2023-09-13 22:59:33,365 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestExportSnapshot timeout: 13 mins 2023-09-13 22:59:33,596 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/62bf382e-8712-1db5-f7ab-e78a401ad305 2023-09-13 22:59:33,596 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobExportSnapshot timeout: 13 mins 2023-09-13 22:59:33,596 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobSecureExportSnapshot timeout: 13 mins 2023-09-13 22:59:33,635 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-09-13 22:59:33,893 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=3, rsPorts=, rsClass=null, numDataNodes=3, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-09-13 22:59:33,893 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/62bf382e-8712-1db5-f7ab-e78a401ad305/cluster_9ec0a0d8-f9f9-a794-7992-e14174bce4fb, deleteOnExit=true 2023-09-13 22:59:33,893 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-09-13 22:59:33,894 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/62bf382e-8712-1db5-f7ab-e78a401ad305/test.cache.data in system properties and HBase conf 2023-09-13 22:59:33,894 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/62bf382e-8712-1db5-f7ab-e78a401ad305/hadoop.tmp.dir in system properties and HBase conf 2023-09-13 22:59:33,895 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/62bf382e-8712-1db5-f7ab-e78a401ad305/hadoop.log.dir in system properties and HBase conf 2023-09-13 22:59:33,895 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/62bf382e-8712-1db5-f7ab-e78a401ad305/mapreduce.cluster.local.dir in system properties and HBase conf 2023-09-13 22:59:33,895 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/62bf382e-8712-1db5-f7ab-e78a401ad305/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-09-13 22:59:33,895 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-09-13 22:59:34,215 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-09-13 22:59:34,220 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/62bf382e-8712-1db5-f7ab-e78a401ad305/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-09-13 22:59:34,220 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/62bf382e-8712-1db5-f7ab-e78a401ad305/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-09-13 22:59:34,221 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/62bf382e-8712-1db5-f7ab-e78a401ad305/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-09-13 22:59:34,221 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/62bf382e-8712-1db5-f7ab-e78a401ad305/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-09-13 22:59:34,221 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/62bf382e-8712-1db5-f7ab-e78a401ad305/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-09-13 22:59:34,222 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/62bf382e-8712-1db5-f7ab-e78a401ad305/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-09-13 22:59:34,222 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/62bf382e-8712-1db5-f7ab-e78a401ad305/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-09-13 22:59:34,222 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/62bf382e-8712-1db5-f7ab-e78a401ad305/dfs.journalnode.edits.dir in system properties and HBase conf 2023-09-13 22:59:34,223 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/62bf382e-8712-1db5-f7ab-e78a401ad305/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-09-13 22:59:34,223 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/62bf382e-8712-1db5-f7ab-e78a401ad305/nfs.dump.dir in system properties and HBase conf 2023-09-13 22:59:34,224 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/62bf382e-8712-1db5-f7ab-e78a401ad305/java.io.tmpdir in system properties and HBase conf 2023-09-13 22:59:34,224 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/62bf382e-8712-1db5-f7ab-e78a401ad305/dfs.journalnode.edits.dir in system properties and HBase conf 2023-09-13 22:59:34,224 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/62bf382e-8712-1db5-f7ab-e78a401ad305/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-09-13 22:59:34,225 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/62bf382e-8712-1db5-f7ab-e78a401ad305/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-09-13 22:59:34,743 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-09-13 22:59:34,748 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-09-13 22:59:35,060 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-09-13 22:59:35,246 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-09-13 22:59:35,260 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-13 22:59:35,302 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-09-13 22:59:35,339 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/62bf382e-8712-1db5-f7ab-e78a401ad305/java.io.tmpdir/Jetty_localhost_45021_hdfs____iu3xtk/webapp 2023-09-13 22:59:35,494 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:45021 2023-09-13 22:59:35,552 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-09-13 22:59:35,553 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-09-13 22:59:36,022 WARN [Listener at localhost/36267] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-09-13 22:59:36,097 WARN [Listener at localhost/36267] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-09-13 22:59:36,116 WARN [Listener at localhost/36267] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-13 22:59:36,123 INFO [Listener at localhost/36267] log.Slf4jLog(67): jetty-6.1.26 2023-09-13 22:59:36,129 INFO [Listener at localhost/36267] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/62bf382e-8712-1db5-f7ab-e78a401ad305/java.io.tmpdir/Jetty_localhost_45953_datanode____.340gir/webapp 2023-09-13 22:59:36,233 INFO [Listener at localhost/36267] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:45953 2023-09-13 22:59:36,648 WARN [Listener at localhost/44423] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-09-13 22:59:36,665 WARN [Listener at localhost/44423] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-09-13 22:59:36,670 WARN [Listener at localhost/44423] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-13 22:59:36,673 INFO [Listener at localhost/44423] log.Slf4jLog(67): jetty-6.1.26 2023-09-13 22:59:36,682 INFO [Listener at localhost/44423] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/62bf382e-8712-1db5-f7ab-e78a401ad305/java.io.tmpdir/Jetty_localhost_36279_datanode____ttr0zc/webapp 2023-09-13 22:59:36,794 INFO [Listener at localhost/44423] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:36279 2023-09-13 22:59:36,809 WARN [Listener at localhost/37245] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-09-13 22:59:36,826 WARN [Listener at localhost/37245] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-09-13 22:59:36,830 WARN [Listener at localhost/37245] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-13 22:59:36,832 INFO [Listener at localhost/37245] log.Slf4jLog(67): jetty-6.1.26 2023-09-13 22:59:36,841 INFO [Listener at localhost/37245] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/62bf382e-8712-1db5-f7ab-e78a401ad305/java.io.tmpdir/Jetty_localhost_38409_datanode____.kqaush/webapp 2023-09-13 22:59:36,969 INFO [Listener at localhost/37245] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:38409 2023-09-13 22:59:36,978 WARN [Listener at localhost/38917] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-09-13 22:59:37,295 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xd70fdc9228e30ff0: Processing first storage report for DS-38af3f20-c426-42e6-b2d0-383211c5c8ef from datanode 964cd63f-69e0-49d8-bddf-a530be028c35 2023-09-13 22:59:37,296 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xd70fdc9228e30ff0: from storage DS-38af3f20-c426-42e6-b2d0-383211c5c8ef node DatanodeRegistration(127.0.0.1:37083, datanodeUuid=964cd63f-69e0-49d8-bddf-a530be028c35, infoPort=33975, infoSecurePort=0, ipcPort=38917, storageInfo=lv=-57;cid=testClusterID;nsid=948370624;c=1694645974831), blocks: 0, hasStaleStorage: true, processing time: 2 msecs, invalidatedBlocks: 0 2023-09-13 22:59:37,297 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x618e3eb050146104: Processing first storage report for DS-4e95c6e2-9353-4291-bebd-193036a96b0a from datanode ed9c1305-af42-4b97-bb47-2563570d7d7f 2023-09-13 22:59:37,297 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x618e3eb050146104: from storage DS-4e95c6e2-9353-4291-bebd-193036a96b0a node DatanodeRegistration(127.0.0.1:45125, datanodeUuid=ed9c1305-af42-4b97-bb47-2563570d7d7f, infoPort=33607, infoSecurePort=0, ipcPort=44423, storageInfo=lv=-57;cid=testClusterID;nsid=948370624;c=1694645974831), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-09-13 22:59:37,297 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xdf4e3f94ecdc89e5: Processing first storage report for DS-a39668b8-1c4f-4f60-b159-8ae4c1b9702e from datanode 4434ad7b-b2ca-4a21-9f5a-5263525be9be 2023-09-13 22:59:37,297 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xdf4e3f94ecdc89e5: from storage DS-a39668b8-1c4f-4f60-b159-8ae4c1b9702e node DatanodeRegistration(127.0.0.1:33705, datanodeUuid=4434ad7b-b2ca-4a21-9f5a-5263525be9be, infoPort=44661, infoSecurePort=0, ipcPort=37245, storageInfo=lv=-57;cid=testClusterID;nsid=948370624;c=1694645974831), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-09-13 22:59:37,297 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xd70fdc9228e30ff0: Processing first storage report for DS-a7e9fd48-d3c5-49d2-b902-ad1923ce5da7 from datanode 964cd63f-69e0-49d8-bddf-a530be028c35 2023-09-13 22:59:37,298 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xd70fdc9228e30ff0: from storage DS-a7e9fd48-d3c5-49d2-b902-ad1923ce5da7 node DatanodeRegistration(127.0.0.1:37083, datanodeUuid=964cd63f-69e0-49d8-bddf-a530be028c35, infoPort=33975, infoSecurePort=0, ipcPort=38917, storageInfo=lv=-57;cid=testClusterID;nsid=948370624;c=1694645974831), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-09-13 22:59:37,298 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x618e3eb050146104: Processing first storage report for DS-169d0fc1-f536-4f10-8350-35a22af4eeb2 from datanode ed9c1305-af42-4b97-bb47-2563570d7d7f 2023-09-13 22:59:37,298 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x618e3eb050146104: from storage DS-169d0fc1-f536-4f10-8350-35a22af4eeb2 node DatanodeRegistration(127.0.0.1:45125, datanodeUuid=ed9c1305-af42-4b97-bb47-2563570d7d7f, infoPort=33607, infoSecurePort=0, ipcPort=44423, storageInfo=lv=-57;cid=testClusterID;nsid=948370624;c=1694645974831), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-09-13 22:59:37,298 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xdf4e3f94ecdc89e5: Processing first storage report for DS-3053afd0-6949-467f-aff4-d22894f6353b from datanode 4434ad7b-b2ca-4a21-9f5a-5263525be9be 2023-09-13 22:59:37,298 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xdf4e3f94ecdc89e5: from storage DS-3053afd0-6949-467f-aff4-d22894f6353b node DatanodeRegistration(127.0.0.1:33705, datanodeUuid=4434ad7b-b2ca-4a21-9f5a-5263525be9be, infoPort=44661, infoSecurePort=0, ipcPort=37245, storageInfo=lv=-57;cid=testClusterID;nsid=948370624;c=1694645974831), blocks: 0, hasStaleStorage: false, processing time: 1 msecs, invalidatedBlocks: 0 2023-09-13 22:59:37,545 DEBUG [Listener at localhost/38917] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/62bf382e-8712-1db5-f7ab-e78a401ad305 2023-09-13 22:59:37,639 INFO [Listener at localhost/38917] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/62bf382e-8712-1db5-f7ab-e78a401ad305/cluster_9ec0a0d8-f9f9-a794-7992-e14174bce4fb/zookeeper_0, clientPort=55012, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/62bf382e-8712-1db5-f7ab-e78a401ad305/cluster_9ec0a0d8-f9f9-a794-7992-e14174bce4fb/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/62bf382e-8712-1db5-f7ab-e78a401ad305/cluster_9ec0a0d8-f9f9-a794-7992-e14174bce4fb/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-09-13 22:59:37,659 INFO [Listener at localhost/38917] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=55012 2023-09-13 22:59:37,666 INFO [Listener at localhost/38917] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-13 22:59:37,668 INFO [Listener at localhost/38917] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-13 22:59:38,358 INFO [Listener at localhost/38917] util.FSUtils(471): Created version file at hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d with version=8 2023-09-13 22:59:38,358 INFO [Listener at localhost/38917] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/hbase-staging 2023-09-13 22:59:38,771 INFO [Listener at localhost/38917] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-09-13 22:59:39,273 INFO [Listener at localhost/38917] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-09-13 22:59:39,305 INFO [Listener at localhost/38917] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-13 22:59:39,305 INFO [Listener at localhost/38917] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-09-13 22:59:39,306 INFO [Listener at localhost/38917] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-09-13 22:59:39,306 INFO [Listener at localhost/38917] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-13 22:59:39,306 INFO [Listener at localhost/38917] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-09-13 22:59:39,448 INFO [Listener at localhost/38917] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-09-13 22:59:39,519 DEBUG [Listener at localhost/38917] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-09-13 22:59:39,611 INFO [Listener at localhost/38917] ipc.NettyRpcServer(120): Bind to /172.31.14.131:36621 2023-09-13 22:59:39,624 INFO [Listener at localhost/38917] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-13 22:59:39,626 INFO [Listener at localhost/38917] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-13 22:59:39,649 INFO [Listener at localhost/38917] zookeeper.RecoverableZooKeeper(93): Process identifier=master:36621 connecting to ZooKeeper ensemble=127.0.0.1:55012 2023-09-13 22:59:39,702 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:366210x0, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-09-13 22:59:39,705 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:36621-0x100a784b9ba0000 connected 2023-09-13 22:59:39,737 DEBUG [Listener at localhost/38917] zookeeper.ZKUtil(164): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-09-13 22:59:39,738 DEBUG [Listener at localhost/38917] zookeeper.ZKUtil(164): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-13 22:59:39,751 DEBUG [Listener at localhost/38917] zookeeper.ZKUtil(164): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-09-13 22:59:39,765 DEBUG [Listener at localhost/38917] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=36621 2023-09-13 22:59:39,765 DEBUG [Listener at localhost/38917] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=36621 2023-09-13 22:59:39,766 DEBUG [Listener at localhost/38917] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=36621 2023-09-13 22:59:39,766 DEBUG [Listener at localhost/38917] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=36621 2023-09-13 22:59:39,766 DEBUG [Listener at localhost/38917] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=36621 2023-09-13 22:59:39,773 INFO [Listener at localhost/38917] master.HMaster(444): hbase.rootdir=hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d, hbase.cluster.distributed=false 2023-09-13 22:59:39,838 INFO [Listener at localhost/38917] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-09-13 22:59:39,838 INFO [Listener at localhost/38917] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-13 22:59:39,838 INFO [Listener at localhost/38917] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-09-13 22:59:39,839 INFO [Listener at localhost/38917] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-09-13 22:59:39,839 INFO [Listener at localhost/38917] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-13 22:59:39,839 INFO [Listener at localhost/38917] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-09-13 22:59:39,843 INFO [Listener at localhost/38917] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-09-13 22:59:39,846 INFO [Listener at localhost/38917] ipc.NettyRpcServer(120): Bind to /172.31.14.131:39163 2023-09-13 22:59:39,849 INFO [Listener at localhost/38917] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-09-13 22:59:39,856 INFO [Listener at localhost/38917] mob.MobFileCache(124): MobFileCache disabled 2023-09-13 22:59:39,857 INFO [Listener at localhost/38917] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-13 22:59:39,859 INFO [Listener at localhost/38917] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-13 22:59:39,861 INFO [Listener at localhost/38917] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:39163 connecting to ZooKeeper ensemble=127.0.0.1:55012 2023-09-13 22:59:39,865 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:391630x0, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-09-13 22:59:39,867 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:39163-0x100a784b9ba0001 connected 2023-09-13 22:59:39,867 DEBUG [Listener at localhost/38917] zookeeper.ZKUtil(164): regionserver:39163-0x100a784b9ba0001, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-09-13 22:59:39,868 DEBUG [Listener at localhost/38917] zookeeper.ZKUtil(164): regionserver:39163-0x100a784b9ba0001, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-13 22:59:39,869 DEBUG [Listener at localhost/38917] zookeeper.ZKUtil(164): regionserver:39163-0x100a784b9ba0001, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-09-13 22:59:39,869 DEBUG [Listener at localhost/38917] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=39163 2023-09-13 22:59:39,870 DEBUG [Listener at localhost/38917] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=39163 2023-09-13 22:59:39,870 DEBUG [Listener at localhost/38917] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=39163 2023-09-13 22:59:39,871 DEBUG [Listener at localhost/38917] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=39163 2023-09-13 22:59:39,872 DEBUG [Listener at localhost/38917] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=39163 2023-09-13 22:59:39,884 INFO [Listener at localhost/38917] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-09-13 22:59:39,884 INFO [Listener at localhost/38917] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-13 22:59:39,885 INFO [Listener at localhost/38917] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-09-13 22:59:39,885 INFO [Listener at localhost/38917] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-09-13 22:59:39,886 INFO [Listener at localhost/38917] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-13 22:59:39,886 INFO [Listener at localhost/38917] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-09-13 22:59:39,886 INFO [Listener at localhost/38917] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-09-13 22:59:39,889 INFO [Listener at localhost/38917] ipc.NettyRpcServer(120): Bind to /172.31.14.131:34119 2023-09-13 22:59:39,890 INFO [Listener at localhost/38917] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-09-13 22:59:39,891 INFO [Listener at localhost/38917] mob.MobFileCache(124): MobFileCache disabled 2023-09-13 22:59:39,892 INFO [Listener at localhost/38917] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-13 22:59:39,894 INFO [Listener at localhost/38917] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-13 22:59:39,897 INFO [Listener at localhost/38917] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:34119 connecting to ZooKeeper ensemble=127.0.0.1:55012 2023-09-13 22:59:39,901 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:341190x0, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-09-13 22:59:39,902 DEBUG [Listener at localhost/38917] zookeeper.ZKUtil(164): regionserver:341190x0, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-09-13 22:59:39,903 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:34119-0x100a784b9ba0002 connected 2023-09-13 22:59:39,903 DEBUG [Listener at localhost/38917] zookeeper.ZKUtil(164): regionserver:341190x0, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-13 22:59:39,904 DEBUG [Listener at localhost/38917] zookeeper.ZKUtil(164): regionserver:34119-0x100a784b9ba0002, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-09-13 22:59:39,905 DEBUG [Listener at localhost/38917] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=34119 2023-09-13 22:59:39,905 DEBUG [Listener at localhost/38917] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=34119 2023-09-13 22:59:39,909 DEBUG [Listener at localhost/38917] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=34119 2023-09-13 22:59:39,909 DEBUG [Listener at localhost/38917] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=34119 2023-09-13 22:59:39,910 DEBUG [Listener at localhost/38917] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=34119 2023-09-13 22:59:39,927 INFO [Listener at localhost/38917] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-09-13 22:59:39,928 INFO [Listener at localhost/38917] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-13 22:59:39,928 INFO [Listener at localhost/38917] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-09-13 22:59:39,928 INFO [Listener at localhost/38917] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-09-13 22:59:39,928 INFO [Listener at localhost/38917] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-13 22:59:39,928 INFO [Listener at localhost/38917] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-09-13 22:59:39,928 INFO [Listener at localhost/38917] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-09-13 22:59:39,930 INFO [Listener at localhost/38917] ipc.NettyRpcServer(120): Bind to /172.31.14.131:42165 2023-09-13 22:59:39,930 INFO [Listener at localhost/38917] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-09-13 22:59:39,931 INFO [Listener at localhost/38917] mob.MobFileCache(124): MobFileCache disabled 2023-09-13 22:59:39,933 INFO [Listener at localhost/38917] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-13 22:59:39,934 INFO [Listener at localhost/38917] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-13 22:59:39,935 INFO [Listener at localhost/38917] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:42165 connecting to ZooKeeper ensemble=127.0.0.1:55012 2023-09-13 22:59:39,939 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:421650x0, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-09-13 22:59:39,940 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:42165-0x100a784b9ba0003 connected 2023-09-13 22:59:39,941 DEBUG [Listener at localhost/38917] zookeeper.ZKUtil(164): regionserver:42165-0x100a784b9ba0003, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-09-13 22:59:39,941 DEBUG [Listener at localhost/38917] zookeeper.ZKUtil(164): regionserver:42165-0x100a784b9ba0003, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-13 22:59:39,942 DEBUG [Listener at localhost/38917] zookeeper.ZKUtil(164): regionserver:42165-0x100a784b9ba0003, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-09-13 22:59:39,943 DEBUG [Listener at localhost/38917] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=42165 2023-09-13 22:59:39,943 DEBUG [Listener at localhost/38917] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=42165 2023-09-13 22:59:39,943 DEBUG [Listener at localhost/38917] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=42165 2023-09-13 22:59:39,944 DEBUG [Listener at localhost/38917] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=42165 2023-09-13 22:59:39,944 DEBUG [Listener at localhost/38917] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=42165 2023-09-13 22:59:39,946 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,36621,1694645978553 2023-09-13 22:59:39,958 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-09-13 22:59:39,959 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,36621,1694645978553 2023-09-13 22:59:39,985 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:42165-0x100a784b9ba0003, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-09-13 22:59:39,985 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:34119-0x100a784b9ba0002, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-09-13 22:59:39,985 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:39163-0x100a784b9ba0001, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-09-13 22:59:39,985 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-09-13 22:59:39,986 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-13 22:59:39,987 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-09-13 22:59:39,988 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,36621,1694645978553 from backup master directory 2023-09-13 22:59:39,988 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-09-13 22:59:39,992 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,36621,1694645978553 2023-09-13 22:59:39,993 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-09-13 22:59:39,993 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-09-13 22:59:39,993 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,36621,1694645978553 2023-09-13 22:59:39,996 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-09-13 22:59:39,998 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-09-13 22:59:40,093 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/hbase.id with ID: 0b6cc1f9-c483-4a04-a6af-2dbef5d72a6f 2023-09-13 22:59:40,133 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-13 22:59:40,149 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-13 22:59:40,197 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x60867b10 to 127.0.0.1:55012 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-13 22:59:40,230 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@579a427, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-13 22:59:40,257 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-09-13 22:59:40,258 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-09-13 22:59:40,276 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-09-13 22:59:40,276 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-09-13 22:59:40,278 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-09-13 22:59:40,282 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-09-13 22:59:40,283 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-09-13 22:59:40,318 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/MasterData/data/master/store-tmp 2023-09-13 22:59:40,355 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-13 22:59:40,356 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-09-13 22:59:40,356 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-13 22:59:40,356 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-13 22:59:40,356 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-09-13 22:59:40,356 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-13 22:59:40,356 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-13 22:59:40,356 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-09-13 22:59:40,358 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/MasterData/WALs/jenkins-hbase4.apache.org,36621,1694645978553 2023-09-13 22:59:40,381 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C36621%2C1694645978553, suffix=, logDir=hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/MasterData/WALs/jenkins-hbase4.apache.org,36621,1694645978553, archiveDir=hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/MasterData/oldWALs, maxLogs=10 2023-09-13 22:59:40,443 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37083,DS-38af3f20-c426-42e6-b2d0-383211c5c8ef,DISK] 2023-09-13 22:59:40,443 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33705,DS-a39668b8-1c4f-4f60-b159-8ae4c1b9702e,DISK] 2023-09-13 22:59:40,443 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45125,DS-4e95c6e2-9353-4291-bebd-193036a96b0a,DISK] 2023-09-13 22:59:40,453 DEBUG [RS-EventLoopGroup-5-1] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-09-13 22:59:40,527 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/MasterData/WALs/jenkins-hbase4.apache.org,36621,1694645978553/jenkins-hbase4.apache.org%2C36621%2C1694645978553.1694645980392 2023-09-13 22:59:40,528 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:37083,DS-38af3f20-c426-42e6-b2d0-383211c5c8ef,DISK], DatanodeInfoWithStorage[127.0.0.1:33705,DS-a39668b8-1c4f-4f60-b159-8ae4c1b9702e,DISK], DatanodeInfoWithStorage[127.0.0.1:45125,DS-4e95c6e2-9353-4291-bebd-193036a96b0a,DISK]] 2023-09-13 22:59:40,528 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-09-13 22:59:40,529 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-13 22:59:40,533 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-09-13 22:59:40,535 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-09-13 22:59:40,598 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-09-13 22:59:40,605 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-09-13 22:59:40,633 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-09-13 22:59:40,645 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-13 22:59:40,650 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-09-13 22:59:40,652 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-09-13 22:59:40,665 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-09-13 22:59:40,669 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-13 22:59:40,670 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67934277, jitterRate=0.012299612164497375}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-13 22:59:40,670 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-09-13 22:59:40,671 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-09-13 22:59:40,692 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-09-13 22:59:40,692 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(561): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-09-13 22:59:40,695 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-09-13 22:59:40,697 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(581): Recovered RegionProcedureStore lease in 1 msec 2023-09-13 22:59:40,733 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(595): Loaded RegionProcedureStore in 35 msec 2023-09-13 22:59:40,733 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-09-13 22:59:40,768 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-09-13 22:59:40,774 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-09-13 22:59:40,799 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-09-13 22:59:40,804 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-09-13 22:59:40,805 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-09-13 22:59:40,811 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-09-13 22:59:40,814 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-09-13 22:59:40,818 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-13 22:59:40,819 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-09-13 22:59:40,820 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-09-13 22:59:40,833 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-09-13 22:59:40,837 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:42165-0x100a784b9ba0003, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-09-13 22:59:40,837 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-09-13 22:59:40,837 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:39163-0x100a784b9ba0001, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-09-13 22:59:40,837 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:34119-0x100a784b9ba0002, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-09-13 22:59:40,838 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-13 22:59:40,838 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,36621,1694645978553, sessionid=0x100a784b9ba0000, setting cluster-up flag (Was=false) 2023-09-13 22:59:40,861 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-13 22:59:40,868 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-09-13 22:59:40,869 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,36621,1694645978553 2023-09-13 22:59:40,876 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-13 22:59:40,882 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-09-13 22:59:40,883 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,36621,1694645978553 2023-09-13 22:59:40,886 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.hbase-snapshot/.tmp 2023-09-13 22:59:40,948 INFO [RS:0;jenkins-hbase4:39163] regionserver.HRegionServer(951): ClusterId : 0b6cc1f9-c483-4a04-a6af-2dbef5d72a6f 2023-09-13 22:59:40,949 INFO [RS:2;jenkins-hbase4:42165] regionserver.HRegionServer(951): ClusterId : 0b6cc1f9-c483-4a04-a6af-2dbef5d72a6f 2023-09-13 22:59:40,948 INFO [RS:1;jenkins-hbase4:34119] regionserver.HRegionServer(951): ClusterId : 0b6cc1f9-c483-4a04-a6af-2dbef5d72a6f 2023-09-13 22:59:40,956 DEBUG [RS:0;jenkins-hbase4:39163] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-09-13 22:59:40,956 DEBUG [RS:2;jenkins-hbase4:42165] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-09-13 22:59:40,956 DEBUG [RS:1;jenkins-hbase4:34119] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-09-13 22:59:40,963 DEBUG [RS:1;jenkins-hbase4:34119] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-09-13 22:59:40,963 DEBUG [RS:2;jenkins-hbase4:42165] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-09-13 22:59:40,963 DEBUG [RS:0;jenkins-hbase4:39163] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-09-13 22:59:40,963 DEBUG [RS:2;jenkins-hbase4:42165] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-09-13 22:59:40,963 DEBUG [RS:1;jenkins-hbase4:34119] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-09-13 22:59:40,964 DEBUG [RS:0;jenkins-hbase4:39163] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-09-13 22:59:40,966 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2930): Registered master coprocessor service: service=AccessControlService 2023-09-13 22:59:40,968 DEBUG [RS:2;jenkins-hbase4:42165] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-09-13 22:59:40,968 DEBUG [RS:1;jenkins-hbase4:34119] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-09-13 22:59:40,969 DEBUG [RS:0;jenkins-hbase4:39163] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-09-13 22:59:40,975 DEBUG [RS:0;jenkins-hbase4:39163] zookeeper.ReadOnlyZKClient(139): Connect 0x04bb76aa to 127.0.0.1:55012 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-13 22:59:40,976 DEBUG [RS:2;jenkins-hbase4:42165] zookeeper.ReadOnlyZKClient(139): Connect 0x2175511e to 127.0.0.1:55012 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-13 22:59:40,975 DEBUG [RS:1;jenkins-hbase4:34119] zookeeper.ReadOnlyZKClient(139): Connect 0x12458e08 to 127.0.0.1:55012 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-13 22:59:40,976 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-13 22:59:40,977 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver loaded, priority=536870912. 2023-09-13 22:59:40,988 DEBUG [RS:0;jenkins-hbase4:39163] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@a7c884d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-13 22:59:40,993 DEBUG [RS:0;jenkins-hbase4:39163] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@e431dda, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-09-13 22:59:40,993 DEBUG [RS:2;jenkins-hbase4:42165] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2fb2ab40, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-13 22:59:40,994 DEBUG [RS:2;jenkins-hbase4:42165] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2b8d3a6e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-09-13 22:59:41,013 DEBUG [RS:1;jenkins-hbase4:34119] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1c827230, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-13 22:59:41,014 DEBUG [RS:1;jenkins-hbase4:34119] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5dbf780b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-09-13 22:59:41,035 DEBUG [RS:1;jenkins-hbase4:34119] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:34119 2023-09-13 22:59:41,035 DEBUG [RS:2;jenkins-hbase4:42165] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:2;jenkins-hbase4:42165 2023-09-13 22:59:41,035 DEBUG [RS:0;jenkins-hbase4:39163] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:39163 2023-09-13 22:59:41,041 INFO [RS:1;jenkins-hbase4:34119] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-09-13 22:59:41,041 INFO [RS:0;jenkins-hbase4:39163] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-09-13 22:59:41,041 INFO [RS:2;jenkins-hbase4:42165] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-09-13 22:59:41,042 INFO [RS:2;jenkins-hbase4:42165] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-09-13 22:59:41,042 INFO [RS:0;jenkins-hbase4:39163] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-09-13 22:59:41,042 INFO [RS:1;jenkins-hbase4:34119] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-09-13 22:59:41,042 DEBUG [RS:2;jenkins-hbase4:42165] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-09-13 22:59:41,042 DEBUG [RS:0;jenkins-hbase4:39163] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-09-13 22:59:41,042 DEBUG [RS:1;jenkins-hbase4:34119] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-09-13 22:59:41,043 INFO [RS:2;jenkins-hbase4:42165] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-13 22:59:41,044 DEBUG [RS:2;jenkins-hbase4:42165] regionserver.HRegionServer(1022): About to register with Master. 2023-09-13 22:59:41,044 INFO [RS:0;jenkins-hbase4:39163] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-13 22:59:41,044 INFO [RS:1;jenkins-hbase4:34119] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-13 22:59:41,044 DEBUG [RS:1;jenkins-hbase4:34119] regionserver.HRegionServer(1022): About to register with Master. 2023-09-13 22:59:41,044 DEBUG [RS:0;jenkins-hbase4:39163] regionserver.HRegionServer(1022): About to register with Master. 2023-09-13 22:59:41,047 INFO [RS:0;jenkins-hbase4:39163] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,36621,1694645978553 with isa=jenkins-hbase4.apache.org/172.31.14.131:39163, startcode=1694645979837 2023-09-13 22:59:41,047 INFO [RS:2;jenkins-hbase4:42165] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,36621,1694645978553 with isa=jenkins-hbase4.apache.org/172.31.14.131:42165, startcode=1694645979926 2023-09-13 22:59:41,047 INFO [RS:1;jenkins-hbase4:34119] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,36621,1694645978553 with isa=jenkins-hbase4.apache.org/172.31.14.131:34119, startcode=1694645979883 2023-09-13 22:59:41,066 DEBUG [RS:1;jenkins-hbase4:34119] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-09-13 22:59:41,066 DEBUG [RS:2;jenkins-hbase4:42165] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-09-13 22:59:41,066 DEBUG [RS:0;jenkins-hbase4:39163] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-09-13 22:59:41,074 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-09-13 22:59:41,084 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-09-13 22:59:41,084 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-09-13 22:59:41,084 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-09-13 22:59:41,084 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-09-13 22:59:41,085 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-09-13 22:59:41,085 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-13 22:59:41,085 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-09-13 22:59:41,085 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-13 22:59:41,089 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1694646011089 2023-09-13 22:59:41,093 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-09-13 22:59:41,108 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-09-13 22:59:41,110 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-09-13 22:59:41,110 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-09-13 22:59:41,116 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-09-13 22:59:41,118 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-09-13 22:59:41,119 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-09-13 22:59:41,120 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-09-13 22:59:41,121 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-09-13 22:59:41,122 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-09-13 22:59:41,125 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-09-13 22:59:41,128 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-09-13 22:59:41,128 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-09-13 22:59:41,132 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:32879, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-09-13 22:59:41,132 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41907, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-09-13 22:59:41,132 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58607, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-09-13 22:59:41,134 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-09-13 22:59:41,135 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-09-13 22:59:41,136 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1694645981136,5,FailOnTimeoutGroup] 2023-09-13 22:59:41,137 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1694645981136,5,FailOnTimeoutGroup] 2023-09-13 22:59:41,137 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-09-13 22:59:41,138 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-09-13 22:59:41,140 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-09-13 22:59:41,140 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-09-13 22:59:41,153 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=36621] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 22:59:41,171 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-09-13 22:59:41,172 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-09-13 22:59:41,172 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=36621] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,34119,1694645979883 2023-09-13 22:59:41,172 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d 2023-09-13 22:59:41,174 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=36621] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 22:59:41,180 DEBUG [RS:0;jenkins-hbase4:39163] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d 2023-09-13 22:59:41,180 DEBUG [RS:1;jenkins-hbase4:34119] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d 2023-09-13 22:59:41,180 DEBUG [RS:2;jenkins-hbase4:42165] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d 2023-09-13 22:59:41,180 DEBUG [RS:1;jenkins-hbase4:34119] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:36267 2023-09-13 22:59:41,180 DEBUG [RS:0;jenkins-hbase4:39163] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:36267 2023-09-13 22:59:41,180 DEBUG [RS:1;jenkins-hbase4:34119] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-09-13 22:59:41,180 DEBUG [RS:2;jenkins-hbase4:42165] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:36267 2023-09-13 22:59:41,181 DEBUG [RS:0;jenkins-hbase4:39163] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-09-13 22:59:41,181 DEBUG [RS:2;jenkins-hbase4:42165] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-09-13 22:59:41,188 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-13 22:59:41,194 DEBUG [RS:2;jenkins-hbase4:42165] zookeeper.ZKUtil(162): regionserver:42165-0x100a784b9ba0003, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 22:59:41,195 WARN [RS:2;jenkins-hbase4:42165] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-09-13 22:59:41,195 DEBUG [RS:0;jenkins-hbase4:39163] zookeeper.ZKUtil(162): regionserver:39163-0x100a784b9ba0001, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 22:59:41,195 DEBUG [RS:1;jenkins-hbase4:34119] zookeeper.ZKUtil(162): regionserver:34119-0x100a784b9ba0002, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34119,1694645979883 2023-09-13 22:59:41,195 WARN [RS:0;jenkins-hbase4:39163] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-09-13 22:59:41,195 INFO [RS:2;jenkins-hbase4:42165] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-09-13 22:59:41,195 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,34119,1694645979883] 2023-09-13 22:59:41,195 INFO [RS:0;jenkins-hbase4:39163] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-09-13 22:59:41,195 WARN [RS:1;jenkins-hbase4:34119] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-09-13 22:59:41,196 DEBUG [RS:2;jenkins-hbase4:42165] regionserver.HRegionServer(1948): logDir=hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/WALs/jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 22:59:41,196 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,42165,1694645979926] 2023-09-13 22:59:41,196 INFO [RS:1;jenkins-hbase4:34119] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-09-13 22:59:41,196 DEBUG [RS:0;jenkins-hbase4:39163] regionserver.HRegionServer(1948): logDir=hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/WALs/jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 22:59:41,197 DEBUG [RS:1;jenkins-hbase4:34119] regionserver.HRegionServer(1948): logDir=hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/WALs/jenkins-hbase4.apache.org,34119,1694645979883 2023-09-13 22:59:41,197 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,39163,1694645979837] 2023-09-13 22:59:41,207 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-13 22:59:41,210 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-09-13 22:59:41,212 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/hbase/meta/1588230740/info 2023-09-13 22:59:41,214 DEBUG [RS:1;jenkins-hbase4:34119] zookeeper.ZKUtil(162): regionserver:34119-0x100a784b9ba0002, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34119,1694645979883 2023-09-13 22:59:41,214 DEBUG [RS:2;jenkins-hbase4:42165] zookeeper.ZKUtil(162): regionserver:42165-0x100a784b9ba0003, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34119,1694645979883 2023-09-13 22:59:41,214 DEBUG [RS:0;jenkins-hbase4:39163] zookeeper.ZKUtil(162): regionserver:39163-0x100a784b9ba0001, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34119,1694645979883 2023-09-13 22:59:41,214 DEBUG [RS:1;jenkins-hbase4:34119] zookeeper.ZKUtil(162): regionserver:34119-0x100a784b9ba0002, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 22:59:41,214 DEBUG [RS:0;jenkins-hbase4:39163] zookeeper.ZKUtil(162): regionserver:39163-0x100a784b9ba0001, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 22:59:41,214 DEBUG [RS:2;jenkins-hbase4:42165] zookeeper.ZKUtil(162): regionserver:42165-0x100a784b9ba0003, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 22:59:41,215 DEBUG [RS:1;jenkins-hbase4:34119] zookeeper.ZKUtil(162): regionserver:34119-0x100a784b9ba0002, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 22:59:41,215 DEBUG [RS:0;jenkins-hbase4:39163] zookeeper.ZKUtil(162): regionserver:39163-0x100a784b9ba0001, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 22:59:41,215 DEBUG [RS:2;jenkins-hbase4:42165] zookeeper.ZKUtil(162): regionserver:42165-0x100a784b9ba0003, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 22:59:41,217 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-09-13 22:59:41,218 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-13 22:59:41,218 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-09-13 22:59:41,221 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/hbase/meta/1588230740/rep_barrier 2023-09-13 22:59:41,222 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-09-13 22:59:41,223 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-13 22:59:41,223 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-09-13 22:59:41,227 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/hbase/meta/1588230740/table 2023-09-13 22:59:41,228 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-09-13 22:59:41,229 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-13 22:59:41,230 DEBUG [RS:1;jenkins-hbase4:34119] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-09-13 22:59:41,230 DEBUG [RS:0;jenkins-hbase4:39163] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-09-13 22:59:41,232 DEBUG [RS:2;jenkins-hbase4:42165] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-09-13 22:59:41,232 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/hbase/meta/1588230740 2023-09-13 22:59:41,235 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/hbase/meta/1588230740 2023-09-13 22:59:41,243 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-09-13 22:59:41,244 INFO [RS:1;jenkins-hbase4:34119] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-09-13 22:59:41,244 INFO [RS:2;jenkins-hbase4:42165] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-09-13 22:59:41,244 INFO [RS:0;jenkins-hbase4:39163] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-09-13 22:59:41,247 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-09-13 22:59:41,251 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-13 22:59:41,252 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68602446, jitterRate=0.02225610613822937}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-09-13 22:59:41,252 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-09-13 22:59:41,252 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-09-13 22:59:41,252 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-09-13 22:59:41,252 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-09-13 22:59:41,252 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-09-13 22:59:41,252 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-09-13 22:59:41,259 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-09-13 22:59:41,259 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-09-13 22:59:41,269 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-09-13 22:59:41,269 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-09-13 22:59:41,279 INFO [RS:2;jenkins-hbase4:42165] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-09-13 22:59:41,279 INFO [RS:1;jenkins-hbase4:34119] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-09-13 22:59:41,279 INFO [RS:0;jenkins-hbase4:39163] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-09-13 22:59:41,285 INFO [RS:2;jenkins-hbase4:42165] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-09-13 22:59:41,285 INFO [RS:1;jenkins-hbase4:34119] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-09-13 22:59:41,285 INFO [RS:2;jenkins-hbase4:42165] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-09-13 22:59:41,285 INFO [RS:1;jenkins-hbase4:34119] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-09-13 22:59:41,285 INFO [RS:0;jenkins-hbase4:39163] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-09-13 22:59:41,286 INFO [RS:0;jenkins-hbase4:39163] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-09-13 22:59:41,286 INFO [RS:2;jenkins-hbase4:42165] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-09-13 22:59:41,287 INFO [RS:1;jenkins-hbase4:34119] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-09-13 22:59:41,288 INFO [RS:0;jenkins-hbase4:39163] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-09-13 22:59:41,289 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-09-13 22:59:41,297 INFO [RS:0;jenkins-hbase4:39163] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-09-13 22:59:41,297 INFO [RS:1;jenkins-hbase4:34119] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-09-13 22:59:41,297 INFO [RS:2;jenkins-hbase4:42165] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-09-13 22:59:41,297 DEBUG [RS:0;jenkins-hbase4:39163] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-13 22:59:41,297 DEBUG [RS:1;jenkins-hbase4:34119] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-13 22:59:41,298 DEBUG [RS:2;jenkins-hbase4:42165] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-13 22:59:41,298 DEBUG [RS:1;jenkins-hbase4:34119] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-13 22:59:41,298 DEBUG [RS:2;jenkins-hbase4:42165] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-13 22:59:41,298 DEBUG [RS:1;jenkins-hbase4:34119] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-13 22:59:41,298 DEBUG [RS:2;jenkins-hbase4:42165] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-13 22:59:41,298 DEBUG [RS:1;jenkins-hbase4:34119] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-13 22:59:41,298 DEBUG [RS:0;jenkins-hbase4:39163] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-13 22:59:41,298 DEBUG [RS:1;jenkins-hbase4:34119] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-13 22:59:41,298 DEBUG [RS:0;jenkins-hbase4:39163] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-13 22:59:41,298 DEBUG [RS:1;jenkins-hbase4:34119] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-09-13 22:59:41,298 DEBUG [RS:0;jenkins-hbase4:39163] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-13 22:59:41,298 DEBUG [RS:1;jenkins-hbase4:34119] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-13 22:59:41,298 DEBUG [RS:0;jenkins-hbase4:39163] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-13 22:59:41,298 DEBUG [RS:2;jenkins-hbase4:42165] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-13 22:59:41,299 DEBUG [RS:0;jenkins-hbase4:39163] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-09-13 22:59:41,299 DEBUG [RS:2;jenkins-hbase4:42165] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-13 22:59:41,299 DEBUG [RS:0;jenkins-hbase4:39163] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-13 22:59:41,299 DEBUG [RS:2;jenkins-hbase4:42165] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-09-13 22:59:41,299 DEBUG [RS:0;jenkins-hbase4:39163] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-13 22:59:41,299 DEBUG [RS:2;jenkins-hbase4:42165] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-13 22:59:41,299 DEBUG [RS:0;jenkins-hbase4:39163] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-13 22:59:41,299 DEBUG [RS:2;jenkins-hbase4:42165] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-13 22:59:41,299 DEBUG [RS:0;jenkins-hbase4:39163] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-13 22:59:41,299 DEBUG [RS:2;jenkins-hbase4:42165] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-13 22:59:41,298 DEBUG [RS:1;jenkins-hbase4:34119] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-13 22:59:41,299 DEBUG [RS:2;jenkins-hbase4:42165] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-13 22:59:41,300 DEBUG [RS:1;jenkins-hbase4:34119] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-13 22:59:41,300 DEBUG [RS:1;jenkins-hbase4:34119] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-13 22:59:41,301 INFO [RS:2;jenkins-hbase4:42165] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-09-13 22:59:41,302 INFO [RS:0;jenkins-hbase4:39163] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-09-13 22:59:41,302 INFO [RS:2;jenkins-hbase4:42165] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-09-13 22:59:41,302 INFO [RS:0;jenkins-hbase4:39163] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-09-13 22:59:41,302 INFO [RS:1;jenkins-hbase4:34119] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-09-13 22:59:41,302 INFO [RS:0;jenkins-hbase4:39163] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-09-13 22:59:41,302 INFO [RS:2;jenkins-hbase4:42165] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-09-13 22:59:41,302 INFO [RS:1;jenkins-hbase4:34119] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-09-13 22:59:41,302 INFO [RS:1;jenkins-hbase4:34119] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-09-13 22:59:41,311 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-09-13 22:59:41,315 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-09-13 22:59:41,325 INFO [RS:2;jenkins-hbase4:42165] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-09-13 22:59:41,325 INFO [RS:1;jenkins-hbase4:34119] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-09-13 22:59:41,325 INFO [RS:0;jenkins-hbase4:39163] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-09-13 22:59:41,328 INFO [RS:1;jenkins-hbase4:34119] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,34119,1694645979883-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-09-13 22:59:41,328 INFO [RS:2;jenkins-hbase4:42165] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42165,1694645979926-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-09-13 22:59:41,328 INFO [RS:0;jenkins-hbase4:39163] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39163,1694645979837-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-09-13 22:59:41,351 INFO [RS:0;jenkins-hbase4:39163] regionserver.Replication(203): jenkins-hbase4.apache.org,39163,1694645979837 started 2023-09-13 22:59:41,351 INFO [RS:1;jenkins-hbase4:34119] regionserver.Replication(203): jenkins-hbase4.apache.org,34119,1694645979883 started 2023-09-13 22:59:41,352 INFO [RS:2;jenkins-hbase4:42165] regionserver.Replication(203): jenkins-hbase4.apache.org,42165,1694645979926 started 2023-09-13 22:59:41,352 INFO [RS:1;jenkins-hbase4:34119] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,34119,1694645979883, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:34119, sessionid=0x100a784b9ba0002 2023-09-13 22:59:41,351 INFO [RS:0;jenkins-hbase4:39163] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,39163,1694645979837, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:39163, sessionid=0x100a784b9ba0001 2023-09-13 22:59:41,352 INFO [RS:2;jenkins-hbase4:42165] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,42165,1694645979926, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:42165, sessionid=0x100a784b9ba0003 2023-09-13 22:59:41,352 DEBUG [RS:2;jenkins-hbase4:42165] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-09-13 22:59:41,352 DEBUG [RS:1;jenkins-hbase4:34119] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-09-13 22:59:41,352 DEBUG [RS:0;jenkins-hbase4:39163] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-09-13 22:59:41,352 DEBUG [RS:1;jenkins-hbase4:34119] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,34119,1694645979883 2023-09-13 22:59:41,352 DEBUG [RS:2;jenkins-hbase4:42165] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 22:59:41,353 DEBUG [RS:1;jenkins-hbase4:34119] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,34119,1694645979883' 2023-09-13 22:59:41,353 DEBUG [RS:2;jenkins-hbase4:42165] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,42165,1694645979926' 2023-09-13 22:59:41,354 DEBUG [RS:2;jenkins-hbase4:42165] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-09-13 22:59:41,353 DEBUG [RS:0;jenkins-hbase4:39163] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 22:59:41,353 DEBUG [RS:1;jenkins-hbase4:34119] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-09-13 22:59:41,354 DEBUG [RS:0;jenkins-hbase4:39163] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,39163,1694645979837' 2023-09-13 22:59:41,354 DEBUG [RS:0;jenkins-hbase4:39163] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-09-13 22:59:41,354 DEBUG [RS:2;jenkins-hbase4:42165] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-09-13 22:59:41,354 DEBUG [RS:0;jenkins-hbase4:39163] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-09-13 22:59:41,354 DEBUG [RS:1;jenkins-hbase4:34119] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-09-13 22:59:41,355 DEBUG [RS:0;jenkins-hbase4:39163] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-09-13 22:59:41,355 DEBUG [RS:1;jenkins-hbase4:34119] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-09-13 22:59:41,355 DEBUG [RS:0;jenkins-hbase4:39163] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-09-13 22:59:41,355 DEBUG [RS:2;jenkins-hbase4:42165] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-09-13 22:59:41,355 DEBUG [RS:0;jenkins-hbase4:39163] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 22:59:41,355 DEBUG [RS:2;jenkins-hbase4:42165] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-09-13 22:59:41,355 DEBUG [RS:1;jenkins-hbase4:34119] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-09-13 22:59:41,356 DEBUG [RS:2;jenkins-hbase4:42165] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 22:59:41,356 DEBUG [RS:2;jenkins-hbase4:42165] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,42165,1694645979926' 2023-09-13 22:59:41,356 DEBUG [RS:2;jenkins-hbase4:42165] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 22:59:41,355 DEBUG [RS:0;jenkins-hbase4:39163] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,39163,1694645979837' 2023-09-13 22:59:41,356 DEBUG [RS:1;jenkins-hbase4:34119] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,34119,1694645979883 2023-09-13 22:59:41,357 DEBUG [RS:0;jenkins-hbase4:39163] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 22:59:41,357 DEBUG [RS:1;jenkins-hbase4:34119] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,34119,1694645979883' 2023-09-13 22:59:41,357 DEBUG [RS:1;jenkins-hbase4:34119] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 22:59:41,357 DEBUG [RS:2;jenkins-hbase4:42165] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 22:59:41,359 DEBUG [RS:1;jenkins-hbase4:34119] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 22:59:41,359 DEBUG [RS:2;jenkins-hbase4:42165] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-09-13 22:59:41,359 DEBUG [RS:0;jenkins-hbase4:39163] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 22:59:41,359 INFO [RS:2;jenkins-hbase4:42165] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-09-13 22:59:41,360 INFO [RS:2;jenkins-hbase4:42165] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-09-13 22:59:41,360 DEBUG [RS:1;jenkins-hbase4:34119] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-09-13 22:59:41,360 INFO [RS:1;jenkins-hbase4:34119] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-09-13 22:59:41,361 INFO [RS:1;jenkins-hbase4:34119] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-09-13 22:59:41,361 DEBUG [RS:0;jenkins-hbase4:39163] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-09-13 22:59:41,361 INFO [RS:0;jenkins-hbase4:39163] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-09-13 22:59:41,362 INFO [RS:0;jenkins-hbase4:39163] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-09-13 22:59:41,467 DEBUG [jenkins-hbase4:36621] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=3, allServersCount=3 2023-09-13 22:59:41,472 DEBUG [jenkins-hbase4:36621] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-13 22:59:41,473 INFO [RS:2;jenkins-hbase4:42165] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C42165%2C1694645979926, suffix=, logDir=hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/WALs/jenkins-hbase4.apache.org,42165,1694645979926, archiveDir=hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/oldWALs, maxLogs=32 2023-09-13 22:59:41,473 INFO [RS:1;jenkins-hbase4:34119] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C34119%2C1694645979883, suffix=, logDir=hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/WALs/jenkins-hbase4.apache.org,34119,1694645979883, archiveDir=hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/oldWALs, maxLogs=32 2023-09-13 22:59:41,473 INFO [RS:0;jenkins-hbase4:39163] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C39163%2C1694645979837, suffix=, logDir=hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/WALs/jenkins-hbase4.apache.org,39163,1694645979837, archiveDir=hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/oldWALs, maxLogs=32 2023-09-13 22:59:41,479 DEBUG [jenkins-hbase4:36621] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-13 22:59:41,479 DEBUG [jenkins-hbase4:36621] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-13 22:59:41,479 DEBUG [jenkins-hbase4:36621] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-13 22:59:41,479 DEBUG [jenkins-hbase4:36621] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-13 22:59:41,482 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,42165,1694645979926, state=OPENING 2023-09-13 22:59:41,497 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-09-13 22:59:41,499 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33705,DS-a39668b8-1c4f-4f60-b159-8ae4c1b9702e,DISK] 2023-09-13 22:59:41,500 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37083,DS-38af3f20-c426-42e6-b2d0-383211c5c8ef,DISK] 2023-09-13 22:59:41,500 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-13 22:59:41,501 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-09-13 22:59:41,503 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45125,DS-4e95c6e2-9353-4291-bebd-193036a96b0a,DISK] 2023-09-13 22:59:41,506 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,42165,1694645979926}] 2023-09-13 22:59:41,522 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33705,DS-a39668b8-1c4f-4f60-b159-8ae4c1b9702e,DISK] 2023-09-13 22:59:41,523 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45125,DS-4e95c6e2-9353-4291-bebd-193036a96b0a,DISK] 2023-09-13 22:59:41,524 INFO [RS:1;jenkins-hbase4:34119] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/WALs/jenkins-hbase4.apache.org,34119,1694645979883/jenkins-hbase4.apache.org%2C34119%2C1694645979883.1694645981478 2023-09-13 22:59:41,529 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37083,DS-38af3f20-c426-42e6-b2d0-383211c5c8ef,DISK] 2023-09-13 22:59:41,529 DEBUG [RS:1;jenkins-hbase4:34119] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:37083,DS-38af3f20-c426-42e6-b2d0-383211c5c8ef,DISK], DatanodeInfoWithStorage[127.0.0.1:45125,DS-4e95c6e2-9353-4291-bebd-193036a96b0a,DISK], DatanodeInfoWithStorage[127.0.0.1:33705,DS-a39668b8-1c4f-4f60-b159-8ae4c1b9702e,DISK]] 2023-09-13 22:59:41,545 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45125,DS-4e95c6e2-9353-4291-bebd-193036a96b0a,DISK] 2023-09-13 22:59:41,545 INFO [RS:0;jenkins-hbase4:39163] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/WALs/jenkins-hbase4.apache.org,39163,1694645979837/jenkins-hbase4.apache.org%2C39163%2C1694645979837.1694645981478 2023-09-13 22:59:41,546 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33705,DS-a39668b8-1c4f-4f60-b159-8ae4c1b9702e,DISK] 2023-09-13 22:59:41,546 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37083,DS-38af3f20-c426-42e6-b2d0-383211c5c8ef,DISK] 2023-09-13 22:59:41,549 DEBUG [RS:0;jenkins-hbase4:39163] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:33705,DS-a39668b8-1c4f-4f60-b159-8ae4c1b9702e,DISK], DatanodeInfoWithStorage[127.0.0.1:45125,DS-4e95c6e2-9353-4291-bebd-193036a96b0a,DISK], DatanodeInfoWithStorage[127.0.0.1:37083,DS-38af3f20-c426-42e6-b2d0-383211c5c8ef,DISK]] 2023-09-13 22:59:41,561 INFO [RS:2;jenkins-hbase4:42165] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/WALs/jenkins-hbase4.apache.org,42165,1694645979926/jenkins-hbase4.apache.org%2C42165%2C1694645979926.1694645981478 2023-09-13 22:59:41,561 DEBUG [RS:2;jenkins-hbase4:42165] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:45125,DS-4e95c6e2-9353-4291-bebd-193036a96b0a,DISK], DatanodeInfoWithStorage[127.0.0.1:33705,DS-a39668b8-1c4f-4f60-b159-8ae4c1b9702e,DISK], DatanodeInfoWithStorage[127.0.0.1:37083,DS-38af3f20-c426-42e6-b2d0-383211c5c8ef,DISK]] 2023-09-13 22:59:41,735 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 22:59:41,738 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-13 22:59:41,741 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37772, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-13 22:59:41,753 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-09-13 22:59:41,754 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-09-13 22:59:41,757 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C42165%2C1694645979926.meta, suffix=.meta, logDir=hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/WALs/jenkins-hbase4.apache.org,42165,1694645979926, archiveDir=hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/oldWALs, maxLogs=32 2023-09-13 22:59:41,781 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37083,DS-38af3f20-c426-42e6-b2d0-383211c5c8ef,DISK] 2023-09-13 22:59:41,781 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45125,DS-4e95c6e2-9353-4291-bebd-193036a96b0a,DISK] 2023-09-13 22:59:41,783 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33705,DS-a39668b8-1c4f-4f60-b159-8ae4c1b9702e,DISK] 2023-09-13 22:59:41,789 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/WALs/jenkins-hbase4.apache.org,42165,1694645979926/jenkins-hbase4.apache.org%2C42165%2C1694645979926.meta.1694645981759.meta 2023-09-13 22:59:41,791 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:37083,DS-38af3f20-c426-42e6-b2d0-383211c5c8ef,DISK], DatanodeInfoWithStorage[127.0.0.1:45125,DS-4e95c6e2-9353-4291-bebd-193036a96b0a,DISK], DatanodeInfoWithStorage[127.0.0.1:33705,DS-a39668b8-1c4f-4f60-b159-8ae4c1b9702e,DISK]] 2023-09-13 22:59:41,792 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-09-13 22:59:41,793 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=AccessControlService 2023-09-13 22:59:41,794 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-13 22:59:41,795 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-09-13 22:59:41,797 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-09-13 22:59:41,799 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-09-13 22:59:41,813 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-09-13 22:59:41,813 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-13 22:59:41,813 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-09-13 22:59:41,813 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-09-13 22:59:41,816 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-09-13 22:59:41,818 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/hbase/meta/1588230740/info 2023-09-13 22:59:41,818 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/hbase/meta/1588230740/info 2023-09-13 22:59:41,819 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-09-13 22:59:41,820 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-13 22:59:41,820 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-09-13 22:59:41,821 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/hbase/meta/1588230740/rep_barrier 2023-09-13 22:59:41,821 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/hbase/meta/1588230740/rep_barrier 2023-09-13 22:59:41,822 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-09-13 22:59:41,823 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-13 22:59:41,823 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-09-13 22:59:41,825 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/hbase/meta/1588230740/table 2023-09-13 22:59:41,825 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/hbase/meta/1588230740/table 2023-09-13 22:59:41,825 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-09-13 22:59:41,826 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-13 22:59:41,828 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/hbase/meta/1588230740 2023-09-13 22:59:41,831 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/hbase/meta/1588230740 2023-09-13 22:59:41,834 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-09-13 22:59:41,836 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-09-13 22:59:41,838 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60572389, jitterRate=-0.09740106761455536}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-09-13 22:59:41,840 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-09-13 22:59:41,850 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1694645981727 2023-09-13 22:59:41,868 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-09-13 22:59:41,869 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-09-13 22:59:41,869 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,42165,1694645979926, state=OPEN 2023-09-13 22:59:41,872 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-09-13 22:59:41,872 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-09-13 22:59:41,878 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=3, resume processing ppid=2 2023-09-13 22:59:41,879 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,42165,1694645979926 in 366 msec 2023-09-13 22:59:41,885 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=2, resume processing ppid=1 2023-09-13 22:59:41,885 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 592 msec 2023-09-13 22:59:41,891 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 905 msec 2023-09-13 22:59:41,891 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1694645981891, completionTime=-1 2023-09-13 22:59:41,891 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=3; waited=0ms, expected min=3 server(s), max=3 server(s), master is running 2023-09-13 22:59:41,891 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-09-13 22:59:42,010 DEBUG [hconnection-0x73fd7489-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-13 22:59:42,013 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37776, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-13 22:59:42,034 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=3 2023-09-13 22:59:42,034 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1694646042034 2023-09-13 22:59:42,034 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1694646102034 2023-09-13 22:59:42,034 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 142 msec 2023-09-13 22:59:42,062 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,36621,1694645978553-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-09-13 22:59:42,062 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,36621,1694645978553-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-09-13 22:59:42,062 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,36621,1694645978553-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-09-13 22:59:42,065 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:36621, period=300000, unit=MILLISECONDS is enabled. 2023-09-13 22:59:42,065 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-09-13 22:59:42,073 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-09-13 22:59:42,086 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-09-13 22:59:42,088 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-09-13 22:59:42,101 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-09-13 22:59:42,105 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-09-13 22:59:42,108 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-13 22:59:42,129 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.tmp/data/hbase/namespace/fc0b72d902cbcbdd7fc3c24accf4ad18 2023-09-13 22:59:42,132 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.tmp/data/hbase/namespace/fc0b72d902cbcbdd7fc3c24accf4ad18 empty. 2023-09-13 22:59:42,133 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.tmp/data/hbase/namespace/fc0b72d902cbcbdd7fc3c24accf4ad18 2023-09-13 22:59:42,133 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-09-13 22:59:42,167 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-09-13 22:59:42,169 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => fc0b72d902cbcbdd7fc3c24accf4ad18, NAME => 'hbase:namespace,,1694645982087.fc0b72d902cbcbdd7fc3c24accf4ad18.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.tmp 2023-09-13 22:59:42,190 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1694645982087.fc0b72d902cbcbdd7fc3c24accf4ad18.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-13 22:59:42,190 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing fc0b72d902cbcbdd7fc3c24accf4ad18, disabling compactions & flushes 2023-09-13 22:59:42,191 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1694645982087.fc0b72d902cbcbdd7fc3c24accf4ad18. 2023-09-13 22:59:42,191 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1694645982087.fc0b72d902cbcbdd7fc3c24accf4ad18. 2023-09-13 22:59:42,191 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1694645982087.fc0b72d902cbcbdd7fc3c24accf4ad18. after waiting 0 ms 2023-09-13 22:59:42,191 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1694645982087.fc0b72d902cbcbdd7fc3c24accf4ad18. 2023-09-13 22:59:42,191 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1694645982087.fc0b72d902cbcbdd7fc3c24accf4ad18. 2023-09-13 22:59:42,191 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for fc0b72d902cbcbdd7fc3c24accf4ad18: 2023-09-13 22:59:42,195 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-09-13 22:59:42,210 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1694645982087.fc0b72d902cbcbdd7fc3c24accf4ad18.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1694645982198"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694645982198"}]},"ts":"1694645982198"} 2023-09-13 22:59:42,237 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-09-13 22:59:42,239 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-13 22:59:42,243 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694645982239"}]},"ts":"1694645982239"} 2023-09-13 22:59:42,248 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-09-13 22:59:42,252 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-13 22:59:42,253 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-13 22:59:42,253 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-13 22:59:42,253 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-13 22:59:42,253 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-13 22:59:42,256 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=fc0b72d902cbcbdd7fc3c24accf4ad18, ASSIGN}] 2023-09-13 22:59:42,258 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=fc0b72d902cbcbdd7fc3c24accf4ad18, ASSIGN 2023-09-13 22:59:42,260 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=fc0b72d902cbcbdd7fc3c24accf4ad18, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42165,1694645979926; forceNewPlan=false, retain=false 2023-09-13 22:59:42,413 INFO [jenkins-hbase4:36621] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-09-13 22:59:42,414 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=fc0b72d902cbcbdd7fc3c24accf4ad18, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 22:59:42,415 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1694645982087.fc0b72d902cbcbdd7fc3c24accf4ad18.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1694645982414"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694645982414"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694645982414"}]},"ts":"1694645982414"} 2023-09-13 22:59:42,419 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure fc0b72d902cbcbdd7fc3c24accf4ad18, server=jenkins-hbase4.apache.org,42165,1694645979926}] 2023-09-13 22:59:42,580 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1694645982087.fc0b72d902cbcbdd7fc3c24accf4ad18. 2023-09-13 22:59:42,581 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => fc0b72d902cbcbdd7fc3c24accf4ad18, NAME => 'hbase:namespace,,1694645982087.fc0b72d902cbcbdd7fc3c24accf4ad18.', STARTKEY => '', ENDKEY => ''} 2023-09-13 22:59:42,581 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:namespace,,1694645982087.fc0b72d902cbcbdd7fc3c24accf4ad18. service=AccessControlService 2023-09-13 22:59:42,582 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-13 22:59:42,582 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace fc0b72d902cbcbdd7fc3c24accf4ad18 2023-09-13 22:59:42,582 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1694645982087.fc0b72d902cbcbdd7fc3c24accf4ad18.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-13 22:59:42,582 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for fc0b72d902cbcbdd7fc3c24accf4ad18 2023-09-13 22:59:42,582 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for fc0b72d902cbcbdd7fc3c24accf4ad18 2023-09-13 22:59:42,585 INFO [StoreOpener-fc0b72d902cbcbdd7fc3c24accf4ad18-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region fc0b72d902cbcbdd7fc3c24accf4ad18 2023-09-13 22:59:42,587 DEBUG [StoreOpener-fc0b72d902cbcbdd7fc3c24accf4ad18-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/hbase/namespace/fc0b72d902cbcbdd7fc3c24accf4ad18/info 2023-09-13 22:59:42,587 DEBUG [StoreOpener-fc0b72d902cbcbdd7fc3c24accf4ad18-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/hbase/namespace/fc0b72d902cbcbdd7fc3c24accf4ad18/info 2023-09-13 22:59:42,588 INFO [StoreOpener-fc0b72d902cbcbdd7fc3c24accf4ad18-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fc0b72d902cbcbdd7fc3c24accf4ad18 columnFamilyName info 2023-09-13 22:59:42,589 INFO [StoreOpener-fc0b72d902cbcbdd7fc3c24accf4ad18-1] regionserver.HStore(310): Store=fc0b72d902cbcbdd7fc3c24accf4ad18/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-13 22:59:42,590 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/hbase/namespace/fc0b72d902cbcbdd7fc3c24accf4ad18 2023-09-13 22:59:42,591 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/hbase/namespace/fc0b72d902cbcbdd7fc3c24accf4ad18 2023-09-13 22:59:42,596 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for fc0b72d902cbcbdd7fc3c24accf4ad18 2023-09-13 22:59:42,599 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/hbase/namespace/fc0b72d902cbcbdd7fc3c24accf4ad18/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-13 22:59:42,600 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened fc0b72d902cbcbdd7fc3c24accf4ad18; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59700988, jitterRate=-0.1103859543800354}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-13 22:59:42,600 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for fc0b72d902cbcbdd7fc3c24accf4ad18: 2023-09-13 22:59:42,602 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1694645982087.fc0b72d902cbcbdd7fc3c24accf4ad18., pid=6, masterSystemTime=1694645982572 2023-09-13 22:59:42,606 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1694645982087.fc0b72d902cbcbdd7fc3c24accf4ad18. 2023-09-13 22:59:42,606 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1694645982087.fc0b72d902cbcbdd7fc3c24accf4ad18. 2023-09-13 22:59:42,607 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=fc0b72d902cbcbdd7fc3c24accf4ad18, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 22:59:42,607 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1694645982087.fc0b72d902cbcbdd7fc3c24accf4ad18.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1694645982607"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1694645982607"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1694645982607"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1694645982607"}]},"ts":"1694645982607"} 2023-09-13 22:59:42,615 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=6, resume processing ppid=5 2023-09-13 22:59:42,615 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure fc0b72d902cbcbdd7fc3c24accf4ad18, server=jenkins-hbase4.apache.org,42165,1694645979926 in 192 msec 2023-09-13 22:59:42,619 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=5, resume processing ppid=4 2023-09-13 22:59:42,619 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=fc0b72d902cbcbdd7fc3c24accf4ad18, ASSIGN in 360 msec 2023-09-13 22:59:42,620 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-13 22:59:42,621 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694645982621"}]},"ts":"1694645982621"} 2023-09-13 22:59:42,623 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-09-13 22:59:42,627 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-09-13 22:59:42,630 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 538 msec 2023-09-13 22:59:42,703 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-09-13 22:59:42,706 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-09-13 22:59:42,706 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-13 22:59:42,743 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-09-13 22:59:42,761 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-09-13 22:59:42,767 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 35 msec 2023-09-13 22:59:42,777 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-09-13 22:59:42,788 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-09-13 22:59:42,795 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 16 msec 2023-09-13 22:59:42,803 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-09-13 22:59:42,810 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-09-13 22:59:42,810 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 2.817sec 2023-09-13 22:59:42,813 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-09-13 22:59:42,815 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-09-13 22:59:42,815 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-09-13 22:59:42,816 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,36621,1694645978553-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-09-13 22:59:42,817 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,36621,1694645978553-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-09-13 22:59:42,836 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster$4(2112): Client=null/null create 'hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-09-13 22:59:42,838 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:acl 2023-09-13 22:59:42,840 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_PRE_OPERATION 2023-09-13 22:59:42,841 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-13 22:59:42,843 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(700): Client=null/null procedure request for creating table: namespace: "hbase" qualifier: "acl" procId is: 9 2023-09-13 22:59:42,844 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.tmp/data/hbase/acl/8cf1f32595287d62a4554a755c1a2190 2023-09-13 22:59:42,845 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.tmp/data/hbase/acl/8cf1f32595287d62a4554a755c1a2190 empty. 2023-09-13 22:59:42,848 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.tmp/data/hbase/acl/8cf1f32595287d62a4554a755c1a2190 2023-09-13 22:59:42,848 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived hbase:acl regions 2023-09-13 22:59:42,852 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-09-13 22:59:42,855 DEBUG [Listener at localhost/38917] zookeeper.ReadOnlyZKClient(139): Connect 0x4d32f7c5 to 127.0.0.1:55012 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-13 22:59:42,863 DEBUG [Listener at localhost/38917] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4f3f5cbd, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-13 22:59:42,879 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.tmp/data/hbase/acl/.tabledesc/.tableinfo.0000000001 2023-09-13 22:59:42,882 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(7675): creating {ENCODED => 8cf1f32595287d62a4554a755c1a2190, NAME => 'hbase:acl,,1694645982832.8cf1f32595287d62a4554a755c1a2190.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.tmp 2023-09-13 22:59:42,885 DEBUG [hconnection-0x342dd8d7-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-13 22:59:42,910 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37782, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-13 22:59:42,911 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(866): Instantiated hbase:acl,,1694645982832.8cf1f32595287d62a4554a755c1a2190.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-13 22:59:42,911 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1604): Closing 8cf1f32595287d62a4554a755c1a2190, disabling compactions & flushes 2023-09-13 22:59:42,911 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1626): Closing region hbase:acl,,1694645982832.8cf1f32595287d62a4554a755c1a2190. 2023-09-13 22:59:42,911 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1694645982832.8cf1f32595287d62a4554a755c1a2190. 2023-09-13 22:59:42,911 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1694645982832.8cf1f32595287d62a4554a755c1a2190. after waiting 0 ms 2023-09-13 22:59:42,911 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1694645982832.8cf1f32595287d62a4554a755c1a2190. 2023-09-13 22:59:42,911 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1838): Closed hbase:acl,,1694645982832.8cf1f32595287d62a4554a755c1a2190. 2023-09-13 22:59:42,911 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1558): Region close journal for 8cf1f32595287d62a4554a755c1a2190: 2023-09-13 22:59:42,914 INFO [Listener at localhost/38917] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,36621,1694645978553 2023-09-13 22:59:42,914 INFO [Listener at localhost/38917] hbase.HBaseTestingUtility(2699): Starting mini mapreduce cluster... 2023-09-13 22:59:42,914 INFO [Listener at localhost/38917] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/62bf382e-8712-1db5-f7ab-e78a401ad305/test.cache.data in system properties and HBase conf 2023-09-13 22:59:42,914 INFO [Listener at localhost/38917] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/62bf382e-8712-1db5-f7ab-e78a401ad305/hadoop.tmp.dir in system properties and HBase conf 2023-09-13 22:59:42,914 INFO [Listener at localhost/38917] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/62bf382e-8712-1db5-f7ab-e78a401ad305/hadoop.log.dir in system properties and HBase conf 2023-09-13 22:59:42,914 INFO [Listener at localhost/38917] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/62bf382e-8712-1db5-f7ab-e78a401ad305/mapreduce.cluster.local.dir in system properties and HBase conf 2023-09-13 22:59:42,914 INFO [Listener at localhost/38917] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/62bf382e-8712-1db5-f7ab-e78a401ad305/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-09-13 22:59:42,915 INFO [Listener at localhost/38917] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-09-13 22:59:42,915 INFO [Listener at localhost/38917] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/62bf382e-8712-1db5-f7ab-e78a401ad305/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-09-13 22:59:42,915 INFO [Listener at localhost/38917] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/62bf382e-8712-1db5-f7ab-e78a401ad305/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-09-13 22:59:42,915 INFO [Listener at localhost/38917] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/62bf382e-8712-1db5-f7ab-e78a401ad305/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-09-13 22:59:42,915 INFO [Listener at localhost/38917] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/62bf382e-8712-1db5-f7ab-e78a401ad305/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-09-13 22:59:42,915 INFO [Listener at localhost/38917] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/62bf382e-8712-1db5-f7ab-e78a401ad305/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-09-13 22:59:42,915 INFO [Listener at localhost/38917] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/62bf382e-8712-1db5-f7ab-e78a401ad305/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-09-13 22:59:42,915 INFO [Listener at localhost/38917] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/62bf382e-8712-1db5-f7ab-e78a401ad305/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-09-13 22:59:42,915 INFO [Listener at localhost/38917] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/62bf382e-8712-1db5-f7ab-e78a401ad305/dfs.journalnode.edits.dir in system properties and HBase conf 2023-09-13 22:59:42,915 INFO [Listener at localhost/38917] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/62bf382e-8712-1db5-f7ab-e78a401ad305/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-09-13 22:59:42,916 INFO [Listener at localhost/38917] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/62bf382e-8712-1db5-f7ab-e78a401ad305/nfs.dump.dir in system properties and HBase conf 2023-09-13 22:59:42,916 INFO [Listener at localhost/38917] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/62bf382e-8712-1db5-f7ab-e78a401ad305/java.io.tmpdir in system properties and HBase conf 2023-09-13 22:59:42,916 INFO [Listener at localhost/38917] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/62bf382e-8712-1db5-f7ab-e78a401ad305/dfs.journalnode.edits.dir in system properties and HBase conf 2023-09-13 22:59:42,916 INFO [Listener at localhost/38917] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/62bf382e-8712-1db5-f7ab-e78a401ad305/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-09-13 22:59:42,916 INFO [Listener at localhost/38917] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/62bf382e-8712-1db5-f7ab-e78a401ad305/fs.s3a.committer.staging.tmp.path in system properties and HBase conf 2023-09-13 22:59:42,916 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ADD_TO_META 2023-09-13 22:59:42,917 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:acl,,1694645982832.8cf1f32595287d62a4554a755c1a2190.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1694645982917"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694645982917"}]},"ts":"1694645982917"} 2023-09-13 22:59:42,920 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-09-13 22:59:42,922 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-13 22:59:42,922 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694645982922"}]},"ts":"1694645982922"} 2023-09-13 22:59:42,925 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLING in hbase:meta 2023-09-13 22:59:42,929 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-13 22:59:42,930 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-13 22:59:42,930 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-13 22:59:42,930 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-13 22:59:42,930 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-13 22:59:42,931 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=8cf1f32595287d62a4554a755c1a2190, ASSIGN}] 2023-09-13 22:59:42,933 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=8cf1f32595287d62a4554a755c1a2190, ASSIGN 2023-09-13 22:59:42,935 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:acl, region=8cf1f32595287d62a4554a755c1a2190, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39163,1694645979837; forceNewPlan=false, retain=false 2023-09-13 22:59:42,955 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-09-13 22:59:43,085 INFO [jenkins-hbase4:36621] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-09-13 22:59:43,086 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=8cf1f32595287d62a4554a755c1a2190, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 22:59:43,087 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:acl,,1694645982832.8cf1f32595287d62a4554a755c1a2190.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1694645983086"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694645983086"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694645983086"}]},"ts":"1694645983086"} 2023-09-13 22:59:43,090 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure 8cf1f32595287d62a4554a755c1a2190, server=jenkins-hbase4.apache.org,39163,1694645979837}] 2023-09-13 22:59:43,156 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-09-13 22:59:43,245 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 22:59:43,245 DEBUG [RSProcedureDispatcher-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-13 22:59:43,250 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41910, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-13 22:59:43,256 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:acl,,1694645982832.8cf1f32595287d62a4554a755c1a2190. 2023-09-13 22:59:43,257 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 8cf1f32595287d62a4554a755c1a2190, NAME => 'hbase:acl,,1694645982832.8cf1f32595287d62a4554a755c1a2190.', STARTKEY => '', ENDKEY => ''} 2023-09-13 22:59:43,257 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:acl,,1694645982832.8cf1f32595287d62a4554a755c1a2190. service=AccessControlService 2023-09-13 22:59:43,257 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-13 22:59:43,257 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table acl 8cf1f32595287d62a4554a755c1a2190 2023-09-13 22:59:43,258 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:acl,,1694645982832.8cf1f32595287d62a4554a755c1a2190.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-13 22:59:43,258 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 8cf1f32595287d62a4554a755c1a2190 2023-09-13 22:59:43,258 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 8cf1f32595287d62a4554a755c1a2190 2023-09-13 22:59:43,260 INFO [StoreOpener-8cf1f32595287d62a4554a755c1a2190-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family l of region 8cf1f32595287d62a4554a755c1a2190 2023-09-13 22:59:43,263 DEBUG [StoreOpener-8cf1f32595287d62a4554a755c1a2190-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/hbase/acl/8cf1f32595287d62a4554a755c1a2190/l 2023-09-13 22:59:43,263 DEBUG [StoreOpener-8cf1f32595287d62a4554a755c1a2190-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/hbase/acl/8cf1f32595287d62a4554a755c1a2190/l 2023-09-13 22:59:43,263 INFO [StoreOpener-8cf1f32595287d62a4554a755c1a2190-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8cf1f32595287d62a4554a755c1a2190 columnFamilyName l 2023-09-13 22:59:43,264 INFO [StoreOpener-8cf1f32595287d62a4554a755c1a2190-1] regionserver.HStore(310): Store=8cf1f32595287d62a4554a755c1a2190/l, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-13 22:59:43,266 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/hbase/acl/8cf1f32595287d62a4554a755c1a2190 2023-09-13 22:59:43,267 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/hbase/acl/8cf1f32595287d62a4554a755c1a2190 2023-09-13 22:59:43,271 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 8cf1f32595287d62a4554a755c1a2190 2023-09-13 22:59:43,275 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/hbase/acl/8cf1f32595287d62a4554a755c1a2190/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-13 22:59:43,276 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 8cf1f32595287d62a4554a755c1a2190; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59301082, jitterRate=-0.11634501814842224}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-13 22:59:43,277 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 8cf1f32595287d62a4554a755c1a2190: 2023-09-13 22:59:43,282 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:acl,,1694645982832.8cf1f32595287d62a4554a755c1a2190., pid=11, masterSystemTime=1694645983245 2023-09-13 22:59:43,287 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:acl,,1694645982832.8cf1f32595287d62a4554a755c1a2190. 2023-09-13 22:59:43,287 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:acl,,1694645982832.8cf1f32595287d62a4554a755c1a2190. 2023-09-13 22:59:43,289 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=8cf1f32595287d62a4554a755c1a2190, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 22:59:43,289 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:acl,,1694645982832.8cf1f32595287d62a4554a755c1a2190.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1694645983289"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1694645983289"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1694645983289"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1694645983289"}]},"ts":"1694645983289"} 2023-09-13 22:59:43,296 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=11, resume processing ppid=10 2023-09-13 22:59:43,296 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure 8cf1f32595287d62a4554a755c1a2190, server=jenkins-hbase4.apache.org,39163,1694645979837 in 202 msec 2023-09-13 22:59:43,300 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=10, resume processing ppid=9 2023-09-13 22:59:43,300 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=hbase:acl, region=8cf1f32595287d62a4554a755c1a2190, ASSIGN in 366 msec 2023-09-13 22:59:43,301 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-13 22:59:43,302 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694645983301"}]},"ts":"1694645983301"} 2023-09-13 22:59:43,304 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLED in hbase:meta 2023-09-13 22:59:43,308 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_POST_OPERATION 2023-09-13 22:59:43,312 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=9, state=SUCCESS; CreateTableProcedure table=hbase:acl in 473 msec 2023-09-13 22:59:43,456 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-09-13 22:59:43,456 INFO [master/jenkins-hbase4:0:becomeActiveMaster] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: hbase:acl, procId: 9 completed 2023-09-13 22:59:43,464 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-09-13 22:59:44,116 WARN [Thread-383] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-13 22:59:44,467 INFO [Thread-383] log.Slf4jLog(67): jetty-6.1.26 2023-09-13 22:59:44,474 INFO [Thread-383] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/jobhistory to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/62bf382e-8712-1db5-f7ab-e78a401ad305/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_34677_jobhistory____.wzwkxu/webapp 2023-09-13 22:59:44,656 INFO [Thread-383] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices as a root resource class 2023-09-13 22:59:44,656 INFO [Thread-383] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver as a provider class 2023-09-13 22:59:44,656 INFO [Thread-383] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-09-13 22:59:44,659 INFO [Thread-383] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-09-13 22:59:44,751 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-13 22:59:45,110 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-13 22:59:45,394 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices to GuiceManagedComponentProvider with the scope "PerRequest" 2023-09-13 22:59:45,428 INFO [Thread-383] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:34677 2023-09-13 22:59:45,613 WARN [Listener at jenkins-hbase4.apache.org/34373] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-13 22:59:45,897 WARN [Listener at jenkins-hbase4.apache.org/34373] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-09-13 22:59:45,897 INFO [Listener at jenkins-hbase4.apache.org/34373] log.Slf4jLog(67): jetty-6.1.26 2023-09-13 22:59:45,905 INFO [Listener at jenkins-hbase4.apache.org/34373] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/cluster to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/62bf382e-8712-1db5-f7ab-e78a401ad305/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_38985_cluster____bhjtf/webapp 2023-09-13 22:59:45,974 INFO [Listener at jenkins-hbase4.apache.org/34373] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver as a provider class 2023-09-13 22:59:45,974 INFO [Listener at jenkins-hbase4.apache.org/34373] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices as a root resource class 2023-09-13 22:59:45,974 INFO [Listener at jenkins-hbase4.apache.org/34373] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-09-13 22:59:45,974 INFO [Listener at jenkins-hbase4.apache.org/34373] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-09-13 22:59:45,983 INFO [Listener at jenkins-hbase4.apache.org/34373] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-13 22:59:46,148 INFO [Listener at jenkins-hbase4.apache.org/34373] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-13 22:59:46,227 INFO [Listener at jenkins-hbase4.apache.org/34373] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-13 22:59:46,238 INFO [Listener at jenkins-hbase4.apache.org/34373] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:38985 2023-09-13 22:59:46,673 WARN [Listener at jenkins-hbase4.apache.org/44735] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-13 22:59:46,706 WARN [Listener at jenkins-hbase4.apache.org/44735] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-09-13 22:59:46,707 INFO [Listener at jenkins-hbase4.apache.org/44735] log.Slf4jLog(67): jetty-6.1.26 2023-09-13 22:59:46,716 INFO [Listener at jenkins-hbase4.apache.org/44735] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/62bf382e-8712-1db5-f7ab-e78a401ad305/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_40279_node____.k8siei/webapp 2023-09-13 22:59:46,778 INFO [Listener at jenkins-hbase4.apache.org/44735] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-09-13 22:59:46,778 INFO [Listener at jenkins-hbase4.apache.org/44735] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-09-13 22:59:46,779 INFO [Listener at jenkins-hbase4.apache.org/44735] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-09-13 22:59:46,779 INFO [Listener at jenkins-hbase4.apache.org/44735] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-09-13 22:59:46,791 INFO [Listener at jenkins-hbase4.apache.org/44735] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-13 22:59:46,812 INFO [Listener at jenkins-hbase4.apache.org/44735] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-13 22:59:46,917 INFO [Listener at jenkins-hbase4.apache.org/44735] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-13 22:59:46,927 INFO [Listener at jenkins-hbase4.apache.org/44735] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:40279 2023-09-13 22:59:47,109 WARN [Listener at jenkins-hbase4.apache.org/37017] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-13 22:59:47,118 WARN [Listener at jenkins-hbase4.apache.org/37017] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-09-13 22:59:47,119 INFO [Listener at jenkins-hbase4.apache.org/37017] log.Slf4jLog(67): jetty-6.1.26 2023-09-13 22:59:47,125 INFO [Listener at jenkins-hbase4.apache.org/37017] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/62bf382e-8712-1db5-f7ab-e78a401ad305/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_34461_node____y194bw/webapp 2023-09-13 22:59:47,177 INFO [Listener at jenkins-hbase4.apache.org/37017] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-09-13 22:59:47,177 INFO [Listener at jenkins-hbase4.apache.org/37017] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-09-13 22:59:47,177 INFO [Listener at jenkins-hbase4.apache.org/37017] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-09-13 22:59:47,177 INFO [Listener at jenkins-hbase4.apache.org/37017] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-09-13 22:59:47,185 INFO [Listener at jenkins-hbase4.apache.org/37017] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-13 22:59:47,198 INFO [Listener at jenkins-hbase4.apache.org/37017] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-13 22:59:47,281 INFO [Listener at jenkins-hbase4.apache.org/37017] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-13 22:59:47,288 INFO [Listener at jenkins-hbase4.apache.org/37017] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:34461 2023-09-13 22:59:47,310 INFO [Listener at jenkins-hbase4.apache.org/37017] hbase.HBaseTestingUtility(2726): Mini mapreduce cluster started 2023-09-13 22:59:47,312 INFO [Listener at jenkins-hbase4.apache.org/37017] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2023-09-13 22:59:47,371 INFO [Listener at jenkins-hbase4.apache.org/37017] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=704, OpenFileDescriptor=898, MaxFileDescriptor=60000, SystemLoadAverage=133, ProcessCount=165, AvailableMemoryMB=9720 2023-09-13 22:59:47,371 WARN [Listener at jenkins-hbase4.apache.org/37017] hbase.ResourceChecker(130): Thread=704 is superior to 500 2023-09-13 22:59:47,377 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-13 22:59:47,397 DEBUG [Listener at jenkins-hbase4.apache.org/37017] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-09-13 22:59:47,406 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49728, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-09-13 22:59:47,420 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-13 22:59:47,423 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] procedure2.ProcedureExecutor(1028): Stored pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportWithTargetName 2023-09-13 22:59:47,425 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_PRE_OPERATION 2023-09-13 22:59:47,426 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportWithTargetName" procId is: 12 2023-09-13 22:59:47,428 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-13 22:59:47,429 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-09-13 22:59:47,432 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.tmp/data/default/testtb-testExportWithTargetName/c3d984d6c94a53e33c927052ad5b968b 2023-09-13 22:59:47,432 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.tmp/data/default/testtb-testExportWithTargetName/60872addc3af4ca2561aec68d0f8f9b5 2023-09-13 22:59:47,433 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.tmp/data/default/testtb-testExportWithTargetName/c3d984d6c94a53e33c927052ad5b968b empty. 2023-09-13 22:59:47,433 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.tmp/data/default/testtb-testExportWithTargetName/60872addc3af4ca2561aec68d0f8f9b5 empty. 2023-09-13 22:59:47,439 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.tmp/data/default/testtb-testExportWithTargetName/c3d984d6c94a53e33c927052ad5b968b 2023-09-13 22:59:47,439 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.tmp/data/default/testtb-testExportWithTargetName/60872addc3af4ca2561aec68d0f8f9b5 2023-09-13 22:59:47,440 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-09-13 22:59:47,503 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.tmp/data/default/testtb-testExportWithTargetName/.tabledesc/.tableinfo.0000000001 2023-09-13 22:59:47,505 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(7675): creating {ENCODED => 60872addc3af4ca2561aec68d0f8f9b5, NAME => 'testtb-testExportWithTargetName,1,1694645987419.60872addc3af4ca2561aec68d0f8f9b5.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.tmp 2023-09-13 22:59:47,505 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(7675): creating {ENCODED => c3d984d6c94a53e33c927052ad5b968b, NAME => 'testtb-testExportWithTargetName,,1694645987419.c3d984d6c94a53e33c927052ad5b968b.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.tmp 2023-09-13 22:59:47,531 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-09-13 22:59:47,573 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1694645987419.60872addc3af4ca2561aec68d0f8f9b5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-13 22:59:47,574 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1604): Closing 60872addc3af4ca2561aec68d0f8f9b5, disabling compactions & flushes 2023-09-13 22:59:47,573 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1694645987419.c3d984d6c94a53e33c927052ad5b968b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-13 22:59:47,574 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1694645987419.60872addc3af4ca2561aec68d0f8f9b5. 2023-09-13 22:59:47,574 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1604): Closing c3d984d6c94a53e33c927052ad5b968b, disabling compactions & flushes 2023-09-13 22:59:47,574 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1694645987419.c3d984d6c94a53e33c927052ad5b968b. 2023-09-13 22:59:47,574 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1694645987419.c3d984d6c94a53e33c927052ad5b968b. 2023-09-13 22:59:47,574 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1694645987419.c3d984d6c94a53e33c927052ad5b968b. after waiting 0 ms 2023-09-13 22:59:47,574 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1694645987419.c3d984d6c94a53e33c927052ad5b968b. 2023-09-13 22:59:47,574 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1694645987419.c3d984d6c94a53e33c927052ad5b968b. 2023-09-13 22:59:47,574 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1558): Region close journal for c3d984d6c94a53e33c927052ad5b968b: 2023-09-13 22:59:47,574 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1694645987419.60872addc3af4ca2561aec68d0f8f9b5. 2023-09-13 22:59:47,575 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1694645987419.60872addc3af4ca2561aec68d0f8f9b5. after waiting 0 ms 2023-09-13 22:59:47,575 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1694645987419.60872addc3af4ca2561aec68d0f8f9b5. 2023-09-13 22:59:47,575 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1694645987419.60872addc3af4ca2561aec68d0f8f9b5. 2023-09-13 22:59:47,575 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1558): Region close journal for 60872addc3af4ca2561aec68d0f8f9b5: 2023-09-13 22:59:47,584 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ADD_TO_META 2023-09-13 22:59:47,586 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1694645987419.c3d984d6c94a53e33c927052ad5b968b.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1694645987586"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694645987586"}]},"ts":"1694645987586"} 2023-09-13 22:59:47,586 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1694645987419.60872addc3af4ca2561aec68d0f8f9b5.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1694645987586"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694645987586"}]},"ts":"1694645987586"} 2023-09-13 22:59:47,607 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-09-13 22:59:47,609 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-09-13 22:59:47,610 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:acl' 2023-09-13 22:59:47,641 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-13 22:59:47,643 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-13 22:59:47,643 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694645987643"}]},"ts":"1694645987643"} 2023-09-13 22:59:47,645 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLING in hbase:meta 2023-09-13 22:59:47,650 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-13 22:59:47,652 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-13 22:59:47,652 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-13 22:59:47,652 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-13 22:59:47,652 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-13 22:59:47,652 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=c3d984d6c94a53e33c927052ad5b968b, ASSIGN}, {pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=60872addc3af4ca2561aec68d0f8f9b5, ASSIGN}] 2023-09-13 22:59:47,655 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=60872addc3af4ca2561aec68d0f8f9b5, ASSIGN 2023-09-13 22:59:47,655 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=c3d984d6c94a53e33c927052ad5b968b, ASSIGN 2023-09-13 22:59:47,657 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=60872addc3af4ca2561aec68d0f8f9b5, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42165,1694645979926; forceNewPlan=false, retain=false 2023-09-13 22:59:47,657 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=c3d984d6c94a53e33c927052ad5b968b, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39163,1694645979837; forceNewPlan=false, retain=false 2023-09-13 22:59:47,734 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-09-13 22:59:47,807 INFO [jenkins-hbase4:36621] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-13 22:59:47,810 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=60872addc3af4ca2561aec68d0f8f9b5, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 22:59:47,810 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=c3d984d6c94a53e33c927052ad5b968b, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 22:59:47,810 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1694645987419.60872addc3af4ca2561aec68d0f8f9b5.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1694645987810"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694645987810"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694645987810"}]},"ts":"1694645987810"} 2023-09-13 22:59:47,810 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1694645987419.c3d984d6c94a53e33c927052ad5b968b.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1694645987810"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694645987810"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694645987810"}]},"ts":"1694645987810"} 2023-09-13 22:59:47,813 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=15, ppid=13, state=RUNNABLE; OpenRegionProcedure c3d984d6c94a53e33c927052ad5b968b, server=jenkins-hbase4.apache.org,39163,1694645979837}] 2023-09-13 22:59:47,814 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=16, ppid=14, state=RUNNABLE; OpenRegionProcedure 60872addc3af4ca2561aec68d0f8f9b5, server=jenkins-hbase4.apache.org,42165,1694645979926}] 2023-09-13 22:59:47,976 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,,1694645987419.c3d984d6c94a53e33c927052ad5b968b. 2023-09-13 22:59:47,977 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => c3d984d6c94a53e33c927052ad5b968b, NAME => 'testtb-testExportWithTargetName,,1694645987419.c3d984d6c94a53e33c927052ad5b968b.', STARTKEY => '', ENDKEY => '1'} 2023-09-13 22:59:47,977 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,,1694645987419.c3d984d6c94a53e33c927052ad5b968b. service=AccessControlService 2023-09-13 22:59:47,977 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-13 22:59:47,977 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName c3d984d6c94a53e33c927052ad5b968b 2023-09-13 22:59:47,977 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1694645987419.c3d984d6c94a53e33c927052ad5b968b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-13 22:59:47,977 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for c3d984d6c94a53e33c927052ad5b968b 2023-09-13 22:59:47,977 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for c3d984d6c94a53e33c927052ad5b968b 2023-09-13 22:59:47,979 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,1,1694645987419.60872addc3af4ca2561aec68d0f8f9b5. 2023-09-13 22:59:47,979 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 60872addc3af4ca2561aec68d0f8f9b5, NAME => 'testtb-testExportWithTargetName,1,1694645987419.60872addc3af4ca2561aec68d0f8f9b5.', STARTKEY => '1', ENDKEY => ''} 2023-09-13 22:59:47,979 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,1,1694645987419.60872addc3af4ca2561aec68d0f8f9b5. service=AccessControlService 2023-09-13 22:59:47,980 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-13 22:59:47,980 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName 60872addc3af4ca2561aec68d0f8f9b5 2023-09-13 22:59:47,980 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1694645987419.60872addc3af4ca2561aec68d0f8f9b5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-13 22:59:47,980 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 60872addc3af4ca2561aec68d0f8f9b5 2023-09-13 22:59:47,980 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 60872addc3af4ca2561aec68d0f8f9b5 2023-09-13 22:59:47,982 INFO [StoreOpener-c3d984d6c94a53e33c927052ad5b968b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region c3d984d6c94a53e33c927052ad5b968b 2023-09-13 22:59:47,982 INFO [StoreOpener-60872addc3af4ca2561aec68d0f8f9b5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 60872addc3af4ca2561aec68d0f8f9b5 2023-09-13 22:59:47,984 DEBUG [StoreOpener-c3d984d6c94a53e33c927052ad5b968b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/default/testtb-testExportWithTargetName/c3d984d6c94a53e33c927052ad5b968b/cf 2023-09-13 22:59:47,984 DEBUG [StoreOpener-c3d984d6c94a53e33c927052ad5b968b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/default/testtb-testExportWithTargetName/c3d984d6c94a53e33c927052ad5b968b/cf 2023-09-13 22:59:47,984 DEBUG [StoreOpener-60872addc3af4ca2561aec68d0f8f9b5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/default/testtb-testExportWithTargetName/60872addc3af4ca2561aec68d0f8f9b5/cf 2023-09-13 22:59:47,984 DEBUG [StoreOpener-60872addc3af4ca2561aec68d0f8f9b5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/default/testtb-testExportWithTargetName/60872addc3af4ca2561aec68d0f8f9b5/cf 2023-09-13 22:59:47,987 INFO [StoreOpener-c3d984d6c94a53e33c927052ad5b968b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c3d984d6c94a53e33c927052ad5b968b columnFamilyName cf 2023-09-13 22:59:47,987 INFO [StoreOpener-60872addc3af4ca2561aec68d0f8f9b5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 60872addc3af4ca2561aec68d0f8f9b5 columnFamilyName cf 2023-09-13 22:59:47,990 INFO [StoreOpener-60872addc3af4ca2561aec68d0f8f9b5-1] regionserver.HStore(310): Store=60872addc3af4ca2561aec68d0f8f9b5/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-13 22:59:47,991 INFO [StoreOpener-c3d984d6c94a53e33c927052ad5b968b-1] regionserver.HStore(310): Store=c3d984d6c94a53e33c927052ad5b968b/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-13 22:59:47,993 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/default/testtb-testExportWithTargetName/60872addc3af4ca2561aec68d0f8f9b5 2023-09-13 22:59:47,994 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/default/testtb-testExportWithTargetName/c3d984d6c94a53e33c927052ad5b968b 2023-09-13 22:59:47,994 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/default/testtb-testExportWithTargetName/60872addc3af4ca2561aec68d0f8f9b5 2023-09-13 22:59:47,996 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/default/testtb-testExportWithTargetName/c3d984d6c94a53e33c927052ad5b968b 2023-09-13 22:59:47,999 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 60872addc3af4ca2561aec68d0f8f9b5 2023-09-13 22:59:48,000 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for c3d984d6c94a53e33c927052ad5b968b 2023-09-13 22:59:48,009 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/default/testtb-testExportWithTargetName/60872addc3af4ca2561aec68d0f8f9b5/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-13 22:59:48,010 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/default/testtb-testExportWithTargetName/c3d984d6c94a53e33c927052ad5b968b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-13 22:59:48,010 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 60872addc3af4ca2561aec68d0f8f9b5; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64778403, jitterRate=-0.0347265750169754}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-13 22:59:48,010 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 60872addc3af4ca2561aec68d0f8f9b5: 2023-09-13 22:59:48,011 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened c3d984d6c94a53e33c927052ad5b968b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69729096, jitterRate=0.03904449939727783}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-13 22:59:48,011 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for c3d984d6c94a53e33c927052ad5b968b: 2023-09-13 22:59:48,011 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,1,1694645987419.60872addc3af4ca2561aec68d0f8f9b5., pid=16, masterSystemTime=1694645987967 2023-09-13 22:59:48,012 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,,1694645987419.c3d984d6c94a53e33c927052ad5b968b., pid=15, masterSystemTime=1694645987966 2023-09-13 22:59:48,014 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,1,1694645987419.60872addc3af4ca2561aec68d0f8f9b5. 2023-09-13 22:59:48,014 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,1,1694645987419.60872addc3af4ca2561aec68d0f8f9b5. 2023-09-13 22:59:48,015 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=60872addc3af4ca2561aec68d0f8f9b5, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 22:59:48,016 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,1,1694645987419.60872addc3af4ca2561aec68d0f8f9b5.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1694645988015"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1694645988015"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1694645988015"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1694645988015"}]},"ts":"1694645988015"} 2023-09-13 22:59:48,016 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,,1694645987419.c3d984d6c94a53e33c927052ad5b968b. 2023-09-13 22:59:48,016 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,,1694645987419.c3d984d6c94a53e33c927052ad5b968b. 2023-09-13 22:59:48,017 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=c3d984d6c94a53e33c927052ad5b968b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 22:59:48,018 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,,1694645987419.c3d984d6c94a53e33c927052ad5b968b.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1694645988017"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1694645988017"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1694645988017"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1694645988017"}]},"ts":"1694645988017"} 2023-09-13 22:59:48,025 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=16, resume processing ppid=14 2023-09-13 22:59:48,025 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=16, ppid=14, state=SUCCESS; OpenRegionProcedure 60872addc3af4ca2561aec68d0f8f9b5, server=jenkins-hbase4.apache.org,42165,1694645979926 in 206 msec 2023-09-13 22:59:48,026 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=15, resume processing ppid=13 2023-09-13 22:59:48,027 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=15, ppid=13, state=SUCCESS; OpenRegionProcedure c3d984d6c94a53e33c927052ad5b968b, server=jenkins-hbase4.apache.org,39163,1694645979837 in 209 msec 2023-09-13 22:59:48,029 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=14, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=60872addc3af4ca2561aec68d0f8f9b5, ASSIGN in 373 msec 2023-09-13 22:59:48,030 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=13, resume processing ppid=12 2023-09-13 22:59:48,030 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=13, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=c3d984d6c94a53e33c927052ad5b968b, ASSIGN in 375 msec 2023-09-13 22:59:48,031 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-13 22:59:48,032 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694645988031"}]},"ts":"1694645988031"} 2023-09-13 22:59:48,034 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLED in hbase:meta 2023-09-13 22:59:48,035 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-09-13 22:59:48,037 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_POST_OPERATION 2023-09-13 22:59:48,043 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportWithTargetName jenkins: RWXCA 2023-09-13 22:59:48,048 DEBUG [PEWorker-5] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-13 22:59:48,051 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59972, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-13 22:59:48,056 DEBUG [hconnection-0x1ecd38fd-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-13 22:59:48,057 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54112, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=ClientService 2023-09-13 22:59:48,065 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39163] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-09-13 22:59:48,097 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:42165-0x100a784b9ba0003, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-09-13 22:59:48,097 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:39163-0x100a784b9ba0001, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-09-13 22:59:48,097 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-09-13 22:59:48,097 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:34119-0x100a784b9ba0002, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-09-13 22:59:48,098 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-13 22:59:48,105 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:42165-0x100a784b9ba0003, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-13 22:59:48,105 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:39163-0x100a784b9ba0001, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-13 22:59:48,105 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-13 22:59:48,105 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:34119-0x100a784b9ba0002, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-13 22:59:48,107 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-09-13 22:59:48,107 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-09-13 22:59:48,107 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-09-13 22:59:48,107 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-09-13 22:59:48,109 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=12, state=SUCCESS; CreateTableProcedure table=testtb-testExportWithTargetName in 686 msec 2023-09-13 22:59:48,537 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-09-13 22:59:48,537 INFO [Listener at jenkins-hbase4.apache.org/37017] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportWithTargetName, procId: 12 completed 2023-09-13 22:59:48,542 DEBUG [Listener at jenkins-hbase4.apache.org/37017] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-09-13 22:59:48,543 DEBUG [Listener at jenkins-hbase4.apache.org/37017] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1694645987419.c3d984d6c94a53e33c927052ad5b968b. 2023-09-13 22:59:48,545 INFO [Listener at jenkins-hbase4.apache.org/37017] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-13 22:59:48,568 DEBUG [hconnection-0x342dd8d7-shared-pool-4] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-13 22:59:48,571 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59976, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-13 22:59:48,588 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-13 22:59:48,588 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1694645988588 (current time:1694645988588). 2023-09-13 22:59:48,588 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-13 22:59:48,589 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] zookeeper.ReadOnlyZKClient(139): Connect 0x72b27add to 127.0.0.1:55012 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-13 22:59:48,597 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@503bf9c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-13 22:59:48,598 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-13 22:59:48,601 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54122, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-13 22:59:48,602 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x72b27add to 127.0.0.1:55012 2023-09-13 22:59:48,602 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-13 22:59:48,605 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] zookeeper.ReadOnlyZKClient(139): Connect 0x5a788797 to 127.0.0.1:55012 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-13 22:59:48,610 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3da86137, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-13 22:59:48,612 DEBUG [hconnection-0x482e10bc-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-13 22:59:48,615 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54132, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-13 22:59:48,618 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-13 22:59:48,621 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59978, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-13 22:59:48,622 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5a788797 to 127.0.0.1:55012 2023-09-13 22:59:48,622 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-13 22:59:48,622 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-09-13 22:59:48,649 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-13 22:59:48,650 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-13 22:59:48,672 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] procedure2.ProcedureExecutor(1028): Stored pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-13 22:59:48,674 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-13 22:59:48,675 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=17, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1694646588675 2023-09-13 22:59:48,675 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-13 22:59:48,675 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-09-13 22:59:48,679 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=17, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-13 22:59:48,679 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-13 22:59:48,681 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=17, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 14 msec 2023-09-13 22:59:48,682 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-13 22:59:48,682 DEBUG [Listener at jenkins-hbase4.apache.org/37017] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-13 22:59:48,683 DEBUG [Listener at jenkins-hbase4.apache.org/37017] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-13 22:59:48,683 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1694646588683 2023-09-13 22:59:48,717 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportWithTargetName 2023-09-13 22:59:48,720 INFO [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportWithTargetName' 2023-09-13 22:59:48,720 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-13 22:59:48,721 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' 2023-09-13 22:59:48,721 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-09-13 22:59:48,722 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-13 22:59:48,722 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-13 22:59:48,728 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:34119-0x100a784b9ba0002, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 22:59:48,728 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:42165-0x100a784b9ba0003, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 22:59:48,728 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 22:59:48,728 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 22:59:48,728 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:39163-0x100a784b9ba0001, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 22:59:48,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 22:59:48,729 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 22:59:48,729 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 22:59:48,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 22:59:48,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 22:59:48,729 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 22:59:48,729 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 22:59:48,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-13 22:59:48,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-13 22:59:48,730 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 22:59:48,730 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-13 22:59:48,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-13 22:59:48,730 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39163-0x100a784b9ba0001, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-13 22:59:48,730 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34119-0x100a784b9ba0002, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-13 22:59:48,731 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42165-0x100a784b9ba0003, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-13 22:59:48,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-09-13 22:59:48,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-09-13 22:59:48,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-13 22:59:48,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-13 22:59:48,733 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-13 22:59:48,733 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-13 22:59:48,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-09-13 22:59:48,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-13 22:59:48,734 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-13 22:59:48,736 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-09-13 22:59:48,741 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-09-13 22:59:48,736 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-09-13 22:59:48,741 DEBUG [member: 'jenkins-hbase4.apache.org,39163,1694645979837' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-13 22:59:48,742 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-13 22:59:48,742 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1694645979883' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-13 22:59:48,742 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1694645979883' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-13 22:59:48,742 DEBUG [member: 'jenkins-hbase4.apache.org,39163,1694645979837' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-13 22:59:48,743 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1694645979883' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-13 22:59:48,743 DEBUG [member: 'jenkins-hbase4.apache.org,39163,1694645979837' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-13 22:59:48,743 DEBUG [member: 'jenkins-hbase4.apache.org,39163,1694645979837' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-09-13 22:59:48,742 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-13 22:59:48,743 DEBUG [member: 'jenkins-hbase4.apache.org,39163,1694645979837' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39163,1694645979837' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-09-13 22:59:48,744 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-13 22:59:48,744 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-09-13 22:59:48,743 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1694645979883' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-09-13 22:59:48,744 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42165,1694645979926' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-09-13 22:59:48,744 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1694645979883' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34119,1694645979883' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-09-13 22:59:48,747 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 22:59:48,747 DEBUG [member: 'jenkins-hbase4.apache.org,39163,1694645979837' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-13 22:59:48,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 22:59:48,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-13 22:59:48,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-13 22:59:48,748 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 22:59:48,748 DEBUG [member: 'jenkins-hbase4.apache.org,39163,1694645979837' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39163-0x100a784b9ba0001, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-13 22:59:48,748 DEBUG [member: 'jenkins-hbase4.apache.org,39163,1694645979837' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-13 22:59:48,748 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1694645979883' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-13 22:59:48,748 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-13 22:59:48,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-13 22:59:48,748 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42165-0x100a784b9ba0003, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-13 22:59:48,748 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1694645979883' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34119-0x100a784b9ba0002, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-13 22:59:48,748 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-13 22:59:48,748 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1694645979883' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-13 22:59:48,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-13 22:59:48,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-13 22:59:48,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34119,1694645979883 2023-09-13 22:59:48,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 22:59:48,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 22:59:48,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-13 22:59:48,751 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39163,1694645979837' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-09-13 22:59:48,751 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@63d17ba0[Count = 1] remaining members to acquire global barrier 2023-09-13 22:59:48,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 22:59:48,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-13 22:59:48,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-13 22:59:48,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-13 22:59:48,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-13 22:59:48,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-13 22:59:48,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34119,1694645979883 2023-09-13 22:59:48,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 22:59:48,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 22:59:48,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-13 22:59:48,754 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42165,1694645979926' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-09-13 22:59:48,754 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@63d17ba0[Count = 0] remaining members to acquire global barrier 2023-09-13 22:59:48,754 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-09-13 22:59:48,754 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-13 22:59:48,757 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:39163-0x100a784b9ba0001, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-13 22:59:48,757 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:34119-0x100a784b9ba0002, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-13 22:59:48,757 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-13 22:59:48,757 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-13 22:59:48,757 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:42165-0x100a784b9ba0003, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-13 22:59:48,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-13 22:59:48,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-13 22:59:48,757 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1694645979883' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-13 22:59:48,757 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 22:59:48,757 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1694645979883' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-09-13 22:59:48,757 DEBUG [member: 'jenkins-hbase4.apache.org,39163,1694645979837' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-13 22:59:48,757 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-13 22:59:48,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-13 22:59:48,758 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1694645979883' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,34119,1694645979883' in zk 2023-09-13 22:59:48,758 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-13 22:59:48,758 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 22:59:48,758 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-13 22:59:48,760 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-13 22:59:48,760 DEBUG [rs(jenkins-hbase4.apache.org,42165,1694645979926)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1694645987419.60872addc3af4ca2561aec68d0f8f9b5. 2023-09-13 22:59:48,760 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1694645979883' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-09-13 22:59:48,760 DEBUG [member: 'jenkins-hbase4.apache.org,39163,1694645979837' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-13 22:59:48,760 DEBUG [member: 'jenkins-hbase4.apache.org,39163,1694645979837' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-13 22:59:48,760 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-13 22:59:48,760 DEBUG [rs(jenkins-hbase4.apache.org,39163,1694645979837)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1694645987419.c3d984d6c94a53e33c927052ad5b968b. 2023-09-13 22:59:48,760 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1694645979883' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-13 22:59:48,761 DEBUG [rs(jenkins-hbase4.apache.org,42165,1694645979926)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1694645987419.60872addc3af4ca2561aec68d0f8f9b5. started... 2023-09-13 22:59:48,761 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1694645979883' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-09-13 22:59:48,762 DEBUG [rs(jenkins-hbase4.apache.org,39163,1694645979837)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1694645987419.c3d984d6c94a53e33c927052ad5b968b. started... 2023-09-13 22:59:48,765 DEBUG [rs(jenkins-hbase4.apache.org,39163,1694645979837)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for c3d984d6c94a53e33c927052ad5b968b: 2023-09-13 22:59:48,765 DEBUG [rs(jenkins-hbase4.apache.org,42165,1694645979926)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 60872addc3af4ca2561aec68d0f8f9b5: 2023-09-13 22:59:48,766 DEBUG [rs(jenkins-hbase4.apache.org,42165,1694645979926)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1694645987419.60872addc3af4ca2561aec68d0f8f9b5.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-09-13 22:59:48,766 DEBUG [rs(jenkins-hbase4.apache.org,39163,1694645979837)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1694645987419.c3d984d6c94a53e33c927052ad5b968b.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-09-13 22:59:48,767 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-09-13 22:59:48,767 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionServerObservers 2023-09-13 22:59:48,768 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-09-13 22:59:48,768 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase MasterObservers 2023-09-13 22:59:48,768 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-09-13 22:59:48,768 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver Metrics about HBase MasterObservers 2023-09-13 22:59:48,768 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-09-13 22:59:48,768 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionObservers 2023-09-13 22:59:48,768 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-09-13 22:59:48,768 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-09-13 22:59:48,773 DEBUG [rs(jenkins-hbase4.apache.org,42165,1694645979926)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-13 22:59:48,773 DEBUG [rs(jenkins-hbase4.apache.org,39163,1694645979837)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-13 22:59:48,776 DEBUG [rs(jenkins-hbase4.apache.org,39163,1694645979837)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-13 22:59:48,776 DEBUG [rs(jenkins-hbase4.apache.org,42165,1694645979926)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-13 22:59:48,783 DEBUG [Listener at jenkins-hbase4.apache.org/37017] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-13 22:59:48,786 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-13 22:59:48,788 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-09-13 22:59:48,788 DEBUG [Listener at jenkins-hbase4.apache.org/37017] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-13 22:59:48,802 DEBUG [rs(jenkins-hbase4.apache.org,42165,1694645979926)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1694645987419.60872addc3af4ca2561aec68d0f8f9b5. completed. 2023-09-13 22:59:48,802 DEBUG [rs(jenkins-hbase4.apache.org,42165,1694645979926)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1694645987419.60872addc3af4ca2561aec68d0f8f9b5. 2023-09-13 22:59:48,803 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-13 22:59:48,803 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-13 22:59:48,803 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 22:59:48,803 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-09-13 22:59:48,803 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,42165,1694645979926' in zk 2023-09-13 22:59:48,806 DEBUG [rs(jenkins-hbase4.apache.org,39163,1694645979837)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1694645987419.c3d984d6c94a53e33c927052ad5b968b. completed. 2023-09-13 22:59:48,806 DEBUG [rs(jenkins-hbase4.apache.org,39163,1694645979837)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1694645987419.c3d984d6c94a53e33c927052ad5b968b. 2023-09-13 22:59:48,807 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-09-13 22:59:48,807 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 22:59:48,807 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-13 22:59:48,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 22:59:48,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-13 22:59:48,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-13 22:59:48,807 DEBUG [member: 'jenkins-hbase4.apache.org,39163,1694645979837' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-13 22:59:48,807 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-09-13 22:59:48,808 DEBUG [member: 'jenkins-hbase4.apache.org,39163,1694645979837' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-13 22:59:48,808 DEBUG [member: 'jenkins-hbase4.apache.org,39163,1694645979837' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 22:59:48,808 DEBUG [member: 'jenkins-hbase4.apache.org,39163,1694645979837' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-09-13 22:59:48,808 DEBUG [member: 'jenkins-hbase4.apache.org,39163,1694645979837' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,39163,1694645979837' in zk 2023-09-13 22:59:48,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-13 22:59:48,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-13 22:59:48,810 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 22:59:48,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-13 22:59:48,810 DEBUG [member: 'jenkins-hbase4.apache.org,39163,1694645979837' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-09-13 22:59:48,810 DEBUG [member: 'jenkins-hbase4.apache.org,39163,1694645979837' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-13 22:59:48,810 DEBUG [member: 'jenkins-hbase4.apache.org,39163,1694645979837' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-09-13 22:59:48,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34119,1694645979883 2023-09-13 22:59:48,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 22:59:48,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 22:59:48,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-13 22:59:48,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-13 22:59:48,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34119,1694645979883 2023-09-13 22:59:48,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 22:59:48,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 22:59:48,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,42165,1694645979926': 2023-09-13 22:59:48,816 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42165,1694645979926' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-09-13 22:59:48,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 22:59:48,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-13 22:59:48,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-13 22:59:48,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-13 22:59:48,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-13 22:59:48,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-13 22:59:48,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34119,1694645979883 2023-09-13 22:59:48,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 22:59:48,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 22:59:48,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-13 22:59:48,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-13 22:59:48,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34119,1694645979883 2023-09-13 22:59:48,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 22:59:48,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 22:59:48,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,39163,1694645979837': 2023-09-13 22:59:48,820 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39163,1694645979837' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-09-13 22:59:48,820 INFO [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportWithTargetName' execution completed 2023-09-13 22:59:48,820 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-13 22:59:48,820 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-13 22:59:48,820 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportWithTargetName 2023-09-13 22:59:48,820 INFO [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-13 22:59:48,824 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:42165-0x100a784b9ba0003, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-13 22:59:48,824 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:39163-0x100a784b9ba0001, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-13 22:59:48,824 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-13 22:59:48,824 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:42165-0x100a784b9ba0003, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 22:59:48,824 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-13 22:59:48,824 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:34119-0x100a784b9ba0002, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-13 22:59:48,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-13 22:59:48,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-13 22:59:48,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-13 22:59:48,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-13 22:59:48,824 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-13 22:59:48,825 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34119,1694645979883 2023-09-13 22:59:48,824 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:39163-0x100a784b9ba0001, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 22:59:48,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-13 22:59:48,824 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-13 22:59:48,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-13 22:59:48,824 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:34119-0x100a784b9ba0002, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 22:59:48,825 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 22:59:48,825 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 22:59:48,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-13 22:59:48,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 22:59:48,825 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 22:59:48,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-13 22:59:48,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 22:59:48,826 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 22:59:48,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-13 22:59:48,826 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 22:59:48,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-13 22:59:48,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-13 22:59:48,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 22:59:48,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-13 22:59:48,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-13 22:59:48,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34119,1694645979883 2023-09-13 22:59:48,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 22:59:48,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 22:59:48,828 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34119,1694645979883 2023-09-13 22:59:48,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-13 22:59:48,829 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 22:59:48,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-13 22:59:48,829 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 22:59:48,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34119,1694645979883 2023-09-13 22:59:48,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 22:59:48,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 22:59:48,842 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 22:59:48,842 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:34119-0x100a784b9ba0002, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 22:59:48,842 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:42165-0x100a784b9ba0003, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 22:59:48,843 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:39163-0x100a784b9ba0001, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 22:59:48,843 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 22:59:48,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 22:59:48,842 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-13 22:59:48,843 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:39163-0x100a784b9ba0001, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 22:59:48,843 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:42165-0x100a784b9ba0003, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 22:59:48,843 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:34119-0x100a784b9ba0002, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 22:59:48,843 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 22:59:48,843 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 22:59:48,843 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportWithTargetName 2023-09-13 22:59:48,843 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-13 22:59:48,843 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 22:59:48,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 22:59:48,843 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 22:59:48,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 22:59:48,843 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-09-13 22:59:48,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 22:59:48,844 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34119,1694645979883 2023-09-13 22:59:48,844 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-09-13 22:59:48,844 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-13 22:59:48,844 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-13 22:59:48,844 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 22:59:48,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 22:59:48,844 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 22:59:48,845 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-13 22:59:48,845 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 22:59:48,845 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34119,1694645979883 2023-09-13 22:59:48,845 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-13 22:59:48,845 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-13 22:59:48,845 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 22:59:48,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 22:59:48,845 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-13 22:59:48,860 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportWithTargetName 2023-09-13 22:59:48,862 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-09-13 22:59:48,911 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName to hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.hbase-snapshot/emptySnaptb0-testExportWithTargetName 2023-09-13 22:59:48,912 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-09-13 22:59:48,913 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-09-13 22:59:48,913 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-09-13 22:59:48,914 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1694645988675Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1694645988860 (+185 ms)Consolidate snapshot: emptySnaptb0-testExportWithTargetName at 1694645988860Loading Region manifests for emptySnaptb0-testExportWithTargetName at 1694645988860Writing data manifest for emptySnaptb0-testExportWithTargetName at 1694645988873 (+13 ms)Verifying snapshot: emptySnaptb0-testExportWithTargetName at 1694645988899 (+26 ms)Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1694645988912 (+13 ms) 2023-09-13 22:59:48,916 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-13 22:59:48,918 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 239 msec 2023-09-13 22:59:48,988 DEBUG [Listener at jenkins-hbase4.apache.org/37017] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-13 22:59:48,993 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-13 22:59:48,994 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-13 22:59:49,008 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39163] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,,1694645987419.c3d984d6c94a53e33c927052ad5b968b. with WAL disabled. Data may be lost in the event of a crash. 2023-09-13 22:59:49,011 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42165] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,1,1694645987419.60872addc3af4ca2561aec68d0f8f9b5. with WAL disabled. Data may be lost in the event of a crash. 2023-09-13 22:59:49,016 DEBUG [Listener at jenkins-hbase4.apache.org/37017] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-09-13 22:59:49,017 DEBUG [Listener at jenkins-hbase4.apache.org/37017] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1694645987419.c3d984d6c94a53e33c927052ad5b968b. 2023-09-13 22:59:49,017 INFO [Listener at jenkins-hbase4.apache.org/37017] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-13 22:59:49,032 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-13 22:59:49,032 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1694645989032 (current time:1694645989032). 2023-09-13 22:59:49,032 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-13 22:59:49,033 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] zookeeper.ReadOnlyZKClient(139): Connect 0x592a58fb to 127.0.0.1:55012 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-13 22:59:49,040 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4191c2c7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-13 22:59:49,041 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-13 22:59:49,044 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54148, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-13 22:59:49,045 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x592a58fb to 127.0.0.1:55012 2023-09-13 22:59:49,045 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-13 22:59:49,047 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] zookeeper.ReadOnlyZKClient(139): Connect 0x53d887af to 127.0.0.1:55012 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-13 22:59:49,053 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@58bee0af, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-13 22:59:49,054 DEBUG [hconnection-0x17768685-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-13 22:59:49,055 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54152, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-13 22:59:49,059 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-13 22:59:49,061 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59988, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-13 22:59:49,062 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x53d887af to 127.0.0.1:55012 2023-09-13 22:59:49,062 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-13 22:59:49,063 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-09-13 22:59:49,064 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-13 22:59:49,064 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-13 22:59:49,068 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] procedure2.ProcedureExecutor(1028): Stored pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-13 22:59:49,069 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-13 22:59:49,070 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=19, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1694646589070 2023-09-13 22:59:49,070 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-13 22:59:49,070 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-09-13 22:59:49,071 DEBUG [Listener at jenkins-hbase4.apache.org/37017] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-13 22:59:49,071 DEBUG [Listener at jenkins-hbase4.apache.org/37017] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-13 22:59:49,073 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-13 22:59:49,073 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=19, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-13 22:59:49,074 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=19, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 7 msec 2023-09-13 22:59:49,075 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-13 22:59:49,076 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=20, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1694646589076 2023-09-13 22:59:49,092 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportWithTargetName 2023-09-13 22:59:49,092 INFO [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportWithTargetName' 2023-09-13 22:59:49,092 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-13 22:59:49,093 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportWithTargetName' starting 'acquire' 2023-09-13 22:59:49,093 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-09-13 22:59:49,093 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-13 22:59:49,093 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-13 22:59:49,095 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:34119-0x100a784b9ba0002, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 22:59:49,095 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:42165-0x100a784b9ba0003, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 22:59:49,095 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 22:59:49,095 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 22:59:49,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 22:59:49,095 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:39163-0x100a784b9ba0001, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 22:59:49,095 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 22:59:49,095 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 22:59:49,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 22:59:49,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 22:59:49,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-13 22:59:49,096 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 22:59:49,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-13 22:59:49,096 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 22:59:49,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-13 22:59:49,096 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34119-0x100a784b9ba0002, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-13 22:59:49,096 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42165-0x100a784b9ba0003, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-13 22:59:49,096 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 22:59:49,096 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-13 22:59:49,096 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39163-0x100a784b9ba0001, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-13 22:59:49,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-09-13 22:59:49,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-13 22:59:49,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-09-13 22:59:49,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-13 22:59:49,097 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-13 22:59:49,097 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-13 22:59:49,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-09-13 22:59:49,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-13 22:59:49,097 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-09-13 22:59:49,097 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-09-13 22:59:49,097 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1694645979883' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-13 22:59:49,097 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-13 22:59:49,097 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-13 22:59:49,097 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-13 22:59:49,097 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1694645979883' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-13 22:59:49,098 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-13 22:59:49,098 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1694645979883' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-13 22:59:49,098 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1694645979883' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-09-13 22:59:49,098 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-09-13 22:59:49,098 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1694645979883' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34119,1694645979883' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-09-13 22:59:49,098 DEBUG [member: 'jenkins-hbase4.apache.org,39163,1694645979837' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-13 22:59:49,098 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-09-13 22:59:49,099 DEBUG [member: 'jenkins-hbase4.apache.org,39163,1694645979837' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-13 22:59:49,099 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42165,1694645979926' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-09-13 22:59:49,099 DEBUG [member: 'jenkins-hbase4.apache.org,39163,1694645979837' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-13 22:59:49,099 DEBUG [member: 'jenkins-hbase4.apache.org,39163,1694645979837' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-09-13 22:59:49,099 DEBUG [member: 'jenkins-hbase4.apache.org,39163,1694645979837' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39163,1694645979837' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-09-13 22:59:49,101 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1694645979883' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-13 22:59:49,103 DEBUG [member: 'jenkins-hbase4.apache.org,39163,1694645979837' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-13 22:59:49,104 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1694645979883' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34119-0x100a784b9ba0002, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-13 22:59:49,104 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1694645979883' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-13 22:59:49,103 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 22:59:49,103 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-13 22:59:49,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 22:59:49,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-13 22:59:49,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-13 22:59:49,104 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 22:59:49,104 DEBUG [member: 'jenkins-hbase4.apache.org,39163,1694645979837' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39163-0x100a784b9ba0001, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-13 22:59:49,104 DEBUG [member: 'jenkins-hbase4.apache.org,39163,1694645979837' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-13 22:59:49,104 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42165-0x100a784b9ba0003, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-13 22:59:49,104 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-13 22:59:49,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-13 22:59:49,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-13 22:59:49,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-13 22:59:49,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34119,1694645979883 2023-09-13 22:59:49,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 22:59:49,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 22:59:49,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-13 22:59:49,107 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42165,1694645979926' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-09-13 22:59:49,107 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@43986499[Count = 1] remaining members to acquire global barrier 2023-09-13 22:59:49,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 22:59:49,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-13 22:59:49,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-13 22:59:49,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-13 22:59:49,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-13 22:59:49,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-13 22:59:49,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34119,1694645979883 2023-09-13 22:59:49,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 22:59:49,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 22:59:49,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-13 22:59:49,109 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39163,1694645979837' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-09-13 22:59:49,109 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@43986499[Count = 0] remaining members to acquire global barrier 2023-09-13 22:59:49,110 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-09-13 22:59:49,110 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-13 22:59:49,113 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:34119-0x100a784b9ba0002, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-13 22:59:49,113 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:39163-0x100a784b9ba0001, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-13 22:59:49,113 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-13 22:59:49,113 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-13 22:59:49,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-13 22:59:49,113 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:42165-0x100a784b9ba0003, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-13 22:59:49,113 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1694645979883' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-13 22:59:49,113 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 22:59:49,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-13 22:59:49,113 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1694645979883' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-09-13 22:59:49,114 DEBUG [member: 'jenkins-hbase4.apache.org,39163,1694645979837' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-13 22:59:49,114 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1694645979883' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,34119,1694645979883' in zk 2023-09-13 22:59:49,113 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-13 22:59:49,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-13 22:59:49,114 DEBUG [member: 'jenkins-hbase4.apache.org,39163,1694645979837' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-13 22:59:49,114 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 22:59:49,114 DEBUG [rs(jenkins-hbase4.apache.org,39163,1694645979837)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1694645987419.c3d984d6c94a53e33c927052ad5b968b. 2023-09-13 22:59:49,114 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-13 22:59:49,114 DEBUG [member: 'jenkins-hbase4.apache.org,39163,1694645979837' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-13 22:59:49,114 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-13 22:59:49,114 DEBUG [rs(jenkins-hbase4.apache.org,39163,1694645979837)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1694645987419.c3d984d6c94a53e33c927052ad5b968b. started... 2023-09-13 22:59:49,114 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-13 22:59:49,114 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-13 22:59:49,114 DEBUG [rs(jenkins-hbase4.apache.org,42165,1694645979926)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1694645987419.60872addc3af4ca2561aec68d0f8f9b5. 2023-09-13 22:59:49,114 INFO [rs(jenkins-hbase4.apache.org,39163,1694645979837)-snapshot-pool-0] regionserver.HRegion(2745): Flushing c3d984d6c94a53e33c927052ad5b968b 1/1 column families, dataSize=132 B heapSize=544 B 2023-09-13 22:59:49,114 DEBUG [rs(jenkins-hbase4.apache.org,42165,1694645979926)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1694645987419.60872addc3af4ca2561aec68d0f8f9b5. started... 2023-09-13 22:59:49,115 INFO [rs(jenkins-hbase4.apache.org,42165,1694645979926)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 60872addc3af4ca2561aec68d0f8f9b5 1/1 column families, dataSize=3.13 KB heapSize=7 KB 2023-09-13 22:59:49,116 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1694645979883' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-09-13 22:59:49,116 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1694645979883' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-13 22:59:49,116 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1694645979883' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-09-13 22:59:49,171 DEBUG [Listener at jenkins-hbase4.apache.org/37017] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-13 22:59:49,173 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-13 22:59:49,173 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-09-13 22:59:49,173 DEBUG [Listener at jenkins-hbase4.apache.org/37017] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-13 22:59:49,373 DEBUG [Listener at jenkins-hbase4.apache.org/37017] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-13 22:59:49,375 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-13 22:59:49,375 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-09-13 22:59:49,375 DEBUG [Listener at jenkins-hbase4.apache.org/37017] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-09-13 22:59:49,653 INFO [rs(jenkins-hbase4.apache.org,39163,1694645979837)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230913ef051c58f6c749cd9d2e22e58bd58074 to hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230913ef051c58f6c749cd9d2e22e58bd58074 2023-09-13 22:59:49,653 INFO [rs(jenkins-hbase4.apache.org,42165,1694645979926)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230913595db198989a476487e86ee20174163b to hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230913595db198989a476487e86ee20174163b 2023-09-13 22:59:49,675 DEBUG [Listener at jenkins-hbase4.apache.org/37017] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-13 22:59:49,680 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-13 22:59:49,681 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-09-13 22:59:49,682 DEBUG [Listener at jenkins-hbase4.apache.org/37017] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-09-13 22:59:49,691 INFO [rs(jenkins-hbase4.apache.org,39163,1694645979837)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=132, hasBloomFilter=true, into tmp file hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/default/testtb-testExportWithTargetName/c3d984d6c94a53e33c927052ad5b968b/.tmp/cf/54c2185b554c4c0e84784a8eeb8df0ce 2023-09-13 22:59:49,694 INFO [rs(jenkins-hbase4.apache.org,42165,1694645979926)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/default/testtb-testExportWithTargetName/60872addc3af4ca2561aec68d0f8f9b5/.tmp/cf/1caa1485cd414b9db61e0c4fe2c86ab2 2023-09-13 22:59:49,701 DEBUG [rs(jenkins-hbase4.apache.org,39163,1694645979837)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/default/testtb-testExportWithTargetName/c3d984d6c94a53e33c927052ad5b968b/.tmp/cf/54c2185b554c4c0e84784a8eeb8df0ce as hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/default/testtb-testExportWithTargetName/c3d984d6c94a53e33c927052ad5b968b/cf/54c2185b554c4c0e84784a8eeb8df0ce 2023-09-13 22:59:49,703 DEBUG [rs(jenkins-hbase4.apache.org,42165,1694645979926)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/default/testtb-testExportWithTargetName/60872addc3af4ca2561aec68d0f8f9b5/.tmp/cf/1caa1485cd414b9db61e0c4fe2c86ab2 as hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/default/testtb-testExportWithTargetName/60872addc3af4ca2561aec68d0f8f9b5/cf/1caa1485cd414b9db61e0c4fe2c86ab2 2023-09-13 22:59:49,711 INFO [rs(jenkins-hbase4.apache.org,42165,1694645979926)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/default/testtb-testExportWithTargetName/60872addc3af4ca2561aec68d0f8f9b5/cf/1caa1485cd414b9db61e0c4fe2c86ab2, entries=48, sequenceid=6, filesize=13.0 K 2023-09-13 22:59:49,711 INFO [rs(jenkins-hbase4.apache.org,39163,1694645979837)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/default/testtb-testExportWithTargetName/c3d984d6c94a53e33c927052ad5b968b/cf/54c2185b554c4c0e84784a8eeb8df0ce, entries=2, sequenceid=6, filesize=5.2 K 2023-09-13 22:59:49,716 INFO [rs(jenkins-hbase4.apache.org,39163,1694645979837)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~132 B/132, heapSize ~528 B/528, currentSize=0 B/0 for c3d984d6c94a53e33c927052ad5b968b in 602ms, sequenceid=6, compaction requested=false 2023-09-13 22:59:49,716 INFO [rs(jenkins-hbase4.apache.org,42165,1694645979926)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.13 KB/3204, heapSize ~6.98 KB/7152, currentSize=0 B/0 for 60872addc3af4ca2561aec68d0f8f9b5 in 601ms, sequenceid=6, compaction requested=false 2023-09-13 22:59:49,716 DEBUG [rs(jenkins-hbase4.apache.org,39163,1694645979837)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-09-13 22:59:49,716 DEBUG [rs(jenkins-hbase4.apache.org,42165,1694645979926)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-09-13 22:59:49,719 DEBUG [rs(jenkins-hbase4.apache.org,39163,1694645979837)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for c3d984d6c94a53e33c927052ad5b968b: 2023-09-13 22:59:49,719 DEBUG [rs(jenkins-hbase4.apache.org,42165,1694645979926)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 60872addc3af4ca2561aec68d0f8f9b5: 2023-09-13 22:59:49,719 DEBUG [rs(jenkins-hbase4.apache.org,39163,1694645979837)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1694645987419.c3d984d6c94a53e33c927052ad5b968b.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-09-13 22:59:49,719 DEBUG [rs(jenkins-hbase4.apache.org,42165,1694645979926)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1694645987419.60872addc3af4ca2561aec68d0f8f9b5.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-09-13 22:59:49,720 DEBUG [rs(jenkins-hbase4.apache.org,39163,1694645979837)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-13 22:59:49,720 DEBUG [rs(jenkins-hbase4.apache.org,42165,1694645979926)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-13 22:59:49,720 DEBUG [rs(jenkins-hbase4.apache.org,39163,1694645979837)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/default/testtb-testExportWithTargetName/c3d984d6c94a53e33c927052ad5b968b/cf/54c2185b554c4c0e84784a8eeb8df0ce] hfiles 2023-09-13 22:59:49,720 DEBUG [rs(jenkins-hbase4.apache.org,42165,1694645979926)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/default/testtb-testExportWithTargetName/60872addc3af4ca2561aec68d0f8f9b5/cf/1caa1485cd414b9db61e0c4fe2c86ab2] hfiles 2023-09-13 22:59:49,720 DEBUG [rs(jenkins-hbase4.apache.org,39163,1694645979837)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/default/testtb-testExportWithTargetName/c3d984d6c94a53e33c927052ad5b968b/cf/54c2185b554c4c0e84784a8eeb8df0ce for snapshot=snaptb0-testExportWithTargetName 2023-09-13 22:59:49,720 DEBUG [rs(jenkins-hbase4.apache.org,42165,1694645979926)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/default/testtb-testExportWithTargetName/60872addc3af4ca2561aec68d0f8f9b5/cf/1caa1485cd414b9db61e0c4fe2c86ab2 for snapshot=snaptb0-testExportWithTargetName 2023-09-13 22:59:49,747 DEBUG [rs(jenkins-hbase4.apache.org,42165,1694645979926)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1694645987419.60872addc3af4ca2561aec68d0f8f9b5. completed. 2023-09-13 22:59:49,747 DEBUG [rs(jenkins-hbase4.apache.org,42165,1694645979926)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1694645987419.60872addc3af4ca2561aec68d0f8f9b5. 2023-09-13 22:59:49,747 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-13 22:59:49,747 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-13 22:59:49,747 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 22:59:49,747 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-09-13 22:59:49,748 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,42165,1694645979926' in zk 2023-09-13 22:59:49,748 DEBUG [rs(jenkins-hbase4.apache.org,39163,1694645979837)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1694645987419.c3d984d6c94a53e33c927052ad5b968b. completed. 2023-09-13 22:59:49,748 DEBUG [rs(jenkins-hbase4.apache.org,39163,1694645979837)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1694645987419.c3d984d6c94a53e33c927052ad5b968b. 2023-09-13 22:59:49,748 DEBUG [member: 'jenkins-hbase4.apache.org,39163,1694645979837' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-13 22:59:49,748 DEBUG [member: 'jenkins-hbase4.apache.org,39163,1694645979837' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-13 22:59:49,748 DEBUG [member: 'jenkins-hbase4.apache.org,39163,1694645979837' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 22:59:49,748 DEBUG [member: 'jenkins-hbase4.apache.org,39163,1694645979837' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-09-13 22:59:49,748 DEBUG [member: 'jenkins-hbase4.apache.org,39163,1694645979837' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,39163,1694645979837' in zk 2023-09-13 22:59:49,749 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-09-13 22:59:49,749 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 22:59:49,749 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-13 22:59:49,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 22:59:49,750 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-09-13 22:59:49,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-13 22:59:49,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-13 22:59:49,752 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 22:59:49,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-13 22:59:49,752 DEBUG [member: 'jenkins-hbase4.apache.org,39163,1694645979837' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-09-13 22:59:49,753 DEBUG [member: 'jenkins-hbase4.apache.org,39163,1694645979837' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-13 22:59:49,753 DEBUG [member: 'jenkins-hbase4.apache.org,39163,1694645979837' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-09-13 22:59:49,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-13 22:59:49,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-13 22:59:49,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34119,1694645979883 2023-09-13 22:59:49,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 22:59:49,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 22:59:49,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-13 22:59:49,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-13 22:59:49,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34119,1694645979883 2023-09-13 22:59:49,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 22:59:49,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 22:59:49,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,42165,1694645979926': 2023-09-13 22:59:49,758 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42165,1694645979926' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-09-13 22:59:49,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 22:59:49,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-13 22:59:49,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-13 22:59:49,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-13 22:59:49,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-13 22:59:49,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-13 22:59:49,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34119,1694645979883 2023-09-13 22:59:49,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 22:59:49,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 22:59:49,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-13 22:59:49,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-13 22:59:49,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34119,1694645979883 2023-09-13 22:59:49,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 22:59:49,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 22:59:49,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,39163,1694645979837': 2023-09-13 22:59:49,762 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39163,1694645979837' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-09-13 22:59:49,762 INFO [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportWithTargetName' execution completed 2023-09-13 22:59:49,762 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-13 22:59:49,762 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-13 22:59:49,762 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportWithTargetName 2023-09-13 22:59:49,762 INFO [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-13 22:59:49,764 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:39163-0x100a784b9ba0001, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-13 22:59:49,764 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:34119-0x100a784b9ba0002, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-13 22:59:49,764 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:39163-0x100a784b9ba0001, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 22:59:49,764 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:34119-0x100a784b9ba0002, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 22:59:49,764 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:42165-0x100a784b9ba0003, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-13 22:59:49,764 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-13 22:59:49,765 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-13 22:59:49,764 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-13 22:59:49,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-13 22:59:49,764 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-13 22:59:49,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-13 22:59:49,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-13 22:59:49,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-13 22:59:49,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-13 22:59:49,765 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:42165-0x100a784b9ba0003, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 22:59:49,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-13 22:59:49,765 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 22:59:49,765 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34119,1694645979883 2023-09-13 22:59:49,765 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 22:59:49,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 22:59:49,765 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 22:59:49,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 22:59:49,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 22:59:49,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-13 22:59:49,766 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 22:59:49,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-13 22:59:49,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-13 22:59:49,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-13 22:59:49,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-13 22:59:49,766 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 22:59:49,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-13 22:59:49,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-13 22:59:49,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34119,1694645979883 2023-09-13 22:59:49,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 22:59:49,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 22:59:49,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-13 22:59:49,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-13 22:59:49,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34119,1694645979883 2023-09-13 22:59:49,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 22:59:49,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 22:59:49,773 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34119,1694645979883 2023-09-13 22:59:49,773 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 22:59:49,774 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 22:59:49,785 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 22:59:49,785 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:39163-0x100a784b9ba0001, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 22:59:49,785 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 22:59:49,785 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-13 22:59:49,785 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportWithTargetName 2023-09-13 22:59:49,785 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:34119-0x100a784b9ba0002, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 22:59:49,786 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-09-13 22:59:49,785 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-13 22:59:49,785 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:42165-0x100a784b9ba0003, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 22:59:49,786 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 22:59:49,787 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 22:59:49,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 22:59:49,787 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34119,1694645979883 2023-09-13 22:59:49,787 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:42165-0x100a784b9ba0003, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 22:59:49,786 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportWithTargetName 2023-09-13 22:59:49,786 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 22:59:49,787 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-13 22:59:49,786 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:34119-0x100a784b9ba0002, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 22:59:49,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 22:59:49,785 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:39163-0x100a784b9ba0001, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 22:59:49,787 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 22:59:49,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 22:59:49,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 22:59:49,787 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-13 22:59:49,787 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 22:59:49,787 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 22:59:49,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 22:59:49,788 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-13 22:59:49,788 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 22:59:49,788 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34119,1694645979883 2023-09-13 22:59:49,788 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-13 22:59:49,788 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-13 22:59:49,788 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 22:59:49,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 22:59:49,789 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230913595db198989a476487e86ee20174163b, hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230913ef051c58f6c749cd9d2e22e58bd58074] mob files 2023-09-13 22:59:49,789 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230913595db198989a476487e86ee20174163b 2023-09-13 22:59:49,789 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230913ef051c58f6c749cd9d2e22e58bd58074 2023-09-13 22:59:49,809 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportWithTargetName 2023-09-13 22:59:49,810 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-09-13 22:59:49,843 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName to hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-09-13 22:59:49,844 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-09-13 22:59:49,844 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-09-13 22:59:49,845 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-09-13 22:59:49,845 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1694645989070Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1694645989809 (+739 ms)Consolidate snapshot: snaptb0-testExportWithTargetName at 1694645989809Loading Region manifests for snaptb0-testExportWithTargetName at 1694645989809Writing data manifest for snaptb0-testExportWithTargetName at 1694645989814 (+5 ms)Verifying snapshot: snaptb0-testExportWithTargetName at 1694645989832 (+18 ms)Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1694645989844 (+12 ms) 2023-09-13 22:59:49,847 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=20, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-13 22:59:49,850 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=20, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 777 msec 2023-09-13 22:59:50,182 DEBUG [Listener at jenkins-hbase4.apache.org/37017] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-13 22:59:50,185 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-13 22:59:50,185 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-13 22:59:50,185 INFO [Listener at jenkins-hbase4.apache.org/37017] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/export-test/export-1694645990185 2023-09-13 22:59:50,186 INFO [Listener at jenkins-hbase4.apache.org/37017] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:36267, tgtDir=hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/export-test/export-1694645990185, rawTgtDir=hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/export-test/export-1694645990185, srcFsUri=hdfs://localhost:36267, srcDir=hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d 2023-09-13 22:59:50,224 DEBUG [Listener at jenkins-hbase4.apache.org/37017] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:36267, inputRoot=hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d 2023-09-13 22:59:50,224 DEBUG [Listener at jenkins-hbase4.apache.org/37017] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_69044516_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/export-test/export-1694645990185, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/export-test/export-1694645990185/.hbase-snapshot/.tmp/testExportWithTargetName 2023-09-13 22:59:50,224 INFO [Listener at jenkins-hbase4.apache.org/37017] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:36267, inputRoot=hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d, snapshotDir=hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.hbase-snapshot/snaptb0-testExportWithTargetName. 2023-09-13 22:59:50,243 INFO [Listener at jenkins-hbase4.apache.org/37017] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.hbase-snapshot/snaptb0-testExportWithTargetName to hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/export-test/export-1694645990185/.hbase-snapshot/.tmp/testExportWithTargetName 2023-09-13 22:59:50,300 DEBUG [Listener at jenkins-hbase4.apache.org/37017] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-13 22:59:50,301 DEBUG [Listener at jenkins-hbase4.apache.org/37017] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-13 22:59:50,302 DEBUG [Listener at jenkins-hbase4.apache.org/37017] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-13 22:59:50,303 DEBUG [Listener at jenkins-hbase4.apache.org/37017] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-13 22:59:51,223 DEBUG [Listener at jenkins-hbase4.apache.org/37017] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/62bf382e-8712-1db5-f7ab-e78a401ad305/hadoop-5787843240603011878.jar 2023-09-13 22:59:51,224 DEBUG [Listener at jenkins-hbase4.apache.org/37017] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-13 22:59:51,224 DEBUG [Listener at jenkins-hbase4.apache.org/37017] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-13 22:59:51,291 DEBUG [Listener at jenkins-hbase4.apache.org/37017] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/62bf382e-8712-1db5-f7ab-e78a401ad305/hadoop-6724018184561476909.jar 2023-09-13 22:59:51,292 DEBUG [Listener at jenkins-hbase4.apache.org/37017] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-13 22:59:51,293 DEBUG [Listener at jenkins-hbase4.apache.org/37017] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-13 22:59:51,293 DEBUG [Listener at jenkins-hbase4.apache.org/37017] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-13 22:59:51,294 DEBUG [Listener at jenkins-hbase4.apache.org/37017] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-13 22:59:51,294 DEBUG [Listener at jenkins-hbase4.apache.org/37017] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-13 22:59:51,295 DEBUG [Listener at jenkins-hbase4.apache.org/37017] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-13 22:59:51,295 DEBUG [Listener at jenkins-hbase4.apache.org/37017] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-13 22:59:51,296 DEBUG [Listener at jenkins-hbase4.apache.org/37017] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-13 22:59:51,296 DEBUG [Listener at jenkins-hbase4.apache.org/37017] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-13 22:59:51,296 DEBUG [Listener at jenkins-hbase4.apache.org/37017] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-13 22:59:51,297 DEBUG [Listener at jenkins-hbase4.apache.org/37017] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-13 22:59:51,298 DEBUG [Listener at jenkins-hbase4.apache.org/37017] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-13 22:59:51,298 DEBUG [Listener at jenkins-hbase4.apache.org/37017] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-13 22:59:51,298 DEBUG [Listener at jenkins-hbase4.apache.org/37017] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-13 22:59:51,299 DEBUG [Listener at jenkins-hbase4.apache.org/37017] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-13 22:59:51,299 DEBUG [Listener at jenkins-hbase4.apache.org/37017] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-13 22:59:51,305 DEBUG [Listener at jenkins-hbase4.apache.org/37017] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-13 22:59:51,306 DEBUG [Listener at jenkins-hbase4.apache.org/37017] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-13 22:59:51,306 DEBUG [Listener at jenkins-hbase4.apache.org/37017] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-13 22:59:51,307 DEBUG [Listener at jenkins-hbase4.apache.org/37017] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-13 22:59:51,307 DEBUG [Listener at jenkins-hbase4.apache.org/37017] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-13 22:59:51,308 DEBUG [Listener at jenkins-hbase4.apache.org/37017] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-13 22:59:51,308 DEBUG [Listener at jenkins-hbase4.apache.org/37017] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-13 22:59:52,124 WARN [Listener at jenkins-hbase4.apache.org/37017] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-13 22:59:52,130 INFO [Listener at jenkins-hbase4.apache.org/37017] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportWithTargetName' hfile list 2023-09-13 22:59:52,138 DEBUG [Listener at jenkins-hbase4.apache.org/37017] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-09-13 22:59:52,599 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-13 22:59:52,600 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-13 22:59:53,199 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694645986290_0001_000001 (auth:SIMPLE) 2023-09-13 22:59:53,483 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-13 22:59:57,586 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694645986290_0001_000001 (auth:SIMPLE) 2023-09-13 22:59:59,831 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694645986290_0001_000001 (auth:SIMPLE) 2023-09-13 23:00:02,671 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694645986290_0001_000001 (auth:SIMPLE) 2023-09-13 23:00:03,989 INFO [Listener at jenkins-hbase4.apache.org/37017] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-13 23:00:03,993 INFO [Listener at jenkins-hbase4.apache.org/37017] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-13 23:00:04,013 INFO [Listener at jenkins-hbase4.apache.org/37017] snapshot.ExportSnapshot(1127): Export Completed: testExportWithTargetName 2023-09-13 23:00:04,013 INFO [Listener at jenkins-hbase4.apache.org/37017] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-13 23:00:04,014 INFO [Listener at jenkins-hbase4.apache.org/37017] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-13 23:00:04,014 DEBUG [Listener at jenkins-hbase4.apache.org/37017] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-527948888_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.hbase-snapshot/snaptb0-testExportWithTargetName at hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-09-13 23:00:04,015 DEBUG [Listener at jenkins-hbase4.apache.org/37017] snapshot.TestExportSnapshot(367): hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.hbase-snapshot/snaptb0-testExportWithTargetName/.snapshotinfo 2023-09-13 23:00:04,015 DEBUG [Listener at jenkins-hbase4.apache.org/37017] snapshot.TestExportSnapshot(367): hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.hbase-snapshot/snaptb0-testExportWithTargetName/data.manifest 2023-09-13 23:00:04,015 DEBUG [Listener at jenkins-hbase4.apache.org/37017] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-527948888_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/export-test/export-1694645990185/.hbase-snapshot/testExportWithTargetName at hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/export-test/export-1694645990185/.hbase-snapshot/testExportWithTargetName 2023-09-13 23:00:04,016 DEBUG [Listener at jenkins-hbase4.apache.org/37017] snapshot.TestExportSnapshot(367): hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/export-test/export-1694645990185/.hbase-snapshot/testExportWithTargetName/.snapshotinfo 2023-09-13 23:00:04,016 DEBUG [Listener at jenkins-hbase4.apache.org/37017] snapshot.TestExportSnapshot(367): hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/export-test/export-1694645990185/.hbase-snapshot/testExportWithTargetName/data.manifest 2023-09-13 23:00:04,026 INFO [Listener at jenkins-hbase4.apache.org/37017] client.HBaseAdmin$15(890): Started disable of testtb-testExportWithTargetName 2023-09-13 23:00:04,031 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportWithTargetName 2023-09-13 23:00:04,039 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] procedure2.ProcedureExecutor(1028): Stored pid=21, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportWithTargetName 2023-09-13 23:00:04,045 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694646004044"}]},"ts":"1694646004044"} 2023-09-13 23:00:04,045 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-09-13 23:00:04,047 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLING in hbase:meta 2023-09-13 23:00:04,049 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testExportWithTargetName to state=DISABLING 2023-09-13 23:00:04,051 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=c3d984d6c94a53e33c927052ad5b968b, UNASSIGN}, {pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=60872addc3af4ca2561aec68d0f8f9b5, UNASSIGN}] 2023-09-13 23:00:04,054 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=c3d984d6c94a53e33c927052ad5b968b, UNASSIGN 2023-09-13 23:00:04,054 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=60872addc3af4ca2561aec68d0f8f9b5, UNASSIGN 2023-09-13 23:00:04,055 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=c3d984d6c94a53e33c927052ad5b968b, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 23:00:04,055 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=60872addc3af4ca2561aec68d0f8f9b5, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 23:00:04,055 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1694645987419.c3d984d6c94a53e33c927052ad5b968b.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1694646004055"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694646004055"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694646004055"}]},"ts":"1694646004055"} 2023-09-13 23:00:04,055 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1694645987419.60872addc3af4ca2561aec68d0f8f9b5.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1694646004055"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694646004055"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694646004055"}]},"ts":"1694646004055"} 2023-09-13 23:00:04,057 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=24, ppid=23, state=RUNNABLE; CloseRegionProcedure 60872addc3af4ca2561aec68d0f8f9b5, server=jenkins-hbase4.apache.org,42165,1694645979926}] 2023-09-13 23:00:04,058 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=25, ppid=22, state=RUNNABLE; CloseRegionProcedure c3d984d6c94a53e33c927052ad5b968b, server=jenkins-hbase4.apache.org,39163,1694645979837}] 2023-09-13 23:00:04,147 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-09-13 23:00:04,218 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 60872addc3af4ca2561aec68d0f8f9b5 2023-09-13 23:00:04,218 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close c3d984d6c94a53e33c927052ad5b968b 2023-09-13 23:00:04,219 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 60872addc3af4ca2561aec68d0f8f9b5, disabling compactions & flushes 2023-09-13 23:00:04,219 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing c3d984d6c94a53e33c927052ad5b968b, disabling compactions & flushes 2023-09-13 23:00:04,219 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1694645987419.60872addc3af4ca2561aec68d0f8f9b5. 2023-09-13 23:00:04,219 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1694645987419.c3d984d6c94a53e33c927052ad5b968b. 2023-09-13 23:00:04,219 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1694645987419.60872addc3af4ca2561aec68d0f8f9b5. 2023-09-13 23:00:04,219 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1694645987419.c3d984d6c94a53e33c927052ad5b968b. 2023-09-13 23:00:04,219 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1694645987419.60872addc3af4ca2561aec68d0f8f9b5. after waiting 0 ms 2023-09-13 23:00:04,219 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1694645987419.c3d984d6c94a53e33c927052ad5b968b. after waiting 0 ms 2023-09-13 23:00:04,219 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1694645987419.c3d984d6c94a53e33c927052ad5b968b. 2023-09-13 23:00:04,219 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1694645987419.60872addc3af4ca2561aec68d0f8f9b5. 2023-09-13 23:00:04,234 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/default/testtb-testExportWithTargetName/60872addc3af4ca2561aec68d0f8f9b5/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-13 23:00:04,234 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/default/testtb-testExportWithTargetName/c3d984d6c94a53e33c927052ad5b968b/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-13 23:00:04,235 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-13 23:00:04,235 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-13 23:00:04,236 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1694645987419.60872addc3af4ca2561aec68d0f8f9b5. 2023-09-13 23:00:04,236 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1694645987419.c3d984d6c94a53e33c927052ad5b968b. 2023-09-13 23:00:04,236 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 60872addc3af4ca2561aec68d0f8f9b5: 2023-09-13 23:00:04,237 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for c3d984d6c94a53e33c927052ad5b968b: 2023-09-13 23:00:04,240 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed c3d984d6c94a53e33c927052ad5b968b 2023-09-13 23:00:04,241 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=c3d984d6c94a53e33c927052ad5b968b, regionState=CLOSED 2023-09-13 23:00:04,241 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1694645987419.c3d984d6c94a53e33c927052ad5b968b.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1694646004241"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694646004241"}]},"ts":"1694646004241"} 2023-09-13 23:00:04,242 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 60872addc3af4ca2561aec68d0f8f9b5 2023-09-13 23:00:04,242 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=60872addc3af4ca2561aec68d0f8f9b5, regionState=CLOSED 2023-09-13 23:00:04,242 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1694645987419.60872addc3af4ca2561aec68d0f8f9b5.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1694646004242"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694646004242"}]},"ts":"1694646004242"} 2023-09-13 23:00:04,246 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=25, resume processing ppid=22 2023-09-13 23:00:04,246 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=25, ppid=22, state=SUCCESS; CloseRegionProcedure c3d984d6c94a53e33c927052ad5b968b, server=jenkins-hbase4.apache.org,39163,1694645979837 in 185 msec 2023-09-13 23:00:04,247 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=24, resume processing ppid=23 2023-09-13 23:00:04,247 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=24, ppid=23, state=SUCCESS; CloseRegionProcedure 60872addc3af4ca2561aec68d0f8f9b5, server=jenkins-hbase4.apache.org,42165,1694645979926 in 187 msec 2023-09-13 23:00:04,249 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=22, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=c3d984d6c94a53e33c927052ad5b968b, UNASSIGN in 195 msec 2023-09-13 23:00:04,251 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=23, resume processing ppid=21 2023-09-13 23:00:04,251 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=23, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=60872addc3af4ca2561aec68d0f8f9b5, UNASSIGN in 196 msec 2023-09-13 23:00:04,252 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694646004252"}]},"ts":"1694646004252"} 2023-09-13 23:00:04,253 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLED in hbase:meta 2023-09-13 23:00:04,255 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testExportWithTargetName to state=DISABLED 2023-09-13 23:00:04,258 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=21, state=SUCCESS; DisableTableProcedure table=testtb-testExportWithTargetName in 222 msec 2023-09-13 23:00:04,348 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-09-13 23:00:04,348 INFO [Listener at jenkins-hbase4.apache.org/37017] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportWithTargetName, procId: 21 completed 2023-09-13 23:00:04,355 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportWithTargetName 2023-09-13 23:00:04,362 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] procedure2.ProcedureExecutor(1028): Stored pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-13 23:00:04,365 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-13 23:00:04,366 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportWithTargetName 2023-09-13 23:00:04,367 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=26, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-13 23:00:04,371 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39163] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportWithTargetName 2023-09-13 23:00:04,374 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.tmp/data/default/testtb-testExportWithTargetName/c3d984d6c94a53e33c927052ad5b968b 2023-09-13 23:00:04,375 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:42165-0x100a784b9ba0003, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-13 23:00:04,375 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:34119-0x100a784b9ba0002, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-13 23:00:04,375 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-13 23:00:04,375 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:39163-0x100a784b9ba0001, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-13 23:00:04,375 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.tmp/data/default/testtb-testExportWithTargetName/60872addc3af4ca2561aec68d0f8f9b5 2023-09-13 23:00:04,375 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-09-13 23:00:04,375 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-09-13 23:00:04,376 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-09-13 23:00:04,376 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-09-13 23:00:04,377 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:42165-0x100a784b9ba0003, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-13 23:00:04,377 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:42165-0x100a784b9ba0003, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-13 23:00:04,377 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:34119-0x100a784b9ba0002, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-13 23:00:04,377 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:34119-0x100a784b9ba0002, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-13 23:00:04,378 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-13 23:00:04,378 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-13 23:00:04,378 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:39163-0x100a784b9ba0001, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-13 23:00:04,378 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:39163-0x100a784b9ba0001, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-13 23:00:04,380 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.tmp/data/default/testtb-testExportWithTargetName/60872addc3af4ca2561aec68d0f8f9b5/cf, FileablePath, hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.tmp/data/default/testtb-testExportWithTargetName/60872addc3af4ca2561aec68d0f8f9b5/recovered.edits] 2023-09-13 23:00:04,380 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.tmp/data/default/testtb-testExportWithTargetName/c3d984d6c94a53e33c927052ad5b968b/cf, FileablePath, hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.tmp/data/default/testtb-testExportWithTargetName/c3d984d6c94a53e33c927052ad5b968b/recovered.edits] 2023-09-13 23:00:04,381 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-09-13 23:00:04,390 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.tmp/data/default/testtb-testExportWithTargetName/60872addc3af4ca2561aec68d0f8f9b5/cf/1caa1485cd414b9db61e0c4fe2c86ab2 to hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/archive/data/default/testtb-testExportWithTargetName/60872addc3af4ca2561aec68d0f8f9b5/cf/1caa1485cd414b9db61e0c4fe2c86ab2 2023-09-13 23:00:04,390 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.tmp/data/default/testtb-testExportWithTargetName/c3d984d6c94a53e33c927052ad5b968b/cf/54c2185b554c4c0e84784a8eeb8df0ce to hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/archive/data/default/testtb-testExportWithTargetName/c3d984d6c94a53e33c927052ad5b968b/cf/54c2185b554c4c0e84784a8eeb8df0ce 2023-09-13 23:00:04,397 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.tmp/data/default/testtb-testExportWithTargetName/60872addc3af4ca2561aec68d0f8f9b5/recovered.edits/9.seqid to hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/archive/data/default/testtb-testExportWithTargetName/60872addc3af4ca2561aec68d0f8f9b5/recovered.edits/9.seqid 2023-09-13 23:00:04,398 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.tmp/data/default/testtb-testExportWithTargetName/c3d984d6c94a53e33c927052ad5b968b/recovered.edits/9.seqid to hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/archive/data/default/testtb-testExportWithTargetName/c3d984d6c94a53e33c927052ad5b968b/recovered.edits/9.seqid 2023-09-13 23:00:04,398 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.tmp/data/default/testtb-testExportWithTargetName/60872addc3af4ca2561aec68d0f8f9b5 2023-09-13 23:00:04,398 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.tmp/data/default/testtb-testExportWithTargetName/c3d984d6c94a53e33c927052ad5b968b 2023-09-13 23:00:04,398 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-09-13 23:00:04,399 DEBUG [PEWorker-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-09-13 23:00:04,400 DEBUG [PEWorker-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf] 2023-09-13 23:00:04,405 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230913595db198989a476487e86ee20174163b to hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230913595db198989a476487e86ee20174163b 2023-09-13 23:00:04,406 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230913ef051c58f6c749cd9d2e22e58bd58074 to hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230913ef051c58f6c749cd9d2e22e58bd58074 2023-09-13 23:00:04,407 DEBUG [PEWorker-2] backup.HFileArchiver(596): Deleted hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-09-13 23:00:04,410 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=26, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-13 23:00:04,435 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportWithTargetName from hbase:meta 2023-09-13 23:00:04,438 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportWithTargetName' descriptor. 2023-09-13 23:00:04,440 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=26, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-13 23:00:04,440 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportWithTargetName' from region states. 2023-09-13 23:00:04,440 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,,1694645987419.c3d984d6c94a53e33c927052ad5b968b.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1694646004440"}]},"ts":"9223372036854775807"} 2023-09-13 23:00:04,440 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,1,1694645987419.60872addc3af4ca2561aec68d0f8f9b5.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1694646004440"}]},"ts":"9223372036854775807"} 2023-09-13 23:00:04,443 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-13 23:00:04,443 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => c3d984d6c94a53e33c927052ad5b968b, NAME => 'testtb-testExportWithTargetName,,1694645987419.c3d984d6c94a53e33c927052ad5b968b.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 60872addc3af4ca2561aec68d0f8f9b5, NAME => 'testtb-testExportWithTargetName,1,1694645987419.60872addc3af4ca2561aec68d0f8f9b5.', STARTKEY => '1', ENDKEY => ''}] 2023-09-13 23:00:04,443 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportWithTargetName' as deleted. 2023-09-13 23:00:04,443 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1694646004443"}]},"ts":"9223372036854775807"} 2023-09-13 23:00:04,445 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportWithTargetName state from META 2023-09-13 23:00:04,447 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=26, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-13 23:00:04,449 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=26, state=SUCCESS; DeleteTableProcedure table=testtb-testExportWithTargetName in 91 msec 2023-09-13 23:00:04,482 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-09-13 23:00:04,484 INFO [Listener at jenkins-hbase4.apache.org/37017] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportWithTargetName, procId: 26 completed 2023-09-13 23:00:04,505 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportWithTargetName" 2023-09-13 23:00:04,508 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportWithTargetName 2023-09-13 23:00:04,511 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportWithTargetName" 2023-09-13 23:00:04,514 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportWithTargetName 2023-09-13 23:00:04,543 INFO [Listener at jenkins-hbase4.apache.org/37017] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=752 (was 704) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x73fd7489-shared-pool-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Container metrics unregistration java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_648851696_1 at /127.0.0.1:44320 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/62bf382e-8712-1db5-f7ab-e78a401ad305/cluster_9ec0a0d8-f9f9-a794-7992-e14174bce4fb/dfs/data/data4/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x73fd7489-shared-pool-11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/62bf382e-8712-1db5-f7ab-e78a401ad305/cluster_9ec0a0d8-f9f9-a794-7992-e14174bce4fb/dfs/data/data3/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Timer for 'JobHistoryServer' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: Thread-1284 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,39163,1694645979837' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1506713691) connection to jenkins-hbase4.apache.org/172.31.14.131:36775 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/62bf382e-8712-1db5-f7ab-e78a401ad305/cluster_9ec0a0d8-f9f9-a794-7992-e14174bce4fb/dfs/data/data6/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x73fd7489-shared-pool-12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-527948888_17 at /127.0.0.1:35522 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-527948888_17 at /127.0.0.1:50416 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/62bf382e-8712-1db5-f7ab-e78a401ad305/cluster_9ec0a0d8-f9f9-a794-7992-e14174bce4fb/dfs/data/data5/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1506713691) connection to jenkins-hbase4.apache.org/172.31.14.131:44735 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #0 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.read1(BufferedReader.java:212) java.io.BufferedReader.read(BufferedReader.java:286) org.apache.hadoop.util.Shell$ShellCommandExecutor.parseExecResult(Shell.java:1229) org.apache.hadoop.util.Shell.runCommand(Shell.java:984) org.apache.hadoop.util.Shell.run(Shell.java:884) org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:1216) org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:294) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.launchContainer(ContainerLaunch.java:442) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:293) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:97) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/62bf382e-8712-1db5-f7ab-e78a401ad305/cluster_9ec0a0d8-f9f9-a794-7992-e14174bce4fb/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,34119,1694645979883' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MutableQuantiles-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/62bf382e-8712-1db5-f7ab-e78a401ad305/cluster_9ec0a0d8-f9f9-a794-7992-e14174bce4fb/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1506713691) connection to jenkins-hbase4.apache.org/172.31.14.131:37225 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: HFileArchiver-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-527948888_17 at /127.0.0.1:44338 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_648851696_1 at /127.0.0.1:35486 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x73fd7489-shared-pool-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=922 (was 898) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=179 (was 133) - SystemLoadAverage LEAK? -, ProcessCount=171 (was 165) - ProcessCount LEAK? -, AvailableMemoryMB=8910 (was 9720) 2023-09-13 23:00:04,543 WARN [Listener at jenkins-hbase4.apache.org/37017] hbase.ResourceChecker(130): Thread=752 is superior to 500 2023-09-13 23:00:04,565 INFO [Listener at jenkins-hbase4.apache.org/37017] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=752, OpenFileDescriptor=922, MaxFileDescriptor=60000, SystemLoadAverage=179, ProcessCount=171, AvailableMemoryMB=8908 2023-09-13 23:00:04,565 WARN [Listener at jenkins-hbase4.apache.org/37017] hbase.ResourceChecker(130): Thread=752 is superior to 500 2023-09-13 23:00:04,567 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-13 23:00:04,570 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] procedure2.ProcedureExecutor(1028): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemState 2023-09-13 23:00:04,573 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-09-13 23:00:04,574 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemState" procId is: 27 2023-09-13 23:00:04,575 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-09-13 23:00:04,576 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-13 23:00:04,579 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.tmp/data/default/testtb-testExportFileSystemState/8d76cbc2cd73433d3550dee05d361e4b 2023-09-13 23:00:04,579 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.tmp/data/default/testtb-testExportFileSystemState/18101864e2d12cf1ba7fe6bad810b1b2 2023-09-13 23:00:04,579 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.tmp/data/default/testtb-testExportFileSystemState/18101864e2d12cf1ba7fe6bad810b1b2 empty. 2023-09-13 23:00:04,579 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.tmp/data/default/testtb-testExportFileSystemState/8d76cbc2cd73433d3550dee05d361e4b empty. 2023-09-13 23:00:04,580 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.tmp/data/default/testtb-testExportFileSystemState/18101864e2d12cf1ba7fe6bad810b1b2 2023-09-13 23:00:04,580 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.tmp/data/default/testtb-testExportFileSystemState/8d76cbc2cd73433d3550dee05d361e4b 2023-09-13 23:00:04,580 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-09-13 23:00:04,594 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.tmp/data/default/testtb-testExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-09-13 23:00:04,595 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 8d76cbc2cd73433d3550dee05d361e4b, NAME => 'testtb-testExportFileSystemState,,1694646004567.8d76cbc2cd73433d3550dee05d361e4b.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.tmp 2023-09-13 23:00:04,596 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => 18101864e2d12cf1ba7fe6bad810b1b2, NAME => 'testtb-testExportFileSystemState,1,1694646004567.18101864e2d12cf1ba7fe6bad810b1b2.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.tmp 2023-09-13 23:00:04,627 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1694646004567.18101864e2d12cf1ba7fe6bad810b1b2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-13 23:00:04,627 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing 18101864e2d12cf1ba7fe6bad810b1b2, disabling compactions & flushes 2023-09-13 23:00:04,628 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1694646004567.18101864e2d12cf1ba7fe6bad810b1b2. 2023-09-13 23:00:04,629 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1694646004567.18101864e2d12cf1ba7fe6bad810b1b2. 2023-09-13 23:00:04,629 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1694646004567.18101864e2d12cf1ba7fe6bad810b1b2. after waiting 0 ms 2023-09-13 23:00:04,629 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1694646004567.18101864e2d12cf1ba7fe6bad810b1b2. 2023-09-13 23:00:04,629 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1694646004567.18101864e2d12cf1ba7fe6bad810b1b2. 2023-09-13 23:00:04,629 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for 18101864e2d12cf1ba7fe6bad810b1b2: 2023-09-13 23:00:04,629 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1694646004567.8d76cbc2cd73433d3550dee05d361e4b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-13 23:00:04,630 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 8d76cbc2cd73433d3550dee05d361e4b, disabling compactions & flushes 2023-09-13 23:00:04,630 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1694646004567.8d76cbc2cd73433d3550dee05d361e4b. 2023-09-13 23:00:04,630 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1694646004567.8d76cbc2cd73433d3550dee05d361e4b. 2023-09-13 23:00:04,630 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1694646004567.8d76cbc2cd73433d3550dee05d361e4b. after waiting 0 ms 2023-09-13 23:00:04,630 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1694646004567.8d76cbc2cd73433d3550dee05d361e4b. 2023-09-13 23:00:04,630 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1694646004567.8d76cbc2cd73433d3550dee05d361e4b. 2023-09-13 23:00:04,630 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 8d76cbc2cd73433d3550dee05d361e4b: 2023-09-13 23:00:04,633 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-09-13 23:00:04,634 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1694646004567.18101864e2d12cf1ba7fe6bad810b1b2.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1694646004634"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694646004634"}]},"ts":"1694646004634"} 2023-09-13 23:00:04,634 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1694646004567.8d76cbc2cd73433d3550dee05d361e4b.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1694646004634"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694646004634"}]},"ts":"1694646004634"} 2023-09-13 23:00:04,637 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-13 23:00:04,638 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-13 23:00:04,638 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694646004638"}]},"ts":"1694646004638"} 2023-09-13 23:00:04,640 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLING in hbase:meta 2023-09-13 23:00:04,644 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-13 23:00:04,645 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-13 23:00:04,645 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-13 23:00:04,645 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-13 23:00:04,645 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-13 23:00:04,646 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=8d76cbc2cd73433d3550dee05d361e4b, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=18101864e2d12cf1ba7fe6bad810b1b2, ASSIGN}] 2023-09-13 23:00:04,648 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=18101864e2d12cf1ba7fe6bad810b1b2, ASSIGN 2023-09-13 23:00:04,648 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=8d76cbc2cd73433d3550dee05d361e4b, ASSIGN 2023-09-13 23:00:04,649 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=18101864e2d12cf1ba7fe6bad810b1b2, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39163,1694645979837; forceNewPlan=false, retain=false 2023-09-13 23:00:04,649 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=8d76cbc2cd73433d3550dee05d361e4b, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42165,1694645979926; forceNewPlan=false, retain=false 2023-09-13 23:00:04,677 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-09-13 23:00:04,800 INFO [jenkins-hbase4:36621] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-13 23:00:04,802 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=8d76cbc2cd73433d3550dee05d361e4b, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 23:00:04,802 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=18101864e2d12cf1ba7fe6bad810b1b2, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 23:00:04,803 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1694646004567.8d76cbc2cd73433d3550dee05d361e4b.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1694646004802"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694646004802"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694646004802"}]},"ts":"1694646004802"} 2023-09-13 23:00:04,803 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1694646004567.18101864e2d12cf1ba7fe6bad810b1b2.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1694646004802"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694646004802"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694646004802"}]},"ts":"1694646004802"} 2023-09-13 23:00:04,805 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=30, ppid=28, state=RUNNABLE; OpenRegionProcedure 8d76cbc2cd73433d3550dee05d361e4b, server=jenkins-hbase4.apache.org,42165,1694645979926}] 2023-09-13 23:00:04,807 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=31, ppid=29, state=RUNNABLE; OpenRegionProcedure 18101864e2d12cf1ba7fe6bad810b1b2, server=jenkins-hbase4.apache.org,39163,1694645979837}] 2023-09-13 23:00:04,878 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-09-13 23:00:04,967 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,1,1694646004567.18101864e2d12cf1ba7fe6bad810b1b2. 2023-09-13 23:00:04,967 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 18101864e2d12cf1ba7fe6bad810b1b2, NAME => 'testtb-testExportFileSystemState,1,1694646004567.18101864e2d12cf1ba7fe6bad810b1b2.', STARTKEY => '1', ENDKEY => ''} 2023-09-13 23:00:04,968 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,1,1694646004567.18101864e2d12cf1ba7fe6bad810b1b2. service=AccessControlService 2023-09-13 23:00:04,968 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-13 23:00:04,968 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 18101864e2d12cf1ba7fe6bad810b1b2 2023-09-13 23:00:04,968 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1694646004567.18101864e2d12cf1ba7fe6bad810b1b2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-13 23:00:04,968 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 18101864e2d12cf1ba7fe6bad810b1b2 2023-09-13 23:00:04,968 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 18101864e2d12cf1ba7fe6bad810b1b2 2023-09-13 23:00:04,967 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,,1694646004567.8d76cbc2cd73433d3550dee05d361e4b. 2023-09-13 23:00:04,969 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 8d76cbc2cd73433d3550dee05d361e4b, NAME => 'testtb-testExportFileSystemState,,1694646004567.8d76cbc2cd73433d3550dee05d361e4b.', STARTKEY => '', ENDKEY => '1'} 2023-09-13 23:00:04,970 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,,1694646004567.8d76cbc2cd73433d3550dee05d361e4b. service=AccessControlService 2023-09-13 23:00:04,970 INFO [StoreOpener-18101864e2d12cf1ba7fe6bad810b1b2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 18101864e2d12cf1ba7fe6bad810b1b2 2023-09-13 23:00:04,970 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-13 23:00:04,970 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 8d76cbc2cd73433d3550dee05d361e4b 2023-09-13 23:00:04,970 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1694646004567.8d76cbc2cd73433d3550dee05d361e4b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-13 23:00:04,970 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 8d76cbc2cd73433d3550dee05d361e4b 2023-09-13 23:00:04,970 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 8d76cbc2cd73433d3550dee05d361e4b 2023-09-13 23:00:04,971 DEBUG [StoreOpener-18101864e2d12cf1ba7fe6bad810b1b2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/default/testtb-testExportFileSystemState/18101864e2d12cf1ba7fe6bad810b1b2/cf 2023-09-13 23:00:04,971 DEBUG [StoreOpener-18101864e2d12cf1ba7fe6bad810b1b2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/default/testtb-testExportFileSystemState/18101864e2d12cf1ba7fe6bad810b1b2/cf 2023-09-13 23:00:04,972 INFO [StoreOpener-8d76cbc2cd73433d3550dee05d361e4b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 8d76cbc2cd73433d3550dee05d361e4b 2023-09-13 23:00:04,972 INFO [StoreOpener-18101864e2d12cf1ba7fe6bad810b1b2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 18101864e2d12cf1ba7fe6bad810b1b2 columnFamilyName cf 2023-09-13 23:00:04,973 INFO [StoreOpener-18101864e2d12cf1ba7fe6bad810b1b2-1] regionserver.HStore(310): Store=18101864e2d12cf1ba7fe6bad810b1b2/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-13 23:00:04,973 DEBUG [StoreOpener-8d76cbc2cd73433d3550dee05d361e4b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/default/testtb-testExportFileSystemState/8d76cbc2cd73433d3550dee05d361e4b/cf 2023-09-13 23:00:04,975 DEBUG [StoreOpener-8d76cbc2cd73433d3550dee05d361e4b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/default/testtb-testExportFileSystemState/8d76cbc2cd73433d3550dee05d361e4b/cf 2023-09-13 23:00:04,975 INFO [StoreOpener-8d76cbc2cd73433d3550dee05d361e4b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8d76cbc2cd73433d3550dee05d361e4b columnFamilyName cf 2023-09-13 23:00:04,976 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/default/testtb-testExportFileSystemState/18101864e2d12cf1ba7fe6bad810b1b2 2023-09-13 23:00:04,976 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/default/testtb-testExportFileSystemState/18101864e2d12cf1ba7fe6bad810b1b2 2023-09-13 23:00:04,976 INFO [StoreOpener-8d76cbc2cd73433d3550dee05d361e4b-1] regionserver.HStore(310): Store=8d76cbc2cd73433d3550dee05d361e4b/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-13 23:00:04,978 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/default/testtb-testExportFileSystemState/8d76cbc2cd73433d3550dee05d361e4b 2023-09-13 23:00:04,979 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/default/testtb-testExportFileSystemState/8d76cbc2cd73433d3550dee05d361e4b 2023-09-13 23:00:04,980 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 18101864e2d12cf1ba7fe6bad810b1b2 2023-09-13 23:00:04,982 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 8d76cbc2cd73433d3550dee05d361e4b 2023-09-13 23:00:04,983 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/default/testtb-testExportFileSystemState/18101864e2d12cf1ba7fe6bad810b1b2/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-13 23:00:04,983 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 18101864e2d12cf1ba7fe6bad810b1b2; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59727106, jitterRate=-0.10999676585197449}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-13 23:00:04,983 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 18101864e2d12cf1ba7fe6bad810b1b2: 2023-09-13 23:00:04,984 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,1,1694646004567.18101864e2d12cf1ba7fe6bad810b1b2., pid=31, masterSystemTime=1694646004963 2023-09-13 23:00:04,984 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/default/testtb-testExportFileSystemState/8d76cbc2cd73433d3550dee05d361e4b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-13 23:00:04,985 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 8d76cbc2cd73433d3550dee05d361e4b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70737136, jitterRate=0.05406546592712402}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-13 23:00:04,985 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 8d76cbc2cd73433d3550dee05d361e4b: 2023-09-13 23:00:04,986 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,,1694646004567.8d76cbc2cd73433d3550dee05d361e4b., pid=30, masterSystemTime=1694646004963 2023-09-13 23:00:04,986 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,1,1694646004567.18101864e2d12cf1ba7fe6bad810b1b2. 2023-09-13 23:00:04,986 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,1,1694646004567.18101864e2d12cf1ba7fe6bad810b1b2. 2023-09-13 23:00:04,987 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=18101864e2d12cf1ba7fe6bad810b1b2, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 23:00:04,988 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,,1694646004567.8d76cbc2cd73433d3550dee05d361e4b. 2023-09-13 23:00:04,988 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,,1694646004567.8d76cbc2cd73433d3550dee05d361e4b. 2023-09-13 23:00:04,988 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,1,1694646004567.18101864e2d12cf1ba7fe6bad810b1b2.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1694646004987"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1694646004987"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1694646004987"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1694646004987"}]},"ts":"1694646004987"} 2023-09-13 23:00:04,989 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=8d76cbc2cd73433d3550dee05d361e4b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 23:00:04,989 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,,1694646004567.8d76cbc2cd73433d3550dee05d361e4b.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1694646004988"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1694646004988"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1694646004988"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1694646004988"}]},"ts":"1694646004988"} 2023-09-13 23:00:04,992 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=31, resume processing ppid=29 2023-09-13 23:00:04,994 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=31, ppid=29, state=SUCCESS; OpenRegionProcedure 18101864e2d12cf1ba7fe6bad810b1b2, server=jenkins-hbase4.apache.org,39163,1694645979837 in 183 msec 2023-09-13 23:00:04,995 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=30, resume processing ppid=28 2023-09-13 23:00:04,996 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=30, ppid=28, state=SUCCESS; OpenRegionProcedure 8d76cbc2cd73433d3550dee05d361e4b, server=jenkins-hbase4.apache.org,42165,1694645979926 in 186 msec 2023-09-13 23:00:04,997 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=18101864e2d12cf1ba7fe6bad810b1b2, ASSIGN in 348 msec 2023-09-13 23:00:04,999 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=28, resume processing ppid=27 2023-09-13 23:00:04,999 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=8d76cbc2cd73433d3550dee05d361e4b, ASSIGN in 350 msec 2023-09-13 23:00:05,000 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-13 23:00:05,000 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694646005000"}]},"ts":"1694646005000"} 2023-09-13 23:00:05,002 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLED in hbase:meta 2023-09-13 23:00:05,004 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-09-13 23:00:05,004 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemState jenkins: RWXCA 2023-09-13 23:00:05,006 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39163] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-09-13 23:00:05,008 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:39163-0x100a784b9ba0001, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-13 23:00:05,008 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:34119-0x100a784b9ba0002, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-13 23:00:05,008 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:42165-0x100a784b9ba0003, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-13 23:00:05,008 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-13 23:00:05,010 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-13 23:00:05,010 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-13 23:00:05,010 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-13 23:00:05,010 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-13 23:00:05,012 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemState in 441 msec 2023-09-13 23:00:05,179 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-09-13 23:00:05,180 INFO [Listener at jenkins-hbase4.apache.org/37017] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemState, procId: 27 completed 2023-09-13 23:00:05,183 DEBUG [Listener at jenkins-hbase4.apache.org/37017] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-09-13 23:00:05,183 DEBUG [Listener at jenkins-hbase4.apache.org/37017] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1694646004567.8d76cbc2cd73433d3550dee05d361e4b. 2023-09-13 23:00:05,186 INFO [Listener at jenkins-hbase4.apache.org/37017] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-13 23:00:05,203 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-13 23:00:05,203 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1694646005203 (current time:1694646005203). 2023-09-13 23:00:05,204 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-13 23:00:05,205 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] zookeeper.ReadOnlyZKClient(139): Connect 0x469f83b0 to 127.0.0.1:55012 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-13 23:00:05,214 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7890602b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-13 23:00:05,215 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-13 23:00:05,217 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36930, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-13 23:00:05,218 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x469f83b0 to 127.0.0.1:55012 2023-09-13 23:00:05,218 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-13 23:00:05,220 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] zookeeper.ReadOnlyZKClient(139): Connect 0x27c05f8e to 127.0.0.1:55012 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-13 23:00:05,227 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1d78cac5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-13 23:00:05,228 DEBUG [hconnection-0x66127079-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-13 23:00:05,231 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36942, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-13 23:00:05,239 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-13 23:00:05,240 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35704, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-13 23:00:05,242 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x27c05f8e to 127.0.0.1:55012 2023-09-13 23:00:05,242 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-13 23:00:05,242 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-09-13 23:00:05,243 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-13 23:00:05,243 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-13 23:00:05,246 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] procedure2.ProcedureExecutor(1028): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-13 23:00:05,247 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-13 23:00:05,248 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1694646605248 2023-09-13 23:00:05,248 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-13 23:00:05,248 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-09-13 23:00:05,250 DEBUG [Listener at jenkins-hbase4.apache.org/37017] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-13 23:00:05,250 DEBUG [Listener at jenkins-hbase4.apache.org/37017] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-13 23:00:05,252 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-13 23:00:05,252 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-13 23:00:05,253 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 7 msec 2023-09-13 23:00:05,254 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-13 23:00:05,255 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=33, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1694646605255 2023-09-13 23:00:05,273 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemState 2023-09-13 23:00:05,273 INFO [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemState' 2023-09-13 23:00:05,273 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-13 23:00:05,275 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' 2023-09-13 23:00:05,275 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-09-13 23:00:05,275 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-13 23:00:05,275 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-13 23:00:05,278 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:34119-0x100a784b9ba0002, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 23:00:05,278 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:39163-0x100a784b9ba0001, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 23:00:05,278 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 23:00:05,278 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 23:00:05,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 23:00:05,278 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 23:00:05,278 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:42165-0x100a784b9ba0003, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 23:00:05,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 23:00:05,278 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 23:00:05,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 23:00:05,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-13 23:00:05,278 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 23:00:05,279 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 23:00:05,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-13 23:00:05,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-13 23:00:05,279 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39163-0x100a784b9ba0001, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-13 23:00:05,279 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 23:00:05,279 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-13 23:00:05,279 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42165-0x100a784b9ba0003, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-13 23:00:05,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-09-13 23:00:05,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-13 23:00:05,279 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34119-0x100a784b9ba0002, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-13 23:00:05,279 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-13 23:00:05,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-09-13 23:00:05,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-13 23:00:05,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-09-13 23:00:05,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-13 23:00:05,280 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-09-13 23:00:05,280 DEBUG [member: 'jenkins-hbase4.apache.org,39163,1694645979837' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-13 23:00:05,280 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-13 23:00:05,280 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-13 23:00:05,280 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-09-13 23:00:05,280 DEBUG [member: 'jenkins-hbase4.apache.org,39163,1694645979837' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-13 23:00:05,280 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1694645979883' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-13 23:00:05,281 DEBUG [member: 'jenkins-hbase4.apache.org,39163,1694645979837' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-13 23:00:05,281 DEBUG [member: 'jenkins-hbase4.apache.org,39163,1694645979837' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-09-13 23:00:05,281 DEBUG [member: 'jenkins-hbase4.apache.org,39163,1694645979837' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39163,1694645979837' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-09-13 23:00:05,281 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1694645979883' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-13 23:00:05,281 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-09-13 23:00:05,282 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1694645979883' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-13 23:00:05,283 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1694645979883' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-09-13 23:00:05,282 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-13 23:00:05,283 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-13 23:00:05,283 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1694645979883' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34119,1694645979883' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-09-13 23:00:05,284 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-13 23:00:05,284 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-09-13 23:00:05,284 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42165,1694645979926' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-09-13 23:00:05,285 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 23:00:05,285 DEBUG [member: 'jenkins-hbase4.apache.org,39163,1694645979837' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-13 23:00:05,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 23:00:05,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-13 23:00:05,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-13 23:00:05,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-13 23:00:05,292 DEBUG [member: 'jenkins-hbase4.apache.org,39163,1694645979837' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39163-0x100a784b9ba0001, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-13 23:00:05,292 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1694645979883' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-13 23:00:05,292 DEBUG [member: 'jenkins-hbase4.apache.org,39163,1694645979837' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-13 23:00:05,293 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 23:00:05,293 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-13 23:00:05,293 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1694645979883' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34119-0x100a784b9ba0002, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-13 23:00:05,293 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1694645979883' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-13 23:00:05,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-13 23:00:05,293 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42165-0x100a784b9ba0003, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-13 23:00:05,293 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-13 23:00:05,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-13 23:00:05,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34119,1694645979883 2023-09-13 23:00:05,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 23:00:05,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 23:00:05,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-13 23:00:05,295 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39163,1694645979837' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-09-13 23:00:05,295 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@39816c78[Count = 1] remaining members to acquire global barrier 2023-09-13 23:00:05,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 23:00:05,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-13 23:00:05,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-13 23:00:05,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-13 23:00:05,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-13 23:00:05,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-13 23:00:05,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34119,1694645979883 2023-09-13 23:00:05,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 23:00:05,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 23:00:05,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-13 23:00:05,297 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42165,1694645979926' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-09-13 23:00:05,297 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@39816c78[Count = 0] remaining members to acquire global barrier 2023-09-13 23:00:05,297 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-09-13 23:00:05,297 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-13 23:00:05,299 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:39163-0x100a784b9ba0001, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-13 23:00:05,299 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:34119-0x100a784b9ba0002, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-13 23:00:05,299 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-13 23:00:05,299 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-13 23:00:05,299 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:42165-0x100a784b9ba0003, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-13 23:00:05,299 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 23:00:05,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-13 23:00:05,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-13 23:00:05,299 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1694645979883' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-13 23:00:05,299 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-13 23:00:05,299 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1694645979883' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-09-13 23:00:05,299 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 23:00:05,299 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-13 23:00:05,299 DEBUG [member: 'jenkins-hbase4.apache.org,39163,1694645979837' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-13 23:00:05,299 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1694645979883' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,34119,1694645979883' in zk 2023-09-13 23:00:05,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-13 23:00:05,300 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-13 23:00:05,300 DEBUG [member: 'jenkins-hbase4.apache.org,39163,1694645979837' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-13 23:00:05,300 DEBUG [member: 'jenkins-hbase4.apache.org,39163,1694645979837' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-13 23:00:05,300 DEBUG [rs(jenkins-hbase4.apache.org,39163,1694645979837)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1694646004567.18101864e2d12cf1ba7fe6bad810b1b2. 2023-09-13 23:00:05,300 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-13 23:00:05,300 DEBUG [rs(jenkins-hbase4.apache.org,42165,1694645979926)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1694646004567.8d76cbc2cd73433d3550dee05d361e4b. 2023-09-13 23:00:05,300 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-13 23:00:05,300 DEBUG [rs(jenkins-hbase4.apache.org,42165,1694645979926)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1694646004567.8d76cbc2cd73433d3550dee05d361e4b. started... 2023-09-13 23:00:05,300 DEBUG [rs(jenkins-hbase4.apache.org,39163,1694645979837)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1694646004567.18101864e2d12cf1ba7fe6bad810b1b2. started... 2023-09-13 23:00:05,300 DEBUG [rs(jenkins-hbase4.apache.org,42165,1694645979926)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 8d76cbc2cd73433d3550dee05d361e4b: 2023-09-13 23:00:05,301 DEBUG [rs(jenkins-hbase4.apache.org,39163,1694645979837)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 18101864e2d12cf1ba7fe6bad810b1b2: 2023-09-13 23:00:05,302 DEBUG [rs(jenkins-hbase4.apache.org,42165,1694645979926)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1694646004567.8d76cbc2cd73433d3550dee05d361e4b.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-09-13 23:00:05,302 DEBUG [rs(jenkins-hbase4.apache.org,42165,1694645979926)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-13 23:00:05,302 DEBUG [rs(jenkins-hbase4.apache.org,42165,1694645979926)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-13 23:00:05,302 DEBUG [rs(jenkins-hbase4.apache.org,39163,1694645979837)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1694646004567.18101864e2d12cf1ba7fe6bad810b1b2.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-09-13 23:00:05,302 DEBUG [rs(jenkins-hbase4.apache.org,39163,1694645979837)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-13 23:00:05,302 DEBUG [rs(jenkins-hbase4.apache.org,39163,1694645979837)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-13 23:00:05,302 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1694645979883' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-09-13 23:00:05,302 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1694645979883' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-13 23:00:05,302 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1694645979883' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-09-13 23:00:05,322 DEBUG [rs(jenkins-hbase4.apache.org,39163,1694645979837)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1694646004567.18101864e2d12cf1ba7fe6bad810b1b2. completed. 2023-09-13 23:00:05,322 DEBUG [rs(jenkins-hbase4.apache.org,39163,1694645979837)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1694646004567.18101864e2d12cf1ba7fe6bad810b1b2. 2023-09-13 23:00:05,322 DEBUG [member: 'jenkins-hbase4.apache.org,39163,1694645979837' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-13 23:00:05,322 DEBUG [member: 'jenkins-hbase4.apache.org,39163,1694645979837' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-13 23:00:05,322 DEBUG [member: 'jenkins-hbase4.apache.org,39163,1694645979837' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 23:00:05,323 DEBUG [member: 'jenkins-hbase4.apache.org,39163,1694645979837' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-09-13 23:00:05,323 DEBUG [member: 'jenkins-hbase4.apache.org,39163,1694645979837' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,39163,1694645979837' in zk 2023-09-13 23:00:05,324 DEBUG [rs(jenkins-hbase4.apache.org,42165,1694645979926)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1694646004567.8d76cbc2cd73433d3550dee05d361e4b. completed. 2023-09-13 23:00:05,324 DEBUG [rs(jenkins-hbase4.apache.org,42165,1694645979926)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1694646004567.8d76cbc2cd73433d3550dee05d361e4b. 2023-09-13 23:00:05,324 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-13 23:00:05,325 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-13 23:00:05,325 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 23:00:05,325 DEBUG [member: 'jenkins-hbase4.apache.org,39163,1694645979837' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-09-13 23:00:05,325 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-09-13 23:00:05,325 DEBUG [member: 'jenkins-hbase4.apache.org,39163,1694645979837' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-13 23:00:05,325 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 23:00:05,325 DEBUG [member: 'jenkins-hbase4.apache.org,39163,1694645979837' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-09-13 23:00:05,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 23:00:05,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-13 23:00:05,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-13 23:00:05,325 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,42165,1694645979926' in zk 2023-09-13 23:00:05,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-13 23:00:05,328 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 23:00:05,328 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-09-13 23:00:05,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-13 23:00:05,328 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-13 23:00:05,328 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-09-13 23:00:05,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-13 23:00:05,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34119,1694645979883 2023-09-13 23:00:05,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 23:00:05,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 23:00:05,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-13 23:00:05,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-13 23:00:05,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34119,1694645979883 2023-09-13 23:00:05,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 23:00:05,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 23:00:05,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,39163,1694645979837': 2023-09-13 23:00:05,332 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39163,1694645979837' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-09-13 23:00:05,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 23:00:05,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-13 23:00:05,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-13 23:00:05,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-13 23:00:05,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-13 23:00:05,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-13 23:00:05,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34119,1694645979883 2023-09-13 23:00:05,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 23:00:05,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 23:00:05,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-13 23:00:05,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-13 23:00:05,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34119,1694645979883 2023-09-13 23:00:05,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 23:00:05,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 23:00:05,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,42165,1694645979926': 2023-09-13 23:00:05,335 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42165,1694645979926' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-09-13 23:00:05,335 INFO [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemState' execution completed 2023-09-13 23:00:05,335 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-13 23:00:05,335 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-13 23:00:05,335 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemState 2023-09-13 23:00:05,335 INFO [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-13 23:00:05,337 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:42165-0x100a784b9ba0003, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-13 23:00:05,337 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-13 23:00:05,337 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:34119-0x100a784b9ba0002, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-13 23:00:05,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-13 23:00:05,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-13 23:00:05,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-13 23:00:05,337 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-13 23:00:05,337 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:42165-0x100a784b9ba0003, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 23:00:05,337 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:39163-0x100a784b9ba0001, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-13 23:00:05,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-13 23:00:05,338 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-13 23:00:05,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-13 23:00:05,338 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:34119-0x100a784b9ba0002, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 23:00:05,338 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34119,1694645979883 2023-09-13 23:00:05,338 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 23:00:05,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 23:00:05,338 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 23:00:05,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 23:00:05,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-13 23:00:05,338 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-13 23:00:05,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-13 23:00:05,338 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:39163-0x100a784b9ba0001, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 23:00:05,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-13 23:00:05,339 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 23:00:05,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-13 23:00:05,339 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 23:00:05,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 23:00:05,339 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 23:00:05,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-13 23:00:05,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-13 23:00:05,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-13 23:00:05,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-13 23:00:05,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34119,1694645979883 2023-09-13 23:00:05,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 23:00:05,342 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34119,1694645979883 2023-09-13 23:00:05,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 23:00:05,342 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 23:00:05,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-13 23:00:05,343 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 23:00:05,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-13 23:00:05,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34119,1694645979883 2023-09-13 23:00:05,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 23:00:05,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 23:00:05,347 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 23:00:05,347 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-13 23:00:05,347 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 23:00:05,347 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:34119-0x100a784b9ba0002, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 23:00:05,347 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34119,1694645979883 2023-09-13 23:00:05,347 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:34119-0x100a784b9ba0002, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 23:00:05,347 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-13 23:00:05,347 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:42165-0x100a784b9ba0003, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 23:00:05,347 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 23:00:05,348 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 23:00:05,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 23:00:05,348 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemState 2023-09-13 23:00:05,348 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:42165-0x100a784b9ba0003, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 23:00:05,348 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-09-13 23:00:05,348 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-13 23:00:05,348 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-09-13 23:00:05,349 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-13 23:00:05,349 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 23:00:05,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 23:00:05,347 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 23:00:05,349 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:39163-0x100a784b9ba0001, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 23:00:05,349 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-13 23:00:05,350 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 23:00:05,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 23:00:05,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 23:00:05,350 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 23:00:05,350 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-13 23:00:05,350 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 23:00:05,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 23:00:05,350 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:39163-0x100a784b9ba0001, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 23:00:05,350 DEBUG [Listener at jenkins-hbase4.apache.org/37017] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-13 23:00:05,350 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34119,1694645979883 2023-09-13 23:00:05,350 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 23:00:05,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 23:00:05,350 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-13 23:00:05,351 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-13 23:00:05,351 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-13 23:00:05,351 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-09-13 23:00:05,352 DEBUG [Listener at jenkins-hbase4.apache.org/37017] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-13 23:00:05,366 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemState 2023-09-13 23:00:05,367 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-09-13 23:00:05,393 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState to hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.hbase-snapshot/emptySnaptb0-testExportFileSystemState 2023-09-13 23:00:05,394 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-09-13 23:00:05,394 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-09-13 23:00:05,394 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-09-13 23:00:05,394 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1694646005248Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1694646005366 (+118 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemState at 1694646005366Loading Region manifests for emptySnaptb0-testExportFileSystemState at 1694646005366Writing data manifest for emptySnaptb0-testExportFileSystemState at 1694646005372 (+6 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemState at 1694646005386 (+14 ms)Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1694646005394 (+8 ms) 2023-09-13 23:00:05,397 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=33, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-13 23:00:05,401 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=33, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 147 msec 2023-09-13 23:00:05,552 DEBUG [Listener at jenkins-hbase4.apache.org/37017] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-13 23:00:05,555 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-13 23:00:05,555 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-13 23:00:05,559 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42165] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,,1694646004567.8d76cbc2cd73433d3550dee05d361e4b. with WAL disabled. Data may be lost in the event of a crash. 2023-09-13 23:00:05,561 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39163] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,1,1694646004567.18101864e2d12cf1ba7fe6bad810b1b2. with WAL disabled. Data may be lost in the event of a crash. 2023-09-13 23:00:05,565 DEBUG [Listener at jenkins-hbase4.apache.org/37017] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-09-13 23:00:05,565 DEBUG [Listener at jenkins-hbase4.apache.org/37017] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1694646004567.8d76cbc2cd73433d3550dee05d361e4b. 2023-09-13 23:00:05,565 INFO [Listener at jenkins-hbase4.apache.org/37017] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-13 23:00:05,577 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-13 23:00:05,577 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1694646005577 (current time:1694646005577). 2023-09-13 23:00:05,577 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-13 23:00:05,578 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] zookeeper.ReadOnlyZKClient(139): Connect 0x2b1917d3 to 127.0.0.1:55012 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-13 23:00:05,586 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@450dae6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-13 23:00:05,587 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-13 23:00:05,590 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36240, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-13 23:00:05,591 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2b1917d3 to 127.0.0.1:55012 2023-09-13 23:00:05,591 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-13 23:00:05,592 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] zookeeper.ReadOnlyZKClient(139): Connect 0x71b43fcc to 127.0.0.1:55012 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-13 23:00:05,597 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@10f576e4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-13 23:00:05,599 DEBUG [hconnection-0x572a7575-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-13 23:00:05,601 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36250, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-13 23:00:05,605 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-13 23:00:05,608 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59788, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-13 23:00:05,609 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x71b43fcc to 127.0.0.1:55012 2023-09-13 23:00:05,609 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-13 23:00:05,609 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-09-13 23:00:05,610 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-13 23:00:05,610 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-13 23:00:05,611 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemState' 2023-09-13 23:00:05,613 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] procedure2.ProcedureExecutor(1028): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-13 23:00:05,614 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-13 23:00:05,616 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1694646605616 2023-09-13 23:00:05,616 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-09-13 23:00:05,616 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-13 23:00:05,617 DEBUG [Listener at jenkins-hbase4.apache.org/37017] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-13 23:00:05,617 DEBUG [Listener at jenkins-hbase4.apache.org/37017] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-13 23:00:05,618 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-13 23:00:05,618 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-13 23:00:05,620 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 7 msec 2023-09-13 23:00:05,621 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-13 23:00:05,622 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=35, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1694646605622 2023-09-13 23:00:05,643 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemState 2023-09-13 23:00:05,643 INFO [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemState' 2023-09-13 23:00:05,643 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-13 23:00:05,644 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemState' starting 'acquire' 2023-09-13 23:00:05,644 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-09-13 23:00:05,645 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-13 23:00:05,645 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-13 23:00:05,646 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:34119-0x100a784b9ba0002, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 23:00:05,646 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:42165-0x100a784b9ba0003, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 23:00:05,646 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 23:00:05,646 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:39163-0x100a784b9ba0001, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 23:00:05,646 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 23:00:05,647 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 23:00:05,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 23:00:05,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 23:00:05,647 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 23:00:05,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 23:00:05,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-13 23:00:05,647 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 23:00:05,647 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 23:00:05,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-13 23:00:05,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-13 23:00:05,648 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39163-0x100a784b9ba0001, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-13 23:00:05,648 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42165-0x100a784b9ba0003, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-13 23:00:05,648 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 23:00:05,648 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-13 23:00:05,648 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34119-0x100a784b9ba0002, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-13 23:00:05,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-09-13 23:00:05,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-13 23:00:05,648 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-13 23:00:05,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-09-13 23:00:05,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-13 23:00:05,649 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-09-13 23:00:05,649 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-13 23:00:05,649 DEBUG [member: 'jenkins-hbase4.apache.org,39163,1694645979837' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-13 23:00:05,649 DEBUG [member: 'jenkins-hbase4.apache.org,39163,1694645979837' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-13 23:00:05,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-09-13 23:00:05,650 DEBUG [member: 'jenkins-hbase4.apache.org,39163,1694645979837' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-13 23:00:05,650 DEBUG [member: 'jenkins-hbase4.apache.org,39163,1694645979837' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-09-13 23:00:05,650 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-09-13 23:00:05,650 DEBUG [member: 'jenkins-hbase4.apache.org,39163,1694645979837' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39163,1694645979837' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-09-13 23:00:05,650 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1694645979883' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-13 23:00:05,650 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1694645979883' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-13 23:00:05,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-13 23:00:05,651 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1694645979883' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-13 23:00:05,652 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1694645979883' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-09-13 23:00:05,652 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-13 23:00:05,652 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1694645979883' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34119,1694645979883' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-09-13 23:00:05,652 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-09-13 23:00:05,652 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-13 23:00:05,652 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-13 23:00:05,653 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-13 23:00:05,653 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-09-13 23:00:05,653 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42165,1694645979926' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-09-13 23:00:05,654 DEBUG [member: 'jenkins-hbase4.apache.org,39163,1694645979837' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-13 23:00:05,657 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 23:00:05,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 23:00:05,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-13 23:00:05,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-13 23:00:05,657 DEBUG [member: 'jenkins-hbase4.apache.org,39163,1694645979837' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39163-0x100a784b9ba0001, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-13 23:00:05,657 DEBUG [member: 'jenkins-hbase4.apache.org,39163,1694645979837' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-13 23:00:05,659 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 23:00:05,659 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-13 23:00:05,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-13 23:00:05,659 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42165-0x100a784b9ba0003, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-13 23:00:05,659 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-13 23:00:05,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-13 23:00:05,660 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1694645979883' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-13 23:00:05,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-13 23:00:05,660 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1694645979883' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34119-0x100a784b9ba0002, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-13 23:00:05,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34119,1694645979883 2023-09-13 23:00:05,660 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1694645979883' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-13 23:00:05,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 23:00:05,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 23:00:05,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-13 23:00:05,661 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39163,1694645979837' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-09-13 23:00:05,661 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@51e50c93[Count = 1] remaining members to acquire global barrier 2023-09-13 23:00:05,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 23:00:05,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-13 23:00:05,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-13 23:00:05,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-13 23:00:05,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-13 23:00:05,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-13 23:00:05,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34119,1694645979883 2023-09-13 23:00:05,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 23:00:05,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 23:00:05,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-13 23:00:05,664 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42165,1694645979926' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-09-13 23:00:05,664 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@51e50c93[Count = 0] remaining members to acquire global barrier 2023-09-13 23:00:05,664 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-09-13 23:00:05,664 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-13 23:00:05,665 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:42165-0x100a784b9ba0003, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-13 23:00:05,665 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:34119-0x100a784b9ba0002, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-13 23:00:05,666 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:39163-0x100a784b9ba0001, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-13 23:00:05,666 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-13 23:00:05,666 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-13 23:00:05,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-13 23:00:05,666 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-13 23:00:05,666 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 23:00:05,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-13 23:00:05,666 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1694645979883' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-13 23:00:05,666 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1694645979883' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-09-13 23:00:05,666 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1694645979883' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,34119,1694645979883' in zk 2023-09-13 23:00:05,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-13 23:00:05,666 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-13 23:00:05,666 DEBUG [member: 'jenkins-hbase4.apache.org,39163,1694645979837' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-13 23:00:05,666 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 23:00:05,667 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-13 23:00:05,667 DEBUG [member: 'jenkins-hbase4.apache.org,39163,1694645979837' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-13 23:00:05,667 DEBUG [member: 'jenkins-hbase4.apache.org,39163,1694645979837' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-13 23:00:05,667 DEBUG [rs(jenkins-hbase4.apache.org,42165,1694645979926)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1694646004567.8d76cbc2cd73433d3550dee05d361e4b. 2023-09-13 23:00:05,667 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-13 23:00:05,667 DEBUG [rs(jenkins-hbase4.apache.org,42165,1694645979926)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1694646004567.8d76cbc2cd73433d3550dee05d361e4b. started... 2023-09-13 23:00:05,667 DEBUG [rs(jenkins-hbase4.apache.org,39163,1694645979837)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1694646004567.18101864e2d12cf1ba7fe6bad810b1b2. 2023-09-13 23:00:05,667 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-13 23:00:05,667 DEBUG [rs(jenkins-hbase4.apache.org,39163,1694645979837)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1694646004567.18101864e2d12cf1ba7fe6bad810b1b2. started... 2023-09-13 23:00:05,667 INFO [rs(jenkins-hbase4.apache.org,42165,1694645979926)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 8d76cbc2cd73433d3550dee05d361e4b 1/1 column families, dataSize=199 B heapSize=688 B 2023-09-13 23:00:05,667 INFO [rs(jenkins-hbase4.apache.org,39163,1694645979837)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 18101864e2d12cf1ba7fe6bad810b1b2 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-09-13 23:00:05,668 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1694645979883' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-09-13 23:00:05,668 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1694645979883' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-13 23:00:05,668 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1694645979883' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-09-13 23:00:05,705 INFO [rs(jenkins-hbase4.apache.org,42165,1694645979926)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202309133bf48d5739934abbbdc655828ff66486 to hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e202309133bf48d5739934abbbdc655828ff66486 2023-09-13 23:00:05,705 INFO [rs(jenkins-hbase4.apache.org,39163,1694645979837)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230913e3c6e2cc3dfd49a4840924a18d7845d2 to hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230913e3c6e2cc3dfd49a4840924a18d7845d2 2023-09-13 23:00:05,717 DEBUG [Listener at jenkins-hbase4.apache.org/37017] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-13 23:00:05,724 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-13 23:00:05,724 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-09-13 23:00:05,725 DEBUG [Listener at jenkins-hbase4.apache.org/37017] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-13 23:00:05,728 INFO [rs(jenkins-hbase4.apache.org,42165,1694645979926)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=199, hasBloomFilter=true, into tmp file hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/default/testtb-testExportFileSystemState/8d76cbc2cd73433d3550dee05d361e4b/.tmp/cf/91ab5618a80f468cb904145c17fad4cc 2023-09-13 23:00:05,735 DEBUG [rs(jenkins-hbase4.apache.org,42165,1694645979926)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/default/testtb-testExportFileSystemState/8d76cbc2cd73433d3550dee05d361e4b/.tmp/cf/91ab5618a80f468cb904145c17fad4cc as hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/default/testtb-testExportFileSystemState/8d76cbc2cd73433d3550dee05d361e4b/cf/91ab5618a80f468cb904145c17fad4cc 2023-09-13 23:00:05,741 INFO [rs(jenkins-hbase4.apache.org,42165,1694645979926)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/default/testtb-testExportFileSystemState/8d76cbc2cd73433d3550dee05d361e4b/cf/91ab5618a80f468cb904145c17fad4cc, entries=3, sequenceid=6, filesize=5.4 K 2023-09-13 23:00:05,742 INFO [rs(jenkins-hbase4.apache.org,42165,1694645979926)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for 8d76cbc2cd73433d3550dee05d361e4b in 75ms, sequenceid=6, compaction requested=false 2023-09-13 23:00:05,743 DEBUG [rs(jenkins-hbase4.apache.org,42165,1694645979926)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 8d76cbc2cd73433d3550dee05d361e4b: 2023-09-13 23:00:05,743 DEBUG [rs(jenkins-hbase4.apache.org,42165,1694645979926)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1694646004567.8d76cbc2cd73433d3550dee05d361e4b.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-09-13 23:00:05,744 DEBUG [rs(jenkins-hbase4.apache.org,42165,1694645979926)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-13 23:00:05,744 DEBUG [rs(jenkins-hbase4.apache.org,42165,1694645979926)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/default/testtb-testExportFileSystemState/8d76cbc2cd73433d3550dee05d361e4b/cf/91ab5618a80f468cb904145c17fad4cc] hfiles 2023-09-13 23:00:05,744 DEBUG [rs(jenkins-hbase4.apache.org,42165,1694645979926)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/default/testtb-testExportFileSystemState/8d76cbc2cd73433d3550dee05d361e4b/cf/91ab5618a80f468cb904145c17fad4cc for snapshot=snaptb0-testExportFileSystemState 2023-09-13 23:00:05,758 DEBUG [rs(jenkins-hbase4.apache.org,42165,1694645979926)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1694646004567.8d76cbc2cd73433d3550dee05d361e4b. completed. 2023-09-13 23:00:05,758 DEBUG [rs(jenkins-hbase4.apache.org,42165,1694645979926)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1694646004567.8d76cbc2cd73433d3550dee05d361e4b. 2023-09-13 23:00:05,758 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-13 23:00:05,758 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-13 23:00:05,758 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 23:00:05,759 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-09-13 23:00:05,759 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,42165,1694645979926' in zk 2023-09-13 23:00:05,766 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-09-13 23:00:05,766 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 23:00:05,766 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-13 23:00:05,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 23:00:05,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-13 23:00:05,766 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-09-13 23:00:05,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-13 23:00:05,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-13 23:00:05,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-13 23:00:05,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-13 23:00:05,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34119,1694645979883 2023-09-13 23:00:05,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 23:00:05,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 23:00:05,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-13 23:00:05,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-13 23:00:05,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34119,1694645979883 2023-09-13 23:00:05,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 23:00:05,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,42165,1694645979926': 2023-09-13 23:00:05,772 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42165,1694645979926' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-09-13 23:00:05,925 DEBUG [Listener at jenkins-hbase4.apache.org/37017] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-13 23:00:05,926 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-13 23:00:05,926 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-09-13 23:00:05,927 DEBUG [Listener at jenkins-hbase4.apache.org/37017] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-09-13 23:00:06,129 INFO [rs(jenkins-hbase4.apache.org,39163,1694645979837)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/default/testtb-testExportFileSystemState/18101864e2d12cf1ba7fe6bad810b1b2/.tmp/cf/0af1ea11b9c64b329ccad48dfc41f91d 2023-09-13 23:00:06,136 DEBUG [rs(jenkins-hbase4.apache.org,39163,1694645979837)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/default/testtb-testExportFileSystemState/18101864e2d12cf1ba7fe6bad810b1b2/.tmp/cf/0af1ea11b9c64b329ccad48dfc41f91d as hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/default/testtb-testExportFileSystemState/18101864e2d12cf1ba7fe6bad810b1b2/cf/0af1ea11b9c64b329ccad48dfc41f91d 2023-09-13 23:00:06,143 INFO [rs(jenkins-hbase4.apache.org,39163,1694645979837)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/default/testtb-testExportFileSystemState/18101864e2d12cf1ba7fe6bad810b1b2/cf/0af1ea11b9c64b329ccad48dfc41f91d, entries=47, sequenceid=6, filesize=12.8 K 2023-09-13 23:00:06,144 INFO [rs(jenkins-hbase4.apache.org,39163,1694645979837)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for 18101864e2d12cf1ba7fe6bad810b1b2 in 477ms, sequenceid=6, compaction requested=false 2023-09-13 23:00:06,144 DEBUG [rs(jenkins-hbase4.apache.org,39163,1694645979837)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 18101864e2d12cf1ba7fe6bad810b1b2: 2023-09-13 23:00:06,144 DEBUG [rs(jenkins-hbase4.apache.org,39163,1694645979837)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1694646004567.18101864e2d12cf1ba7fe6bad810b1b2.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-09-13 23:00:06,144 DEBUG [rs(jenkins-hbase4.apache.org,39163,1694645979837)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-13 23:00:06,144 DEBUG [rs(jenkins-hbase4.apache.org,39163,1694645979837)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/default/testtb-testExportFileSystemState/18101864e2d12cf1ba7fe6bad810b1b2/cf/0af1ea11b9c64b329ccad48dfc41f91d] hfiles 2023-09-13 23:00:06,144 DEBUG [rs(jenkins-hbase4.apache.org,39163,1694645979837)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/default/testtb-testExportFileSystemState/18101864e2d12cf1ba7fe6bad810b1b2/cf/0af1ea11b9c64b329ccad48dfc41f91d for snapshot=snaptb0-testExportFileSystemState 2023-09-13 23:00:06,163 DEBUG [rs(jenkins-hbase4.apache.org,39163,1694645979837)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1694646004567.18101864e2d12cf1ba7fe6bad810b1b2. completed. 2023-09-13 23:00:06,163 DEBUG [rs(jenkins-hbase4.apache.org,39163,1694645979837)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1694646004567.18101864e2d12cf1ba7fe6bad810b1b2. 2023-09-13 23:00:06,163 DEBUG [member: 'jenkins-hbase4.apache.org,39163,1694645979837' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-13 23:00:06,163 DEBUG [member: 'jenkins-hbase4.apache.org,39163,1694645979837' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-13 23:00:06,163 DEBUG [member: 'jenkins-hbase4.apache.org,39163,1694645979837' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 23:00:06,163 DEBUG [member: 'jenkins-hbase4.apache.org,39163,1694645979837' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-09-13 23:00:06,163 DEBUG [member: 'jenkins-hbase4.apache.org,39163,1694645979837' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,39163,1694645979837' in zk 2023-09-13 23:00:06,165 DEBUG [member: 'jenkins-hbase4.apache.org,39163,1694645979837' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-09-13 23:00:06,165 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 23:00:06,165 DEBUG [member: 'jenkins-hbase4.apache.org,39163,1694645979837' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-13 23:00:06,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 23:00:06,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-13 23:00:06,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-13 23:00:06,166 DEBUG [member: 'jenkins-hbase4.apache.org,39163,1694645979837' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-09-13 23:00:06,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-13 23:00:06,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-13 23:00:06,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-13 23:00:06,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34119,1694645979883 2023-09-13 23:00:06,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 23:00:06,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 23:00:06,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-13 23:00:06,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-13 23:00:06,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34119,1694645979883 2023-09-13 23:00:06,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 23:00:06,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 23:00:06,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,39163,1694645979837': 2023-09-13 23:00:06,171 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39163,1694645979837' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-09-13 23:00:06,171 INFO [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemState' execution completed 2023-09-13 23:00:06,172 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-13 23:00:06,172 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-13 23:00:06,172 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemState 2023-09-13 23:00:06,172 INFO [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-13 23:00:06,174 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:42165-0x100a784b9ba0003, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-13 23:00:06,174 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:39163-0x100a784b9ba0001, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-13 23:00:06,174 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-13 23:00:06,174 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-13 23:00:06,174 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:39163-0x100a784b9ba0001, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 23:00:06,174 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:34119-0x100a784b9ba0002, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-13 23:00:06,174 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:42165-0x100a784b9ba0003, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 23:00:06,174 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-13 23:00:06,174 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:34119-0x100a784b9ba0002, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 23:00:06,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-13 23:00:06,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-13 23:00:06,174 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-13 23:00:06,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-13 23:00:06,174 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 23:00:06,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 23:00:06,175 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 23:00:06,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 23:00:06,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-13 23:00:06,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-13 23:00:06,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-13 23:00:06,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-13 23:00:06,175 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34119,1694645979883 2023-09-13 23:00:06,175 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 23:00:06,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 23:00:06,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-13 23:00:06,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-13 23:00:06,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-13 23:00:06,176 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 23:00:06,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-13 23:00:06,176 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 23:00:06,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-13 23:00:06,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-13 23:00:06,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34119,1694645979883 2023-09-13 23:00:06,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 23:00:06,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 23:00:06,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-13 23:00:06,178 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34119,1694645979883 2023-09-13 23:00:06,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-13 23:00:06,179 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 23:00:06,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34119,1694645979883 2023-09-13 23:00:06,179 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 23:00:06,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 23:00:06,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 23:00:06,183 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:42165-0x100a784b9ba0003, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 23:00:06,183 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 23:00:06,183 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:42165-0x100a784b9ba0003, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 23:00:06,183 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:39163-0x100a784b9ba0001, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 23:00:06,183 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:34119-0x100a784b9ba0002, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 23:00:06,183 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 23:00:06,183 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 23:00:06,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 23:00:06,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 23:00:06,183 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-13 23:00:06,183 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-13 23:00:06,184 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemState 2023-09-13 23:00:06,183 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:34119-0x100a784b9ba0002, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 23:00:06,183 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:39163-0x100a784b9ba0001, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 23:00:06,195 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 23:00:06,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 23:00:06,184 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-09-13 23:00:06,195 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 23:00:06,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 23:00:06,195 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemState 2023-09-13 23:00:06,195 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-13 23:00:06,183 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 23:00:06,195 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34119,1694645979883 2023-09-13 23:00:06,195 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-13 23:00:06,195 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 23:00:06,195 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-13 23:00:06,195 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 23:00:06,195 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34119,1694645979883 2023-09-13 23:00:06,195 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-13 23:00:06,195 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-13 23:00:06,196 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 23:00:06,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 23:00:06,196 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 23:00:06,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 23:00:06,197 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230913e3c6e2cc3dfd49a4840924a18d7845d2, hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e202309133bf48d5739934abbbdc655828ff66486] mob files 2023-09-13 23:00:06,197 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230913e3c6e2cc3dfd49a4840924a18d7845d2 2023-09-13 23:00:06,197 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e202309133bf48d5739934abbbdc655828ff66486 2023-09-13 23:00:06,213 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemState 2023-09-13 23:00:06,214 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-09-13 23:00:06,227 DEBUG [Listener at jenkins-hbase4.apache.org/37017] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-13 23:00:06,228 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-13 23:00:06,228 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-09-13 23:00:06,228 DEBUG [Listener at jenkins-hbase4.apache.org/37017] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-09-13 23:00:06,240 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState to hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-09-13 23:00:06,241 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-09-13 23:00:06,241 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-09-13 23:00:06,242 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-09-13 23:00:06,242 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1694646005616Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1694646006213 (+597 ms)Consolidate snapshot: snaptb0-testExportFileSystemState at 1694646006213Loading Region manifests for snaptb0-testExportFileSystemState at 1694646006213Writing data manifest for snaptb0-testExportFileSystemState at 1694646006218 (+5 ms)Verifying snapshot: snaptb0-testExportFileSystemState at 1694646006230 (+12 ms)Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1694646006241 (+11 ms) 2023-09-13 23:00:06,244 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=35, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-13 23:00:06,247 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=35, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 628 msec 2023-09-13 23:00:06,728 DEBUG [Listener at jenkins-hbase4.apache.org/37017] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-13 23:00:06,729 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-13 23:00:06,730 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-13 23:00:06,730 INFO [Listener at jenkins-hbase4.apache.org/37017] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/export-test/export-1694646006730 2023-09-13 23:00:06,730 INFO [Listener at jenkins-hbase4.apache.org/37017] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:36267, tgtDir=hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/export-test/export-1694646006730, rawTgtDir=hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/export-test/export-1694646006730, srcFsUri=hdfs://localhost:36267, srcDir=hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d 2023-09-13 23:00:06,760 DEBUG [Listener at jenkins-hbase4.apache.org/37017] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:36267, inputRoot=hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d 2023-09-13 23:00:06,760 DEBUG [Listener at jenkins-hbase4.apache.org/37017] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1773166005_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/export-test/export-1694646006730, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/export-test/export-1694646006730/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-09-13 23:00:06,760 INFO [Listener at jenkins-hbase4.apache.org/37017] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:36267, inputRoot=hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d, snapshotDir=hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.hbase-snapshot/snaptb0-testExportFileSystemState. 2023-09-13 23:00:06,808 INFO [Listener at jenkins-hbase4.apache.org/37017] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.hbase-snapshot/snaptb0-testExportFileSystemState to hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/export-test/export-1694646006730/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-09-13 23:00:06,839 DEBUG [Listener at jenkins-hbase4.apache.org/37017] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-13 23:00:06,840 DEBUG [Listener at jenkins-hbase4.apache.org/37017] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-13 23:00:06,840 DEBUG [Listener at jenkins-hbase4.apache.org/37017] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-13 23:00:06,841 DEBUG [Listener at jenkins-hbase4.apache.org/37017] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-13 23:00:07,731 DEBUG [Listener at jenkins-hbase4.apache.org/37017] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/62bf382e-8712-1db5-f7ab-e78a401ad305/hadoop-6119874518686511850.jar 2023-09-13 23:00:07,731 DEBUG [Listener at jenkins-hbase4.apache.org/37017] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-13 23:00:07,732 DEBUG [Listener at jenkins-hbase4.apache.org/37017] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-13 23:00:07,804 DEBUG [Listener at jenkins-hbase4.apache.org/37017] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/62bf382e-8712-1db5-f7ab-e78a401ad305/hadoop-1973749601885603138.jar 2023-09-13 23:00:07,805 DEBUG [Listener at jenkins-hbase4.apache.org/37017] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-13 23:00:07,806 DEBUG [Listener at jenkins-hbase4.apache.org/37017] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-13 23:00:07,806 DEBUG [Listener at jenkins-hbase4.apache.org/37017] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-13 23:00:07,807 DEBUG [Listener at jenkins-hbase4.apache.org/37017] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-13 23:00:07,807 DEBUG [Listener at jenkins-hbase4.apache.org/37017] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-13 23:00:07,808 DEBUG [Listener at jenkins-hbase4.apache.org/37017] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-13 23:00:07,808 DEBUG [Listener at jenkins-hbase4.apache.org/37017] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-13 23:00:07,809 DEBUG [Listener at jenkins-hbase4.apache.org/37017] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-13 23:00:07,809 DEBUG [Listener at jenkins-hbase4.apache.org/37017] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-13 23:00:07,810 DEBUG [Listener at jenkins-hbase4.apache.org/37017] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-13 23:00:07,810 DEBUG [Listener at jenkins-hbase4.apache.org/37017] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-13 23:00:07,811 DEBUG [Listener at jenkins-hbase4.apache.org/37017] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-13 23:00:07,811 DEBUG [Listener at jenkins-hbase4.apache.org/37017] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-13 23:00:07,811 DEBUG [Listener at jenkins-hbase4.apache.org/37017] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-13 23:00:07,812 DEBUG [Listener at jenkins-hbase4.apache.org/37017] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-13 23:00:07,812 DEBUG [Listener at jenkins-hbase4.apache.org/37017] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-13 23:00:07,813 DEBUG [Listener at jenkins-hbase4.apache.org/37017] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-13 23:00:07,814 DEBUG [Listener at jenkins-hbase4.apache.org/37017] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-13 23:00:07,814 DEBUG [Listener at jenkins-hbase4.apache.org/37017] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-13 23:00:07,815 DEBUG [Listener at jenkins-hbase4.apache.org/37017] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-13 23:00:07,815 DEBUG [Listener at jenkins-hbase4.apache.org/37017] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-13 23:00:07,815 DEBUG [Listener at jenkins-hbase4.apache.org/37017] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-13 23:00:07,816 DEBUG [Listener at jenkins-hbase4.apache.org/37017] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-13 23:00:08,347 WARN [Listener at jenkins-hbase4.apache.org/37017] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-13 23:00:08,350 INFO [Listener at jenkins-hbase4.apache.org/37017] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemState' hfile list 2023-09-13 23:00:08,352 DEBUG [Listener at jenkins-hbase4.apache.org/37017] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-09-13 23:00:08,884 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-13 23:00:08,884 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-13 23:00:08,890 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694645986290_0001_000001 (auth:SIMPLE) 2023-09-13 23:00:09,325 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694645986290_0002_000001 (auth:SIMPLE) 2023-09-13 23:00:09,840 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-13 23:00:13,396 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694645986290_0002_000001 (auth:SIMPLE) 2023-09-13 23:00:15,624 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694645986290_0002_000001 (auth:SIMPLE) 2023-09-13 23:00:18,760 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694645986290_0002_000001 (auth:SIMPLE) 2023-09-13 23:00:20,614 INFO [Listener at jenkins-hbase4.apache.org/37017] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-13 23:00:20,615 INFO [Listener at jenkins-hbase4.apache.org/37017] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-13 23:00:20,623 INFO [Listener at jenkins-hbase4.apache.org/37017] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemState 2023-09-13 23:00:20,623 INFO [Listener at jenkins-hbase4.apache.org/37017] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-13 23:00:20,624 INFO [Listener at jenkins-hbase4.apache.org/37017] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-13 23:00:20,624 DEBUG [Listener at jenkins-hbase4.apache.org/37017] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-527948888_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-09-13 23:00:20,625 DEBUG [Listener at jenkins-hbase4.apache.org/37017] snapshot.TestExportSnapshot(367): hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-09-13 23:00:20,625 DEBUG [Listener at jenkins-hbase4.apache.org/37017] snapshot.TestExportSnapshot(367): hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-09-13 23:00:20,625 DEBUG [Listener at jenkins-hbase4.apache.org/37017] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-527948888_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/export-test/export-1694646006730/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/export-test/export-1694646006730/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-09-13 23:00:20,625 DEBUG [Listener at jenkins-hbase4.apache.org/37017] snapshot.TestExportSnapshot(367): hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/export-test/export-1694646006730/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-09-13 23:00:20,625 DEBUG [Listener at jenkins-hbase4.apache.org/37017] snapshot.TestExportSnapshot(367): hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/export-test/export-1694646006730/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-09-13 23:00:20,632 INFO [Listener at jenkins-hbase4.apache.org/37017] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemState 2023-09-13 23:00:20,633 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemState 2023-09-13 23:00:20,634 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] procedure2.ProcedureExecutor(1028): Stored pid=36, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemState 2023-09-13 23:00:20,637 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-09-13 23:00:20,638 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694646020638"}]},"ts":"1694646020638"} 2023-09-13 23:00:20,639 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLING in hbase:meta 2023-09-13 23:00:20,641 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemState to state=DISABLING 2023-09-13 23:00:20,642 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=8d76cbc2cd73433d3550dee05d361e4b, UNASSIGN}, {pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=18101864e2d12cf1ba7fe6bad810b1b2, UNASSIGN}] 2023-09-13 23:00:20,644 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=8d76cbc2cd73433d3550dee05d361e4b, UNASSIGN 2023-09-13 23:00:20,644 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=18101864e2d12cf1ba7fe6bad810b1b2, UNASSIGN 2023-09-13 23:00:20,645 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=8d76cbc2cd73433d3550dee05d361e4b, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 23:00:20,645 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=18101864e2d12cf1ba7fe6bad810b1b2, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 23:00:20,646 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1694646004567.8d76cbc2cd73433d3550dee05d361e4b.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1694646020645"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694646020645"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694646020645"}]},"ts":"1694646020645"} 2023-09-13 23:00:20,646 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1694646004567.18101864e2d12cf1ba7fe6bad810b1b2.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1694646020645"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694646020645"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694646020645"}]},"ts":"1694646020645"} 2023-09-13 23:00:20,647 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=39, ppid=37, state=RUNNABLE; CloseRegionProcedure 8d76cbc2cd73433d3550dee05d361e4b, server=jenkins-hbase4.apache.org,42165,1694645979926}] 2023-09-13 23:00:20,648 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=40, ppid=38, state=RUNNABLE; CloseRegionProcedure 18101864e2d12cf1ba7fe6bad810b1b2, server=jenkins-hbase4.apache.org,39163,1694645979837}] 2023-09-13 23:00:20,738 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-09-13 23:00:20,800 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 8d76cbc2cd73433d3550dee05d361e4b 2023-09-13 23:00:20,800 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 8d76cbc2cd73433d3550dee05d361e4b, disabling compactions & flushes 2023-09-13 23:00:20,800 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1694646004567.8d76cbc2cd73433d3550dee05d361e4b. 2023-09-13 23:00:20,800 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1694646004567.8d76cbc2cd73433d3550dee05d361e4b. 2023-09-13 23:00:20,800 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1694646004567.8d76cbc2cd73433d3550dee05d361e4b. after waiting 0 ms 2023-09-13 23:00:20,800 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1694646004567.8d76cbc2cd73433d3550dee05d361e4b. 2023-09-13 23:00:20,804 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 18101864e2d12cf1ba7fe6bad810b1b2 2023-09-13 23:00:20,804 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 18101864e2d12cf1ba7fe6bad810b1b2, disabling compactions & flushes 2023-09-13 23:00:20,804 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1694646004567.18101864e2d12cf1ba7fe6bad810b1b2. 2023-09-13 23:00:20,804 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1694646004567.18101864e2d12cf1ba7fe6bad810b1b2. 2023-09-13 23:00:20,804 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1694646004567.18101864e2d12cf1ba7fe6bad810b1b2. after waiting 0 ms 2023-09-13 23:00:20,804 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1694646004567.18101864e2d12cf1ba7fe6bad810b1b2. 2023-09-13 23:00:20,810 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/default/testtb-testExportFileSystemState/8d76cbc2cd73433d3550dee05d361e4b/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-13 23:00:20,810 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/default/testtb-testExportFileSystemState/18101864e2d12cf1ba7fe6bad810b1b2/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-13 23:00:20,810 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-13 23:00:20,811 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1694646004567.8d76cbc2cd73433d3550dee05d361e4b. 2023-09-13 23:00:20,811 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-13 23:00:20,811 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 8d76cbc2cd73433d3550dee05d361e4b: 2023-09-13 23:00:20,812 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1694646004567.18101864e2d12cf1ba7fe6bad810b1b2. 2023-09-13 23:00:20,812 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 18101864e2d12cf1ba7fe6bad810b1b2: 2023-09-13 23:00:20,814 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 8d76cbc2cd73433d3550dee05d361e4b 2023-09-13 23:00:20,815 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=8d76cbc2cd73433d3550dee05d361e4b, regionState=CLOSED 2023-09-13 23:00:20,815 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 18101864e2d12cf1ba7fe6bad810b1b2 2023-09-13 23:00:20,815 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1694646004567.8d76cbc2cd73433d3550dee05d361e4b.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1694646020815"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694646020815"}]},"ts":"1694646020815"} 2023-09-13 23:00:20,816 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=18101864e2d12cf1ba7fe6bad810b1b2, regionState=CLOSED 2023-09-13 23:00:20,816 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1694646004567.18101864e2d12cf1ba7fe6bad810b1b2.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1694646020816"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694646020816"}]},"ts":"1694646020816"} 2023-09-13 23:00:20,820 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=39, resume processing ppid=37 2023-09-13 23:00:20,821 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=39, ppid=37, state=SUCCESS; CloseRegionProcedure 8d76cbc2cd73433d3550dee05d361e4b, server=jenkins-hbase4.apache.org,42165,1694645979926 in 171 msec 2023-09-13 23:00:20,821 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=40, resume processing ppid=38 2023-09-13 23:00:20,821 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=40, ppid=38, state=SUCCESS; CloseRegionProcedure 18101864e2d12cf1ba7fe6bad810b1b2, server=jenkins-hbase4.apache.org,39163,1694645979837 in 171 msec 2023-09-13 23:00:20,822 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=37, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=8d76cbc2cd73433d3550dee05d361e4b, UNASSIGN in 179 msec 2023-09-13 23:00:20,823 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=38, resume processing ppid=36 2023-09-13 23:00:20,823 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=38, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=18101864e2d12cf1ba7fe6bad810b1b2, UNASSIGN in 179 msec 2023-09-13 23:00:20,824 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694646020824"}]},"ts":"1694646020824"} 2023-09-13 23:00:20,825 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLED in hbase:meta 2023-09-13 23:00:20,827 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemState to state=DISABLED 2023-09-13 23:00:20,829 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=36, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemState in 195 msec 2023-09-13 23:00:20,940 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-09-13 23:00:20,940 INFO [Listener at jenkins-hbase4.apache.org/37017] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemState, procId: 36 completed 2023-09-13 23:00:20,941 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemState 2023-09-13 23:00:20,942 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] procedure2.ProcedureExecutor(1028): Stored pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-13 23:00:20,944 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-13 23:00:20,945 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemState 2023-09-13 23:00:20,945 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=41, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-13 23:00:20,947 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39163] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemState 2023-09-13 23:00:20,950 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.tmp/data/default/testtb-testExportFileSystemState/8d76cbc2cd73433d3550dee05d361e4b 2023-09-13 23:00:20,950 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.tmp/data/default/testtb-testExportFileSystemState/18101864e2d12cf1ba7fe6bad810b1b2 2023-09-13 23:00:20,951 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:34119-0x100a784b9ba0002, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-13 23:00:20,951 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:39163-0x100a784b9ba0001, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-13 23:00:20,951 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:42165-0x100a784b9ba0003, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-13 23:00:20,951 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-13 23:00:20,951 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-09-13 23:00:20,951 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-09-13 23:00:20,951 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-09-13 23:00:20,951 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-09-13 23:00:20,952 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:39163-0x100a784b9ba0001, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-13 23:00:20,952 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:39163-0x100a784b9ba0001, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-13 23:00:20,952 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:42165-0x100a784b9ba0003, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-13 23:00:20,952 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-13 23:00:20,952 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:34119-0x100a784b9ba0002, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-13 23:00:20,953 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:34119-0x100a784b9ba0002, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-13 23:00:20,952 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:42165-0x100a784b9ba0003, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-13 23:00:20,952 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-13 23:00:20,953 DEBUG [HFileArchiver-9] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.tmp/data/default/testtb-testExportFileSystemState/8d76cbc2cd73433d3550dee05d361e4b/cf, FileablePath, hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.tmp/data/default/testtb-testExportFileSystemState/8d76cbc2cd73433d3550dee05d361e4b/recovered.edits] 2023-09-13 23:00:20,953 DEBUG [HFileArchiver-10] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.tmp/data/default/testtb-testExportFileSystemState/18101864e2d12cf1ba7fe6bad810b1b2/cf, FileablePath, hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.tmp/data/default/testtb-testExportFileSystemState/18101864e2d12cf1ba7fe6bad810b1b2/recovered.edits] 2023-09-13 23:00:20,953 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-09-13 23:00:20,958 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.tmp/data/default/testtb-testExportFileSystemState/8d76cbc2cd73433d3550dee05d361e4b/cf/91ab5618a80f468cb904145c17fad4cc to hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/archive/data/default/testtb-testExportFileSystemState/8d76cbc2cd73433d3550dee05d361e4b/cf/91ab5618a80f468cb904145c17fad4cc 2023-09-13 23:00:20,958 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.tmp/data/default/testtb-testExportFileSystemState/18101864e2d12cf1ba7fe6bad810b1b2/cf/0af1ea11b9c64b329ccad48dfc41f91d to hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/archive/data/default/testtb-testExportFileSystemState/18101864e2d12cf1ba7fe6bad810b1b2/cf/0af1ea11b9c64b329ccad48dfc41f91d 2023-09-13 23:00:20,961 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.tmp/data/default/testtb-testExportFileSystemState/8d76cbc2cd73433d3550dee05d361e4b/recovered.edits/9.seqid to hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/archive/data/default/testtb-testExportFileSystemState/8d76cbc2cd73433d3550dee05d361e4b/recovered.edits/9.seqid 2023-09-13 23:00:20,962 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.tmp/data/default/testtb-testExportFileSystemState/18101864e2d12cf1ba7fe6bad810b1b2/recovered.edits/9.seqid to hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/archive/data/default/testtb-testExportFileSystemState/18101864e2d12cf1ba7fe6bad810b1b2/recovered.edits/9.seqid 2023-09-13 23:00:20,962 DEBUG [HFileArchiver-9] backup.HFileArchiver(596): Deleted hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.tmp/data/default/testtb-testExportFileSystemState/8d76cbc2cd73433d3550dee05d361e4b 2023-09-13 23:00:20,962 DEBUG [HFileArchiver-10] backup.HFileArchiver(596): Deleted hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.tmp/data/default/testtb-testExportFileSystemState/18101864e2d12cf1ba7fe6bad810b1b2 2023-09-13 23:00:20,962 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-09-13 23:00:20,963 DEBUG [PEWorker-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-09-13 23:00:20,964 DEBUG [PEWorker-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf] 2023-09-13 23:00:20,968 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230913e3c6e2cc3dfd49a4840924a18d7845d2 to hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230913e3c6e2cc3dfd49a4840924a18d7845d2 2023-09-13 23:00:20,969 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e202309133bf48d5739934abbbdc655828ff66486 to hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e202309133bf48d5739934abbbdc655828ff66486 2023-09-13 23:00:20,970 DEBUG [PEWorker-2] backup.HFileArchiver(596): Deleted hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-09-13 23:00:20,973 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=41, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-13 23:00:20,975 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemState from hbase:meta 2023-09-13 23:00:20,977 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemState' descriptor. 2023-09-13 23:00:20,979 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=41, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-13 23:00:20,979 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemState' from region states. 2023-09-13 23:00:20,979 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,,1694646004567.8d76cbc2cd73433d3550dee05d361e4b.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1694646020979"}]},"ts":"9223372036854775807"} 2023-09-13 23:00:20,979 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,1,1694646004567.18101864e2d12cf1ba7fe6bad810b1b2.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1694646020979"}]},"ts":"9223372036854775807"} 2023-09-13 23:00:20,981 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-13 23:00:20,981 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 8d76cbc2cd73433d3550dee05d361e4b, NAME => 'testtb-testExportFileSystemState,,1694646004567.8d76cbc2cd73433d3550dee05d361e4b.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 18101864e2d12cf1ba7fe6bad810b1b2, NAME => 'testtb-testExportFileSystemState,1,1694646004567.18101864e2d12cf1ba7fe6bad810b1b2.', STARTKEY => '1', ENDKEY => ''}] 2023-09-13 23:00:20,981 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemState' as deleted. 2023-09-13 23:00:20,981 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1694646020981"}]},"ts":"9223372036854775807"} 2023-09-13 23:00:20,983 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemState state from META 2023-09-13 23:00:20,985 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=41, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-13 23:00:20,987 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=41, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemState in 44 msec 2023-09-13 23:00:21,055 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-09-13 23:00:21,055 INFO [Listener at jenkins-hbase4.apache.org/37017] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemState, procId: 41 completed 2023-09-13 23:00:21,064 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemState" 2023-09-13 23:00:21,066 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemState 2023-09-13 23:00:21,067 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemState" 2023-09-13 23:00:21,070 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemState 2023-09-13 23:00:21,096 INFO [Listener at jenkins-hbase4.apache.org/37017] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=759 (was 752) Potentially hanging thread: hconnection-0x73fd7489-shared-pool-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-527948888_17 at /127.0.0.1:47082 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1964 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: ApplicationMasterLauncher #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x73fd7489-shared-pool-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-527948888_17 at /127.0.0.1:58188 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1506713691) connection to jenkins-hbase4.apache.org/172.31.14.131:37481 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_243718858_1 at /127.0.0.1:45078 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x73fd7489-shared-pool-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x73fd7489-shared-pool-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-527948888_17 at /127.0.0.1:45100 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=931 (was 922) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=250 (was 179) - SystemLoadAverage LEAK? -, ProcessCount=168 (was 171), AvailableMemoryMB=8739 (was 8908) 2023-09-13 23:00:21,097 WARN [Listener at jenkins-hbase4.apache.org/37017] hbase.ResourceChecker(130): Thread=759 is superior to 500 2023-09-13 23:00:21,119 INFO [Listener at jenkins-hbase4.apache.org/37017] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=759, OpenFileDescriptor=931, MaxFileDescriptor=60000, SystemLoadAverage=250, ProcessCount=168, AvailableMemoryMB=8739 2023-09-13 23:00:21,120 WARN [Listener at jenkins-hbase4.apache.org/37017] hbase.ResourceChecker(130): Thread=759 is superior to 500 2023-09-13 23:00:21,122 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-13 23:00:21,124 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] procedure2.ProcedureExecutor(1028): Stored pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testConsecutiveExports 2023-09-13 23:00:21,127 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_PRE_OPERATION 2023-09-13 23:00:21,127 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testConsecutiveExports" procId is: 42 2023-09-13 23:00:21,128 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-13 23:00:21,128 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-09-13 23:00:21,130 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.tmp/data/default/testtb-testConsecutiveExports/dc0500944d9611b80a55560d8e528e94 2023-09-13 23:00:21,130 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.tmp/data/default/testtb-testConsecutiveExports/077f739ebd1276f66ec48a98c3db64df 2023-09-13 23:00:21,131 DEBUG [HFileArchiver-12] backup.HFileArchiver(153): Directory hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.tmp/data/default/testtb-testConsecutiveExports/077f739ebd1276f66ec48a98c3db64df empty. 2023-09-13 23:00:21,131 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.tmp/data/default/testtb-testConsecutiveExports/dc0500944d9611b80a55560d8e528e94 empty. 2023-09-13 23:00:21,132 DEBUG [HFileArchiver-12] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.tmp/data/default/testtb-testConsecutiveExports/077f739ebd1276f66ec48a98c3db64df 2023-09-13 23:00:21,132 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.tmp/data/default/testtb-testConsecutiveExports/dc0500944d9611b80a55560d8e528e94 2023-09-13 23:00:21,132 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-09-13 23:00:21,146 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.tmp/data/default/testtb-testConsecutiveExports/.tabledesc/.tableinfo.0000000001 2023-09-13 23:00:21,148 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(7675): creating {ENCODED => dc0500944d9611b80a55560d8e528e94, NAME => 'testtb-testConsecutiveExports,,1694646021121.dc0500944d9611b80a55560d8e528e94.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.tmp 2023-09-13 23:00:21,148 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(7675): creating {ENCODED => 077f739ebd1276f66ec48a98c3db64df, NAME => 'testtb-testConsecutiveExports,1,1694646021121.077f739ebd1276f66ec48a98c3db64df.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.tmp 2023-09-13 23:00:21,165 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1694646021121.dc0500944d9611b80a55560d8e528e94.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-13 23:00:21,165 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1604): Closing dc0500944d9611b80a55560d8e528e94, disabling compactions & flushes 2023-09-13 23:00:21,165 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1694646021121.dc0500944d9611b80a55560d8e528e94. 2023-09-13 23:00:21,165 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1694646021121.dc0500944d9611b80a55560d8e528e94. 2023-09-13 23:00:21,165 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1694646021121.dc0500944d9611b80a55560d8e528e94. after waiting 0 ms 2023-09-13 23:00:21,165 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1694646021121.dc0500944d9611b80a55560d8e528e94. 2023-09-13 23:00:21,165 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1694646021121.dc0500944d9611b80a55560d8e528e94. 2023-09-13 23:00:21,165 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1558): Region close journal for dc0500944d9611b80a55560d8e528e94: 2023-09-13 23:00:21,167 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1694646021121.077f739ebd1276f66ec48a98c3db64df.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-13 23:00:21,168 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1604): Closing 077f739ebd1276f66ec48a98c3db64df, disabling compactions & flushes 2023-09-13 23:00:21,168 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1694646021121.077f739ebd1276f66ec48a98c3db64df. 2023-09-13 23:00:21,168 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1694646021121.077f739ebd1276f66ec48a98c3db64df. 2023-09-13 23:00:21,168 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1694646021121.077f739ebd1276f66ec48a98c3db64df. after waiting 0 ms 2023-09-13 23:00:21,168 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1694646021121.077f739ebd1276f66ec48a98c3db64df. 2023-09-13 23:00:21,168 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1694646021121.077f739ebd1276f66ec48a98c3db64df. 2023-09-13 23:00:21,168 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1558): Region close journal for 077f739ebd1276f66ec48a98c3db64df: 2023-09-13 23:00:21,170 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ADD_TO_META 2023-09-13 23:00:21,172 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1694646021121.dc0500944d9611b80a55560d8e528e94.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1694646021171"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694646021171"}]},"ts":"1694646021171"} 2023-09-13 23:00:21,172 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1694646021121.077f739ebd1276f66ec48a98c3db64df.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1694646021171"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694646021171"}]},"ts":"1694646021171"} 2023-09-13 23:00:21,174 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-13 23:00:21,175 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-13 23:00:21,175 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694646021175"}]},"ts":"1694646021175"} 2023-09-13 23:00:21,177 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLING in hbase:meta 2023-09-13 23:00:21,181 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-13 23:00:21,182 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-13 23:00:21,182 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-13 23:00:21,182 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-13 23:00:21,182 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-13 23:00:21,182 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=dc0500944d9611b80a55560d8e528e94, ASSIGN}, {pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=077f739ebd1276f66ec48a98c3db64df, ASSIGN}] 2023-09-13 23:00:21,185 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=077f739ebd1276f66ec48a98c3db64df, ASSIGN 2023-09-13 23:00:21,185 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=dc0500944d9611b80a55560d8e528e94, ASSIGN 2023-09-13 23:00:21,186 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=077f739ebd1276f66ec48a98c3db64df, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34119,1694645979883; forceNewPlan=false, retain=false 2023-09-13 23:00:21,186 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=dc0500944d9611b80a55560d8e528e94, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42165,1694645979926; forceNewPlan=false, retain=false 2023-09-13 23:00:21,229 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-09-13 23:00:21,336 INFO [jenkins-hbase4:36621] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-13 23:00:21,339 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=dc0500944d9611b80a55560d8e528e94, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 23:00:21,339 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=077f739ebd1276f66ec48a98c3db64df, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34119,1694645979883 2023-09-13 23:00:21,339 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1694646021121.dc0500944d9611b80a55560d8e528e94.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1694646021339"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694646021339"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694646021339"}]},"ts":"1694646021339"} 2023-09-13 23:00:21,339 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1694646021121.077f739ebd1276f66ec48a98c3db64df.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1694646021339"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694646021339"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694646021339"}]},"ts":"1694646021339"} 2023-09-13 23:00:21,341 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=45, ppid=43, state=RUNNABLE; OpenRegionProcedure dc0500944d9611b80a55560d8e528e94, server=jenkins-hbase4.apache.org,42165,1694645979926}] 2023-09-13 23:00:21,342 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=46, ppid=44, state=RUNNABLE; OpenRegionProcedure 077f739ebd1276f66ec48a98c3db64df, server=jenkins-hbase4.apache.org,34119,1694645979883}] 2023-09-13 23:00:21,430 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-09-13 23:00:21,495 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,34119,1694645979883 2023-09-13 23:00:21,496 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-13 23:00:21,496 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,,1694646021121.dc0500944d9611b80a55560d8e528e94. 2023-09-13 23:00:21,497 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => dc0500944d9611b80a55560d8e528e94, NAME => 'testtb-testConsecutiveExports,,1694646021121.dc0500944d9611b80a55560d8e528e94.', STARTKEY => '', ENDKEY => '1'} 2023-09-13 23:00:21,499 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,,1694646021121.dc0500944d9611b80a55560d8e528e94. service=AccessControlService 2023-09-13 23:00:21,499 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-13 23:00:21,499 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36808, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-13 23:00:21,499 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports dc0500944d9611b80a55560d8e528e94 2023-09-13 23:00:21,500 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1694646021121.dc0500944d9611b80a55560d8e528e94.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-13 23:00:21,500 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for dc0500944d9611b80a55560d8e528e94 2023-09-13 23:00:21,500 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for dc0500944d9611b80a55560d8e528e94 2023-09-13 23:00:21,502 INFO [StoreOpener-dc0500944d9611b80a55560d8e528e94-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region dc0500944d9611b80a55560d8e528e94 2023-09-13 23:00:21,504 DEBUG [StoreOpener-dc0500944d9611b80a55560d8e528e94-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/default/testtb-testConsecutiveExports/dc0500944d9611b80a55560d8e528e94/cf 2023-09-13 23:00:21,504 DEBUG [StoreOpener-dc0500944d9611b80a55560d8e528e94-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/default/testtb-testConsecutiveExports/dc0500944d9611b80a55560d8e528e94/cf 2023-09-13 23:00:21,504 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,1,1694646021121.077f739ebd1276f66ec48a98c3db64df. 2023-09-13 23:00:21,504 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 077f739ebd1276f66ec48a98c3db64df, NAME => 'testtb-testConsecutiveExports,1,1694646021121.077f739ebd1276f66ec48a98c3db64df.', STARTKEY => '1', ENDKEY => ''} 2023-09-13 23:00:21,504 INFO [StoreOpener-dc0500944d9611b80a55560d8e528e94-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region dc0500944d9611b80a55560d8e528e94 columnFamilyName cf 2023-09-13 23:00:21,504 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,1,1694646021121.077f739ebd1276f66ec48a98c3db64df. service=AccessControlService 2023-09-13 23:00:21,504 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-13 23:00:21,504 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports 077f739ebd1276f66ec48a98c3db64df 2023-09-13 23:00:21,505 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1694646021121.077f739ebd1276f66ec48a98c3db64df.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-13 23:00:21,505 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 077f739ebd1276f66ec48a98c3db64df 2023-09-13 23:00:21,505 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 077f739ebd1276f66ec48a98c3db64df 2023-09-13 23:00:21,505 INFO [StoreOpener-dc0500944d9611b80a55560d8e528e94-1] regionserver.HStore(310): Store=dc0500944d9611b80a55560d8e528e94/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-13 23:00:21,506 INFO [StoreOpener-077f739ebd1276f66ec48a98c3db64df-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 077f739ebd1276f66ec48a98c3db64df 2023-09-13 23:00:21,506 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/default/testtb-testConsecutiveExports/dc0500944d9611b80a55560d8e528e94 2023-09-13 23:00:21,507 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/default/testtb-testConsecutiveExports/dc0500944d9611b80a55560d8e528e94 2023-09-13 23:00:21,507 DEBUG [StoreOpener-077f739ebd1276f66ec48a98c3db64df-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/default/testtb-testConsecutiveExports/077f739ebd1276f66ec48a98c3db64df/cf 2023-09-13 23:00:21,507 DEBUG [StoreOpener-077f739ebd1276f66ec48a98c3db64df-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/default/testtb-testConsecutiveExports/077f739ebd1276f66ec48a98c3db64df/cf 2023-09-13 23:00:21,507 INFO [StoreOpener-077f739ebd1276f66ec48a98c3db64df-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 077f739ebd1276f66ec48a98c3db64df columnFamilyName cf 2023-09-13 23:00:21,508 INFO [StoreOpener-077f739ebd1276f66ec48a98c3db64df-1] regionserver.HStore(310): Store=077f739ebd1276f66ec48a98c3db64df/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-13 23:00:21,509 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/default/testtb-testConsecutiveExports/077f739ebd1276f66ec48a98c3db64df 2023-09-13 23:00:21,510 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/default/testtb-testConsecutiveExports/077f739ebd1276f66ec48a98c3db64df 2023-09-13 23:00:21,510 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for dc0500944d9611b80a55560d8e528e94 2023-09-13 23:00:21,512 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/default/testtb-testConsecutiveExports/dc0500944d9611b80a55560d8e528e94/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-13 23:00:21,512 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened dc0500944d9611b80a55560d8e528e94; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64470414, jitterRate=-0.03931596875190735}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-13 23:00:21,512 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for dc0500944d9611b80a55560d8e528e94: 2023-09-13 23:00:21,512 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 077f739ebd1276f66ec48a98c3db64df 2023-09-13 23:00:21,513 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,,1694646021121.dc0500944d9611b80a55560d8e528e94., pid=45, masterSystemTime=1694646021492 2023-09-13 23:00:21,515 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/default/testtb-testConsecutiveExports/077f739ebd1276f66ec48a98c3db64df/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-13 23:00:21,516 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,,1694646021121.dc0500944d9611b80a55560d8e528e94. 2023-09-13 23:00:21,516 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,,1694646021121.dc0500944d9611b80a55560d8e528e94. 2023-09-13 23:00:21,516 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 077f739ebd1276f66ec48a98c3db64df; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73852464, jitterRate=0.10048747062683105}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-13 23:00:21,516 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 077f739ebd1276f66ec48a98c3db64df: 2023-09-13 23:00:21,516 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=dc0500944d9611b80a55560d8e528e94, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 23:00:21,517 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,,1694646021121.dc0500944d9611b80a55560d8e528e94.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1694646021516"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1694646021516"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1694646021516"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1694646021516"}]},"ts":"1694646021516"} 2023-09-13 23:00:21,517 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,1,1694646021121.077f739ebd1276f66ec48a98c3db64df., pid=46, masterSystemTime=1694646021495 2023-09-13 23:00:21,520 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,1,1694646021121.077f739ebd1276f66ec48a98c3db64df. 2023-09-13 23:00:21,521 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,1,1694646021121.077f739ebd1276f66ec48a98c3db64df. 2023-09-13 23:00:21,522 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=077f739ebd1276f66ec48a98c3db64df, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34119,1694645979883 2023-09-13 23:00:21,522 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,1,1694646021121.077f739ebd1276f66ec48a98c3db64df.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1694646021522"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1694646021522"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1694646021522"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1694646021522"}]},"ts":"1694646021522"} 2023-09-13 23:00:21,523 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=45, resume processing ppid=43 2023-09-13 23:00:21,523 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=45, ppid=43, state=SUCCESS; OpenRegionProcedure dc0500944d9611b80a55560d8e528e94, server=jenkins-hbase4.apache.org,42165,1694645979926 in 180 msec 2023-09-13 23:00:21,525 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=43, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=dc0500944d9611b80a55560d8e528e94, ASSIGN in 341 msec 2023-09-13 23:00:21,526 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=46, resume processing ppid=44 2023-09-13 23:00:21,526 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=46, ppid=44, state=SUCCESS; OpenRegionProcedure 077f739ebd1276f66ec48a98c3db64df, server=jenkins-hbase4.apache.org,34119,1694645979883 in 182 msec 2023-09-13 23:00:21,528 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=44, resume processing ppid=42 2023-09-13 23:00:21,528 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=44, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=077f739ebd1276f66ec48a98c3db64df, ASSIGN in 344 msec 2023-09-13 23:00:21,529 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-13 23:00:21,529 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694646021529"}]},"ts":"1694646021529"} 2023-09-13 23:00:21,530 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLED in hbase:meta 2023-09-13 23:00:21,533 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_POST_OPERATION 2023-09-13 23:00:21,533 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testConsecutiveExports jenkins: RWXCA 2023-09-13 23:00:21,535 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39163] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-09-13 23:00:21,536 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:39163-0x100a784b9ba0001, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-13 23:00:21,536 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:34119-0x100a784b9ba0002, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-13 23:00:21,536 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:42165-0x100a784b9ba0003, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-13 23:00:21,536 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-13 23:00:21,538 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-09-13 23:00:21,538 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-09-13 23:00:21,538 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-09-13 23:00:21,538 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-09-13 23:00:21,540 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=42, state=SUCCESS; CreateTableProcedure table=testtb-testConsecutiveExports in 416 msec 2023-09-13 23:00:21,732 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-09-13 23:00:21,732 INFO [Listener at jenkins-hbase4.apache.org/37017] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testConsecutiveExports, procId: 42 completed 2023-09-13 23:00:21,734 DEBUG [Listener at jenkins-hbase4.apache.org/37017] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-09-13 23:00:21,735 DEBUG [Listener at jenkins-hbase4.apache.org/37017] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1694646021121.dc0500944d9611b80a55560d8e528e94. 2023-09-13 23:00:21,736 INFO [Listener at jenkins-hbase4.apache.org/37017] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-13 23:00:21,746 DEBUG [hconnection-0x342dd8d7-shared-pool-17] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-13 23:00:21,751 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36814, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-13 23:00:21,755 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-13 23:00:21,755 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1694646021755 (current time:1694646021755). 2023-09-13 23:00:21,755 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-13 23:00:21,756 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] zookeeper.ReadOnlyZKClient(139): Connect 0x34ab21ad to 127.0.0.1:55012 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-13 23:00:21,765 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1d9c1916, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-13 23:00:21,766 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-13 23:00:21,768 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53892, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-13 23:00:21,770 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x34ab21ad to 127.0.0.1:55012 2023-09-13 23:00:21,770 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-13 23:00:21,771 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] zookeeper.ReadOnlyZKClient(139): Connect 0x096cfec6 to 127.0.0.1:55012 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-13 23:00:21,776 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@64a7100f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-13 23:00:21,779 DEBUG [hconnection-0x198ee124-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-13 23:00:21,781 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53894, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-13 23:00:21,785 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-13 23:00:21,787 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36216, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-13 23:00:21,788 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x096cfec6 to 127.0.0.1:55012 2023-09-13 23:00:21,788 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-13 23:00:21,788 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-09-13 23:00:21,789 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-13 23:00:21,789 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-13 23:00:21,791 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] procedure2.ProcedureExecutor(1028): Stored pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-13 23:00:21,792 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-13 23:00:21,793 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=47, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1694646621793 2023-09-13 23:00:21,793 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-09-13 23:00:21,793 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-13 23:00:21,794 DEBUG [Listener at jenkins-hbase4.apache.org/37017] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-13 23:00:21,794 DEBUG [Listener at jenkins-hbase4.apache.org/37017] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-13 23:00:21,797 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=47, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-13 23:00:21,797 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-13 23:00:21,798 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=47, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 7 msec 2023-09-13 23:00:21,799 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-13 23:00:21,799 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1694646621799 2023-09-13 23:00:21,810 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testConsecutiveExports 2023-09-13 23:00:21,810 INFO [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testConsecutiveExports' 2023-09-13 23:00:21,810 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-13 23:00:21,811 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' 2023-09-13 23:00:21,811 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-09-13 23:00:21,811 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-13 23:00:21,811 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-13 23:00:21,818 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:34119-0x100a784b9ba0002, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 23:00:21,818 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:42165-0x100a784b9ba0003, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 23:00:21,818 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 23:00:21,818 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 23:00:21,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 23:00:21,818 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:39163-0x100a784b9ba0001, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 23:00:21,818 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34119,1694645979883 2023-09-13 23:00:21,818 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 23:00:21,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 23:00:21,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 23:00:21,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-13 23:00:21,818 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34119,1694645979883 2023-09-13 23:00:21,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-13 23:00:21,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-13 23:00:21,818 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 23:00:21,818 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42165-0x100a784b9ba0003, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-13 23:00:21,819 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34119-0x100a784b9ba0002, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-13 23:00:21,819 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39163-0x100a784b9ba0001, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-13 23:00:21,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-09-13 23:00:21,819 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 23:00:21,819 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-13 23:00:21,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-13 23:00:21,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-09-13 23:00:21,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-13 23:00:21,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-09-13 23:00:21,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-13 23:00:21,819 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-13 23:00:21,819 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-13 23:00:21,819 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-13 23:00:21,819 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-09-13 23:00:21,820 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-09-13 23:00:21,820 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-09-13 23:00:21,820 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1694645979883' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-13 23:00:21,820 DEBUG [member: 'jenkins-hbase4.apache.org,39163,1694645979837' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-13 23:00:21,820 DEBUG [member: 'jenkins-hbase4.apache.org,39163,1694645979837' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-13 23:00:21,820 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-13 23:00:21,821 DEBUG [member: 'jenkins-hbase4.apache.org,39163,1694645979837' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-13 23:00:21,821 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-13 23:00:21,821 DEBUG [member: 'jenkins-hbase4.apache.org,39163,1694645979837' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-09-13 23:00:21,821 DEBUG [member: 'jenkins-hbase4.apache.org,39163,1694645979837' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39163,1694645979837' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-09-13 23:00:21,820 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1694645979883' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-13 23:00:21,822 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-13 23:00:21,824 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-09-13 23:00:21,824 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1694645979883' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-13 23:00:21,825 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1694645979883' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-09-13 23:00:21,825 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42165,1694645979926' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-09-13 23:00:21,825 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1694645979883' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34119,1694645979883' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-09-13 23:00:21,826 DEBUG [member: 'jenkins-hbase4.apache.org,39163,1694645979837' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-13 23:00:21,827 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 23:00:21,827 DEBUG [member: 'jenkins-hbase4.apache.org,39163,1694645979837' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39163-0x100a784b9ba0001, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-13 23:00:21,827 DEBUG [member: 'jenkins-hbase4.apache.org,39163,1694645979837' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-13 23:00:21,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 23:00:21,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-13 23:00:21,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-13 23:00:21,827 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-13 23:00:21,827 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34119,1694645979883 2023-09-13 23:00:21,828 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1694645979883' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-13 23:00:21,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-13 23:00:21,828 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42165-0x100a784b9ba0003, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-13 23:00:21,828 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-13 23:00:21,828 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1694645979883' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34119-0x100a784b9ba0002, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-13 23:00:21,828 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1694645979883' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-13 23:00:21,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-13 23:00:21,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-13 23:00:21,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34119,1694645979883 2023-09-13 23:00:21,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 23:00:21,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 23:00:21,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-13 23:00:21,829 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42165,1694645979926' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-09-13 23:00:21,829 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5159069a[Count = 1] remaining members to acquire global barrier 2023-09-13 23:00:21,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34119,1694645979883 2023-09-13 23:00:21,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-13 23:00:21,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-13 23:00:21,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-13 23:00:21,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-13 23:00:21,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-13 23:00:21,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34119,1694645979883 2023-09-13 23:00:21,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 23:00:21,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 23:00:21,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-13 23:00:21,831 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34119,1694645979883' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-09-13 23:00:21,831 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5159069a[Count = 0] remaining members to acquire global barrier 2023-09-13 23:00:21,831 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-09-13 23:00:21,831 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-13 23:00:21,837 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:34119-0x100a784b9ba0002, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-13 23:00:21,837 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:42165-0x100a784b9ba0003, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-13 23:00:21,837 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:39163-0x100a784b9ba0001, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-13 23:00:21,837 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-13 23:00:21,837 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-13 23:00:21,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-13 23:00:21,837 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 23:00:21,837 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-13 23:00:21,837 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-13 23:00:21,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-13 23:00:21,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-13 23:00:21,837 DEBUG [member: 'jenkins-hbase4.apache.org,39163,1694645979837' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-13 23:00:21,837 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1694645979883' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-13 23:00:21,837 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34119,1694645979883 2023-09-13 23:00:21,837 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-13 23:00:21,837 DEBUG [member: 'jenkins-hbase4.apache.org,39163,1694645979837' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-09-13 23:00:21,837 DEBUG [member: 'jenkins-hbase4.apache.org,39163,1694645979837' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,39163,1694645979837' in zk 2023-09-13 23:00:21,837 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-13 23:00:21,837 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-13 23:00:21,837 DEBUG [rs(jenkins-hbase4.apache.org,34119,1694645979883)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1694646021121.077f739ebd1276f66ec48a98c3db64df. 2023-09-13 23:00:21,837 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1694645979883' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-13 23:00:21,838 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1694645979883' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-13 23:00:21,837 DEBUG [rs(jenkins-hbase4.apache.org,42165,1694645979926)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1694646021121.dc0500944d9611b80a55560d8e528e94. 2023-09-13 23:00:21,838 DEBUG [rs(jenkins-hbase4.apache.org,34119,1694645979883)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1694646021121.077f739ebd1276f66ec48a98c3db64df. started... 2023-09-13 23:00:21,838 DEBUG [rs(jenkins-hbase4.apache.org,42165,1694645979926)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1694646021121.dc0500944d9611b80a55560d8e528e94. started... 2023-09-13 23:00:21,839 DEBUG [rs(jenkins-hbase4.apache.org,34119,1694645979883)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 077f739ebd1276f66ec48a98c3db64df: 2023-09-13 23:00:21,839 DEBUG [rs(jenkins-hbase4.apache.org,42165,1694645979926)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for dc0500944d9611b80a55560d8e528e94: 2023-09-13 23:00:21,839 DEBUG [rs(jenkins-hbase4.apache.org,34119,1694645979883)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1694646021121.077f739ebd1276f66ec48a98c3db64df.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-09-13 23:00:21,839 DEBUG [rs(jenkins-hbase4.apache.org,42165,1694645979926)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1694646021121.dc0500944d9611b80a55560d8e528e94.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-09-13 23:00:21,840 DEBUG [rs(jenkins-hbase4.apache.org,34119,1694645979883)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-13 23:00:21,840 DEBUG [rs(jenkins-hbase4.apache.org,42165,1694645979926)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-13 23:00:21,840 DEBUG [rs(jenkins-hbase4.apache.org,34119,1694645979883)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-13 23:00:21,840 DEBUG [rs(jenkins-hbase4.apache.org,42165,1694645979926)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-13 23:00:21,845 DEBUG [member: 'jenkins-hbase4.apache.org,39163,1694645979837' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-09-13 23:00:21,845 DEBUG [member: 'jenkins-hbase4.apache.org,39163,1694645979837' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-13 23:00:21,845 DEBUG [member: 'jenkins-hbase4.apache.org,39163,1694645979837' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-09-13 23:00:21,854 DEBUG [rs(jenkins-hbase4.apache.org,42165,1694645979926)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1694646021121.dc0500944d9611b80a55560d8e528e94. completed. 2023-09-13 23:00:21,854 DEBUG [rs(jenkins-hbase4.apache.org,34119,1694645979883)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1694646021121.077f739ebd1276f66ec48a98c3db64df. completed. 2023-09-13 23:00:21,854 DEBUG [rs(jenkins-hbase4.apache.org,34119,1694645979883)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1694646021121.077f739ebd1276f66ec48a98c3db64df. 2023-09-13 23:00:21,854 DEBUG [rs(jenkins-hbase4.apache.org,42165,1694645979926)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1694646021121.dc0500944d9611b80a55560d8e528e94. 2023-09-13 23:00:21,854 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1694645979883' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-13 23:00:21,854 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1694645979883' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-13 23:00:21,854 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-13 23:00:21,854 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-13 23:00:21,854 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 23:00:21,854 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1694645979883' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34119,1694645979883 2023-09-13 23:00:21,854 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-09-13 23:00:21,855 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1694645979883' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-09-13 23:00:21,855 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,42165,1694645979926' in zk 2023-09-13 23:00:21,855 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1694645979883' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,34119,1694645979883' in zk 2023-09-13 23:00:21,856 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1694645979883' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-09-13 23:00:21,856 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 23:00:21,856 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1694645979883' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-13 23:00:21,856 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-09-13 23:00:21,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 23:00:21,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-13 23:00:21,856 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1694645979883' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-09-13 23:00:21,856 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34119,1694645979883 2023-09-13 23:00:21,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-13 23:00:21,858 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-13 23:00:21,858 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-09-13 23:00:21,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-13 23:00:21,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-13 23:00:21,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-13 23:00:21,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34119,1694645979883 2023-09-13 23:00:21,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 23:00:21,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 23:00:21,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-13 23:00:21,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-13 23:00:21,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34119,1694645979883 2023-09-13 23:00:21,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 23:00:21,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 23:00:21,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,42165,1694645979926': 2023-09-13 23:00:21,862 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42165,1694645979926' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-09-13 23:00:21,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34119,1694645979883 2023-09-13 23:00:21,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-13 23:00:21,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-13 23:00:21,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-13 23:00:21,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-13 23:00:21,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-13 23:00:21,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34119,1694645979883 2023-09-13 23:00:21,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 23:00:21,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 23:00:21,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-13 23:00:21,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-13 23:00:21,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34119,1694645979883 2023-09-13 23:00:21,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 23:00:21,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 23:00:21,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,34119,1694645979883': 2023-09-13 23:00:21,865 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34119,1694645979883' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-09-13 23:00:21,865 INFO [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testConsecutiveExports' execution completed 2023-09-13 23:00:21,865 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-13 23:00:21,865 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-13 23:00:21,865 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testConsecutiveExports 2023-09-13 23:00:21,865 INFO [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-13 23:00:21,867 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:39163-0x100a784b9ba0001, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-13 23:00:21,867 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:42165-0x100a784b9ba0003, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-13 23:00:21,867 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-13 23:00:21,867 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-13 23:00:21,867 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:42165-0x100a784b9ba0003, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 23:00:21,867 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:34119-0x100a784b9ba0002, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-13 23:00:21,867 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:39163-0x100a784b9ba0001, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 23:00:21,867 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-13 23:00:21,868 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-13 23:00:21,868 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:34119-0x100a784b9ba0002, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 23:00:21,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-13 23:00:21,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-13 23:00:21,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-13 23:00:21,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-13 23:00:21,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-13 23:00:21,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-13 23:00:21,868 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34119,1694645979883 2023-09-13 23:00:21,868 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 23:00:21,868 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 23:00:21,868 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 23:00:21,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 23:00:21,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-13 23:00:21,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 23:00:21,869 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 23:00:21,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 23:00:21,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-13 23:00:21,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-13 23:00:21,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-13 23:00:21,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-13 23:00:21,869 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 23:00:21,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-13 23:00:21,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-13 23:00:21,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34119,1694645979883 2023-09-13 23:00:21,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 23:00:21,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 23:00:21,872 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34119,1694645979883 2023-09-13 23:00:21,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-13 23:00:21,873 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 23:00:21,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-13 23:00:21,873 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 23:00:21,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34119,1694645979883 2023-09-13 23:00:21,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 23:00:21,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 23:00:21,876 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 23:00:21,876 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-13 23:00:21,876 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 23:00:21,876 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34119,1694645979883 2023-09-13 23:00:21,876 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:39163-0x100a784b9ba0001, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 23:00:21,876 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-13 23:00:21,876 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 23:00:21,876 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:42165-0x100a784b9ba0003, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 23:00:21,876 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:34119-0x100a784b9ba0002, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 23:00:21,876 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-13 23:00:21,876 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:34119-0x100a784b9ba0002, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 23:00:21,876 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 23:00:21,876 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 23:00:21,876 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testConsecutiveExports 2023-09-13 23:00:21,876 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 23:00:21,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 23:00:21,876 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:42165-0x100a784b9ba0003, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 23:00:21,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 23:00:21,876 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:39163-0x100a784b9ba0001, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 23:00:21,878 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-09-13 23:00:21,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 23:00:21,878 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-13 23:00:21,878 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-09-13 23:00:21,878 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 23:00:21,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 23:00:21,878 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-13 23:00:21,878 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 23:00:21,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 23:00:21,878 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 23:00:21,878 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 23:00:21,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 23:00:21,878 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34119,1694645979883 2023-09-13 23:00:21,879 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-13 23:00:21,879 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-13 23:00:21,879 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-13 23:00:21,886 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testConsecutiveExports 2023-09-13 23:00:21,887 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-09-13 23:00:21,894 DEBUG [Listener at jenkins-hbase4.apache.org/37017] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-13 23:00:21,895 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-09-13 23:00:21,895 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-09-13 23:00:21,895 DEBUG [Listener at jenkins-hbase4.apache.org/37017] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-13 23:00:21,907 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports to hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.hbase-snapshot/emptySnaptb0-testConsecutiveExports 2023-09-13 23:00:21,908 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-09-13 23:00:21,908 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-09-13 23:00:21,908 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-09-13 23:00:21,908 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1694646021793Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1694646021886 (+93 ms)Consolidate snapshot: emptySnaptb0-testConsecutiveExports at 1694646021886Loading Region manifests for emptySnaptb0-testConsecutiveExports at 1694646021886Writing data manifest for emptySnaptb0-testConsecutiveExports at 1694646021890 (+4 ms)Verifying snapshot: emptySnaptb0-testConsecutiveExports at 1694646021901 (+11 ms)Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1694646021908 (+7 ms) 2023-09-13 23:00:21,911 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-13 23:00:21,913 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 118 msec 2023-09-13 23:00:22,096 DEBUG [Listener at jenkins-hbase4.apache.org/37017] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-13 23:00:22,096 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-09-13 23:00:22,097 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-13 23:00:22,099 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42165] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,,1694646021121.dc0500944d9611b80a55560d8e528e94. with WAL disabled. Data may be lost in the event of a crash. 2023-09-13 23:00:22,101 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34119] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,1,1694646021121.077f739ebd1276f66ec48a98c3db64df. with WAL disabled. Data may be lost in the event of a crash. 2023-09-13 23:00:22,105 DEBUG [Listener at jenkins-hbase4.apache.org/37017] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-09-13 23:00:22,105 DEBUG [Listener at jenkins-hbase4.apache.org/37017] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1694646021121.dc0500944d9611b80a55560d8e528e94. 2023-09-13 23:00:22,105 INFO [Listener at jenkins-hbase4.apache.org/37017] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-13 23:00:22,116 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-13 23:00:22,116 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1694646022116 (current time:1694646022116). 2023-09-13 23:00:22,117 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-13 23:00:22,118 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] zookeeper.ReadOnlyZKClient(139): Connect 0x1b4cca8a to 127.0.0.1:55012 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-13 23:00:22,129 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@62e4e92b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-13 23:00:22,131 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-13 23:00:22,133 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53902, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-13 23:00:22,134 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1b4cca8a to 127.0.0.1:55012 2023-09-13 23:00:22,134 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-13 23:00:22,135 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] zookeeper.ReadOnlyZKClient(139): Connect 0x465efeb2 to 127.0.0.1:55012 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-13 23:00:22,141 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3b3b6469, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-13 23:00:22,142 DEBUG [hconnection-0x7e536f94-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-13 23:00:22,143 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53912, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-13 23:00:22,146 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-13 23:00:22,147 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36222, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-13 23:00:22,148 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x465efeb2 to 127.0.0.1:55012 2023-09-13 23:00:22,148 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-13 23:00:22,148 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-09-13 23:00:22,149 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-13 23:00:22,149 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-13 23:00:22,152 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] procedure2.ProcedureExecutor(1028): Stored pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-13 23:00:22,153 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-13 23:00:22,153 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=49, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1694646622153 2023-09-13 23:00:22,153 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-13 23:00:22,154 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-09-13 23:00:22,155 DEBUG [Listener at jenkins-hbase4.apache.org/37017] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-13 23:00:22,155 DEBUG [Listener at jenkins-hbase4.apache.org/37017] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-13 23:00:22,156 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=49, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-13 23:00:22,156 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-13 23:00:22,157 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=49, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 5 msec 2023-09-13 23:00:22,158 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-13 23:00:22,158 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=50, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1694646622158 2023-09-13 23:00:22,168 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testConsecutiveExports 2023-09-13 23:00:22,168 INFO [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testConsecutiveExports' 2023-09-13 23:00:22,168 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-13 23:00:22,169 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testConsecutiveExports' starting 'acquire' 2023-09-13 23:00:22,169 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-09-13 23:00:22,170 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-13 23:00:22,170 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-13 23:00:22,171 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:34119-0x100a784b9ba0002, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 23:00:22,172 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34119,1694645979883 2023-09-13 23:00:22,172 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 23:00:22,172 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:39163-0x100a784b9ba0001, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 23:00:22,171 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:42165-0x100a784b9ba0003, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 23:00:22,172 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 23:00:22,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 23:00:22,172 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 23:00:22,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 23:00:22,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 23:00:22,172 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34119,1694645979883 2023-09-13 23:00:22,172 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 23:00:22,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-13 23:00:22,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-13 23:00:22,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-13 23:00:22,173 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 23:00:22,173 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-13 23:00:22,173 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42165-0x100a784b9ba0003, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-13 23:00:22,173 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39163-0x100a784b9ba0001, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-13 23:00:22,173 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34119-0x100a784b9ba0002, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-13 23:00:22,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-09-13 23:00:22,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-13 23:00:22,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-09-13 23:00:22,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-13 23:00:22,173 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-13 23:00:22,173 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-13 23:00:22,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-09-13 23:00:22,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-13 23:00:22,173 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-09-13 23:00:22,174 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-13 23:00:22,173 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-09-13 23:00:22,174 DEBUG [member: 'jenkins-hbase4.apache.org,39163,1694645979837' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-13 23:00:22,174 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-13 23:00:22,174 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-09-13 23:00:22,174 DEBUG [member: 'jenkins-hbase4.apache.org,39163,1694645979837' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-13 23:00:22,174 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1694645979883' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-13 23:00:22,175 DEBUG [member: 'jenkins-hbase4.apache.org,39163,1694645979837' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-13 23:00:22,175 DEBUG [member: 'jenkins-hbase4.apache.org,39163,1694645979837' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-09-13 23:00:22,175 DEBUG [member: 'jenkins-hbase4.apache.org,39163,1694645979837' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39163,1694645979837' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-09-13 23:00:22,174 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-13 23:00:22,175 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1694645979883' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-13 23:00:22,177 DEBUG [member: 'jenkins-hbase4.apache.org,39163,1694645979837' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-13 23:00:22,177 DEBUG [member: 'jenkins-hbase4.apache.org,39163,1694645979837' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39163-0x100a784b9ba0001, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-13 23:00:22,177 DEBUG [member: 'jenkins-hbase4.apache.org,39163,1694645979837' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-13 23:00:22,181 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-13 23:00:22,181 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-09-13 23:00:22,181 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1694645979883' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-13 23:00:22,181 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1694645979883' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-09-13 23:00:22,181 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42165,1694645979926' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-09-13 23:00:22,181 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1694645979883' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34119,1694645979883' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-09-13 23:00:22,183 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 23:00:22,183 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-13 23:00:22,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 23:00:22,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-13 23:00:22,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-13 23:00:22,183 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34119,1694645979883 2023-09-13 23:00:22,184 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1694645979883' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-13 23:00:22,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-13 23:00:22,184 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42165-0x100a784b9ba0003, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-13 23:00:22,184 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-13 23:00:22,184 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1694645979883' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34119-0x100a784b9ba0002, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-13 23:00:22,184 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1694645979883' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-13 23:00:22,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-13 23:00:22,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-13 23:00:22,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34119,1694645979883 2023-09-13 23:00:22,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 23:00:22,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 23:00:22,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-13 23:00:22,185 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42165,1694645979926' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-09-13 23:00:22,186 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@27fbd44b[Count = 1] remaining members to acquire global barrier 2023-09-13 23:00:22,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34119,1694645979883 2023-09-13 23:00:22,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-13 23:00:22,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-13 23:00:22,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-13 23:00:22,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-13 23:00:22,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-13 23:00:22,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34119,1694645979883 2023-09-13 23:00:22,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 23:00:22,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 23:00:22,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-13 23:00:22,187 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34119,1694645979883' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-09-13 23:00:22,187 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@27fbd44b[Count = 0] remaining members to acquire global barrier 2023-09-13 23:00:22,187 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-09-13 23:00:22,188 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-13 23:00:22,191 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:42165-0x100a784b9ba0003, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-13 23:00:22,191 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:39163-0x100a784b9ba0001, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-13 23:00:22,191 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-13 23:00:22,191 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:34119-0x100a784b9ba0002, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-13 23:00:22,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-13 23:00:22,191 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 23:00:22,191 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-13 23:00:22,191 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-13 23:00:22,191 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-13 23:00:22,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-13 23:00:22,191 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-13 23:00:22,191 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-13 23:00:22,191 DEBUG [rs(jenkins-hbase4.apache.org,42165,1694645979926)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1694646021121.dc0500944d9611b80a55560d8e528e94. 2023-09-13 23:00:22,192 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34119,1694645979883 2023-09-13 23:00:22,192 DEBUG [rs(jenkins-hbase4.apache.org,42165,1694645979926)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1694646021121.dc0500944d9611b80a55560d8e528e94. started... 2023-09-13 23:00:22,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-13 23:00:22,192 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-13 23:00:22,191 DEBUG [member: 'jenkins-hbase4.apache.org,39163,1694645979837' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-13 23:00:22,192 INFO [rs(jenkins-hbase4.apache.org,42165,1694645979926)-snapshot-pool-0] regionserver.HRegion(2745): Flushing dc0500944d9611b80a55560d8e528e94 1/1 column families, dataSize=132 B heapSize=544 B 2023-09-13 23:00:22,192 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1694645979883' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-13 23:00:22,192 DEBUG [member: 'jenkins-hbase4.apache.org,39163,1694645979837' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-09-13 23:00:22,192 DEBUG [member: 'jenkins-hbase4.apache.org,39163,1694645979837' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,39163,1694645979837' in zk 2023-09-13 23:00:22,192 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1694645979883' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-13 23:00:22,192 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1694645979883' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-13 23:00:22,192 DEBUG [rs(jenkins-hbase4.apache.org,34119,1694645979883)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1694646021121.077f739ebd1276f66ec48a98c3db64df. 2023-09-13 23:00:22,192 DEBUG [rs(jenkins-hbase4.apache.org,34119,1694645979883)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1694646021121.077f739ebd1276f66ec48a98c3db64df. started... 2023-09-13 23:00:22,192 INFO [rs(jenkins-hbase4.apache.org,34119,1694645979883)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 077f739ebd1276f66ec48a98c3db64df 1/1 column families, dataSize=3.13 KB heapSize=7 KB 2023-09-13 23:00:22,194 DEBUG [member: 'jenkins-hbase4.apache.org,39163,1694645979837' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-09-13 23:00:22,194 DEBUG [member: 'jenkins-hbase4.apache.org,39163,1694645979837' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-13 23:00:22,194 DEBUG [member: 'jenkins-hbase4.apache.org,39163,1694645979837' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-09-13 23:00:22,221 INFO [rs(jenkins-hbase4.apache.org,42165,1694645979926)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230913074a0f03495d458fb1ac1e3facb69c3d to hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230913074a0f03495d458fb1ac1e3facb69c3d 2023-09-13 23:00:22,221 INFO [rs(jenkins-hbase4.apache.org,34119,1694645979883)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230913515ea079c4c04f5698c5eef70c5aee5f to hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230913515ea079c4c04f5698c5eef70c5aee5f 2023-09-13 23:00:22,244 INFO [rs(jenkins-hbase4.apache.org,42165,1694645979926)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=132, hasBloomFilter=true, into tmp file hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/default/testtb-testConsecutiveExports/dc0500944d9611b80a55560d8e528e94/.tmp/cf/28366f3030004728af3d41f4d0505a4c 2023-09-13 23:00:22,245 INFO [rs(jenkins-hbase4.apache.org,34119,1694645979883)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/default/testtb-testConsecutiveExports/077f739ebd1276f66ec48a98c3db64df/.tmp/cf/6daad79f3180445aa9daf72bd4f63825 2023-09-13 23:00:22,250 DEBUG [rs(jenkins-hbase4.apache.org,42165,1694645979926)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/default/testtb-testConsecutiveExports/dc0500944d9611b80a55560d8e528e94/.tmp/cf/28366f3030004728af3d41f4d0505a4c as hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/default/testtb-testConsecutiveExports/dc0500944d9611b80a55560d8e528e94/cf/28366f3030004728af3d41f4d0505a4c 2023-09-13 23:00:22,250 DEBUG [rs(jenkins-hbase4.apache.org,34119,1694645979883)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/default/testtb-testConsecutiveExports/077f739ebd1276f66ec48a98c3db64df/.tmp/cf/6daad79f3180445aa9daf72bd4f63825 as hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/default/testtb-testConsecutiveExports/077f739ebd1276f66ec48a98c3db64df/cf/6daad79f3180445aa9daf72bd4f63825 2023-09-13 23:00:22,255 DEBUG [Listener at jenkins-hbase4.apache.org/37017] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-13 23:00:22,256 INFO [rs(jenkins-hbase4.apache.org,34119,1694645979883)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/default/testtb-testConsecutiveExports/077f739ebd1276f66ec48a98c3db64df/cf/6daad79f3180445aa9daf72bd4f63825, entries=48, sequenceid=6, filesize=12.9 K 2023-09-13 23:00:22,256 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-09-13 23:00:22,256 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-09-13 23:00:22,256 DEBUG [Listener at jenkins-hbase4.apache.org/37017] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-13 23:00:22,257 INFO [rs(jenkins-hbase4.apache.org,34119,1694645979883)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.13 KB/3204, heapSize ~6.98 KB/7152, currentSize=0 B/0 for 077f739ebd1276f66ec48a98c3db64df in 65ms, sequenceid=6, compaction requested=false 2023-09-13 23:00:22,257 INFO [rs(jenkins-hbase4.apache.org,42165,1694645979926)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/default/testtb-testConsecutiveExports/dc0500944d9611b80a55560d8e528e94/cf/28366f3030004728af3d41f4d0505a4c, entries=2, sequenceid=6, filesize=5.2 K 2023-09-13 23:00:22,257 DEBUG [rs(jenkins-hbase4.apache.org,34119,1694645979883)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-09-13 23:00:22,258 DEBUG [rs(jenkins-hbase4.apache.org,34119,1694645979883)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 077f739ebd1276f66ec48a98c3db64df: 2023-09-13 23:00:22,258 DEBUG [rs(jenkins-hbase4.apache.org,34119,1694645979883)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1694646021121.077f739ebd1276f66ec48a98c3db64df.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-09-13 23:00:22,258 DEBUG [rs(jenkins-hbase4.apache.org,34119,1694645979883)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-13 23:00:22,258 INFO [rs(jenkins-hbase4.apache.org,42165,1694645979926)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~132 B/132, heapSize ~528 B/528, currentSize=0 B/0 for dc0500944d9611b80a55560d8e528e94 in 66ms, sequenceid=6, compaction requested=false 2023-09-13 23:00:22,258 DEBUG [rs(jenkins-hbase4.apache.org,34119,1694645979883)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/default/testtb-testConsecutiveExports/077f739ebd1276f66ec48a98c3db64df/cf/6daad79f3180445aa9daf72bd4f63825] hfiles 2023-09-13 23:00:22,258 DEBUG [rs(jenkins-hbase4.apache.org,34119,1694645979883)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/default/testtb-testConsecutiveExports/077f739ebd1276f66ec48a98c3db64df/cf/6daad79f3180445aa9daf72bd4f63825 for snapshot=snaptb0-testConsecutiveExports 2023-09-13 23:00:22,259 DEBUG [rs(jenkins-hbase4.apache.org,42165,1694645979926)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for dc0500944d9611b80a55560d8e528e94: 2023-09-13 23:00:22,260 DEBUG [rs(jenkins-hbase4.apache.org,42165,1694645979926)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1694646021121.dc0500944d9611b80a55560d8e528e94.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-09-13 23:00:22,260 DEBUG [rs(jenkins-hbase4.apache.org,42165,1694645979926)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-13 23:00:22,260 DEBUG [rs(jenkins-hbase4.apache.org,42165,1694645979926)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/default/testtb-testConsecutiveExports/dc0500944d9611b80a55560d8e528e94/cf/28366f3030004728af3d41f4d0505a4c] hfiles 2023-09-13 23:00:22,260 DEBUG [rs(jenkins-hbase4.apache.org,42165,1694645979926)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/default/testtb-testConsecutiveExports/dc0500944d9611b80a55560d8e528e94/cf/28366f3030004728af3d41f4d0505a4c for snapshot=snaptb0-testConsecutiveExports 2023-09-13 23:00:22,271 DEBUG [rs(jenkins-hbase4.apache.org,34119,1694645979883)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1694646021121.077f739ebd1276f66ec48a98c3db64df. completed. 2023-09-13 23:00:22,271 DEBUG [rs(jenkins-hbase4.apache.org,34119,1694645979883)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1694646021121.077f739ebd1276f66ec48a98c3db64df. 2023-09-13 23:00:22,271 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1694645979883' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-13 23:00:22,271 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1694645979883' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-13 23:00:22,271 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1694645979883' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34119,1694645979883 2023-09-13 23:00:22,271 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1694645979883' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-09-13 23:00:22,271 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1694645979883' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,34119,1694645979883' in zk 2023-09-13 23:00:22,273 DEBUG [rs(jenkins-hbase4.apache.org,42165,1694645979926)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1694646021121.dc0500944d9611b80a55560d8e528e94. completed. 2023-09-13 23:00:22,273 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34119,1694645979883 2023-09-13 23:00:22,273 DEBUG [rs(jenkins-hbase4.apache.org,42165,1694645979926)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1694646021121.dc0500944d9611b80a55560d8e528e94. 2023-09-13 23:00:22,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34119,1694645979883 2023-09-13 23:00:22,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-13 23:00:22,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-13 23:00:22,273 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-13 23:00:22,274 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-13 23:00:22,274 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 23:00:22,274 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-09-13 23:00:22,274 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,42165,1694645979926' in zk 2023-09-13 23:00:22,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-13 23:00:22,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-13 23:00:22,275 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 23:00:22,275 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-09-13 23:00:22,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-13 23:00:22,276 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-13 23:00:22,276 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-09-13 23:00:22,277 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1694645979883' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-09-13 23:00:22,277 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1694645979883' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-13 23:00:22,277 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1694645979883' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-09-13 23:00:22,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34119,1694645979883 2023-09-13 23:00:22,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 23:00:22,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 23:00:22,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-13 23:00:22,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-13 23:00:22,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34119,1694645979883 2023-09-13 23:00:22,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 23:00:22,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 23:00:22,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,34119,1694645979883': 2023-09-13 23:00:22,281 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34119,1694645979883' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-09-13 23:00:22,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 23:00:22,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-13 23:00:22,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-13 23:00:22,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-13 23:00:22,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-13 23:00:22,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-13 23:00:22,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34119,1694645979883 2023-09-13 23:00:22,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 23:00:22,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 23:00:22,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-13 23:00:22,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-13 23:00:22,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34119,1694645979883 2023-09-13 23:00:22,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 23:00:22,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 23:00:22,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,42165,1694645979926': 2023-09-13 23:00:22,285 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42165,1694645979926' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-09-13 23:00:22,285 INFO [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testConsecutiveExports' execution completed 2023-09-13 23:00:22,285 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-13 23:00:22,285 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-13 23:00:22,285 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testConsecutiveExports 2023-09-13 23:00:22,285 INFO [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-13 23:00:22,288 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:39163-0x100a784b9ba0001, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-13 23:00:22,288 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:42165-0x100a784b9ba0003, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-13 23:00:22,288 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-13 23:00:22,288 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:39163-0x100a784b9ba0001, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 23:00:22,288 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-13 23:00:22,288 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:34119-0x100a784b9ba0002, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-13 23:00:22,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-13 23:00:22,288 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-13 23:00:22,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-13 23:00:22,288 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:34119-0x100a784b9ba0002, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 23:00:22,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-13 23:00:22,288 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-13 23:00:22,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-13 23:00:22,288 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:42165-0x100a784b9ba0003, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 23:00:22,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-13 23:00:22,289 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34119,1694645979883 2023-09-13 23:00:22,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-13 23:00:22,289 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 23:00:22,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 23:00:22,289 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 23:00:22,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 23:00:22,289 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 23:00:22,289 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 23:00:22,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 23:00:22,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-13 23:00:22,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-13 23:00:22,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-13 23:00:22,290 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 23:00:22,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-13 23:00:22,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-13 23:00:22,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-13 23:00:22,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-13 23:00:22,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34119,1694645979883 2023-09-13 23:00:22,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 23:00:22,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 23:00:22,292 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34119,1694645979883 2023-09-13 23:00:22,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-13 23:00:22,293 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 23:00:22,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-13 23:00:22,293 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 23:00:22,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34119,1694645979883 2023-09-13 23:00:22,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 23:00:22,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 23:00:22,304 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 23:00:22,304 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:42165-0x100a784b9ba0003, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 23:00:22,304 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-13 23:00:22,304 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 23:00:22,304 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:34119-0x100a784b9ba0002, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 23:00:22,305 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:39163-0x100a784b9ba0001, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 23:00:22,305 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 23:00:22,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 23:00:22,305 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-13 23:00:22,305 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 23:00:22,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 23:00:22,305 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34119,1694645979883 2023-09-13 23:00:22,304 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 23:00:22,306 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-13 23:00:22,306 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:39163-0x100a784b9ba0001, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 23:00:22,305 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testConsecutiveExports 2023-09-13 23:00:22,305 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:42165-0x100a784b9ba0003, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 23:00:22,307 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 23:00:22,305 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:34119-0x100a784b9ba0002, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 23:00:22,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 23:00:22,307 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-09-13 23:00:22,307 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 23:00:22,307 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-13 23:00:22,307 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testConsecutiveExports 2023-09-13 23:00:22,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 23:00:22,307 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-13 23:00:22,307 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 23:00:22,307 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 23:00:22,308 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34119,1694645979883 2023-09-13 23:00:22,308 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 23:00:22,308 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-13 23:00:22,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 23:00:22,308 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-13 23:00:22,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 23:00:22,308 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230913515ea079c4c04f5698c5eef70c5aee5f, hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230913074a0f03495d458fb1ac1e3facb69c3d] mob files 2023-09-13 23:00:22,308 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230913515ea079c4c04f5698c5eef70c5aee5f 2023-09-13 23:00:22,308 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230913074a0f03495d458fb1ac1e3facb69c3d 2023-09-13 23:00:22,319 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testConsecutiveExports 2023-09-13 23:00:22,319 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-13 23:00:22,338 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports to hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-09-13 23:00:22,339 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-09-13 23:00:22,339 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-13 23:00:22,340 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-13 23:00:22,340 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1694646022154Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1694646022319 (+165 ms)Consolidate snapshot: snaptb0-testConsecutiveExports at 1694646022319Loading Region manifests for snaptb0-testConsecutiveExports at 1694646022319Writing data manifest for snaptb0-testConsecutiveExports at 1694646022323 (+4 ms)Verifying snapshot: snaptb0-testConsecutiveExports at 1694646022331 (+8 ms)Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1694646022339 (+8 ms) 2023-09-13 23:00:22,342 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=50, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-13 23:00:22,344 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=50, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 189 msec 2023-09-13 23:00:22,457 DEBUG [Listener at jenkins-hbase4.apache.org/37017] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-13 23:00:22,458 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-09-13 23:00:22,458 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-13 23:00:22,458 INFO [Listener at jenkins-hbase4.apache.org/37017] snapshot.TestExportSnapshot(389): Local export destination path: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/62bf382e-8712-1db5-f7ab-e78a401ad305/local-export-1694646022458 2023-09-13 23:00:22,458 INFO [Listener at jenkins-hbase4.apache.org/37017] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/62bf382e-8712-1db5-f7ab-e78a401ad305/local-export-1694646022458, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/62bf382e-8712-1db5-f7ab-e78a401ad305/local-export-1694646022458, srcFsUri=hdfs://localhost:36267, srcDir=hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d 2023-09-13 23:00:22,480 DEBUG [Listener at jenkins-hbase4.apache.org/37017] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:36267, inputRoot=hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d 2023-09-13 23:00:22,480 DEBUG [Listener at jenkins-hbase4.apache.org/37017] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@6616216d, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/62bf382e-8712-1db5-f7ab-e78a401ad305/local-export-1694646022458, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/62bf382e-8712-1db5-f7ab-e78a401ad305/local-export-1694646022458/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-13 23:00:22,481 INFO [Listener at jenkins-hbase4.apache.org/37017] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:36267, inputRoot=hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d, snapshotDir=hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-09-13 23:00:22,489 INFO [Listener at jenkins-hbase4.apache.org/37017] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/62bf382e-8712-1db5-f7ab-e78a401ad305/local-export-1694646022458/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-13 23:00:22,500 DEBUG [Listener at jenkins-hbase4.apache.org/37017] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-13 23:00:22,501 DEBUG [Listener at jenkins-hbase4.apache.org/37017] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-13 23:00:22,501 DEBUG [Listener at jenkins-hbase4.apache.org/37017] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-13 23:00:22,501 DEBUG [Listener at jenkins-hbase4.apache.org/37017] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-13 23:00:23,390 DEBUG [Listener at jenkins-hbase4.apache.org/37017] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/62bf382e-8712-1db5-f7ab-e78a401ad305/hadoop-7266487329344150647.jar 2023-09-13 23:00:23,391 DEBUG [Listener at jenkins-hbase4.apache.org/37017] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-13 23:00:23,391 DEBUG [Listener at jenkins-hbase4.apache.org/37017] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-13 23:00:23,457 DEBUG [Listener at jenkins-hbase4.apache.org/37017] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/62bf382e-8712-1db5-f7ab-e78a401ad305/hadoop-3912489003632796893.jar 2023-09-13 23:00:23,457 DEBUG [Listener at jenkins-hbase4.apache.org/37017] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-13 23:00:23,458 DEBUG [Listener at jenkins-hbase4.apache.org/37017] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-13 23:00:23,458 DEBUG [Listener at jenkins-hbase4.apache.org/37017] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-13 23:00:23,458 DEBUG [Listener at jenkins-hbase4.apache.org/37017] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-13 23:00:23,459 DEBUG [Listener at jenkins-hbase4.apache.org/37017] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-13 23:00:23,459 DEBUG [Listener at jenkins-hbase4.apache.org/37017] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-13 23:00:23,459 DEBUG [Listener at jenkins-hbase4.apache.org/37017] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-13 23:00:23,460 DEBUG [Listener at jenkins-hbase4.apache.org/37017] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-13 23:00:23,460 DEBUG [Listener at jenkins-hbase4.apache.org/37017] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-13 23:00:23,460 DEBUG [Listener at jenkins-hbase4.apache.org/37017] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-13 23:00:23,461 DEBUG [Listener at jenkins-hbase4.apache.org/37017] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-13 23:00:23,461 DEBUG [Listener at jenkins-hbase4.apache.org/37017] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-13 23:00:23,462 DEBUG [Listener at jenkins-hbase4.apache.org/37017] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-13 23:00:23,462 DEBUG [Listener at jenkins-hbase4.apache.org/37017] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-13 23:00:23,462 DEBUG [Listener at jenkins-hbase4.apache.org/37017] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-13 23:00:23,463 DEBUG [Listener at jenkins-hbase4.apache.org/37017] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-13 23:00:23,463 DEBUG [Listener at jenkins-hbase4.apache.org/37017] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-13 23:00:23,464 DEBUG [Listener at jenkins-hbase4.apache.org/37017] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-13 23:00:23,464 DEBUG [Listener at jenkins-hbase4.apache.org/37017] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-13 23:00:23,465 DEBUG [Listener at jenkins-hbase4.apache.org/37017] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-13 23:00:23,465 DEBUG [Listener at jenkins-hbase4.apache.org/37017] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-13 23:00:23,465 DEBUG [Listener at jenkins-hbase4.apache.org/37017] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-13 23:00:23,466 DEBUG [Listener at jenkins-hbase4.apache.org/37017] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-13 23:00:23,817 WARN [Listener at jenkins-hbase4.apache.org/37017] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-13 23:00:23,819 INFO [Listener at jenkins-hbase4.apache.org/37017] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-09-13 23:00:23,821 DEBUG [Listener at jenkins-hbase4.apache.org/37017] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-09-13 23:00:24,945 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-13 23:00:24,945 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-13 23:00:24,949 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694645986290_0002_000001 (auth:SIMPLE) 2023-09-13 23:00:25,762 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694645986290_0003_000001 (auth:SIMPLE) 2023-09-13 23:00:26,447 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-13 23:00:29,502 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694645986290_0003_000001 (auth:SIMPLE) 2023-09-13 23:00:31,716 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694645986290_0003_000001 (auth:SIMPLE) 2023-09-13 23:00:34,032 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694645986290_0003_000001 (auth:SIMPLE) 2023-09-13 23:00:35,984 INFO [Listener at jenkins-hbase4.apache.org/37017] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-13 23:00:35,985 INFO [Listener at jenkins-hbase4.apache.org/37017] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-13 23:00:35,989 INFO [Listener at jenkins-hbase4.apache.org/37017] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-09-13 23:00:35,989 INFO [Listener at jenkins-hbase4.apache.org/37017] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-13 23:00:35,990 INFO [Listener at jenkins-hbase4.apache.org/37017] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-13 23:00:35,990 DEBUG [Listener at jenkins-hbase4.apache.org/37017] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-527948888_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-09-13 23:00:35,992 DEBUG [Listener at jenkins-hbase4.apache.org/37017] snapshot.TestExportSnapshot(367): hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-09-13 23:00:35,992 DEBUG [Listener at jenkins-hbase4.apache.org/37017] snapshot.TestExportSnapshot(367): hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-09-13 23:00:35,992 DEBUG [Listener at jenkins-hbase4.apache.org/37017] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@48cb9aa1 in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/62bf382e-8712-1db5-f7ab-e78a401ad305/local-export-1694646022458/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/62bf382e-8712-1db5-f7ab-e78a401ad305/local-export-1694646022458/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-09-13 23:00:35,993 DEBUG [Listener at jenkins-hbase4.apache.org/37017] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/62bf382e-8712-1db5-f7ab-e78a401ad305/local-export-1694646022458/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-09-13 23:00:35,993 DEBUG [Listener at jenkins-hbase4.apache.org/37017] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/62bf382e-8712-1db5-f7ab-e78a401ad305/local-export-1694646022458/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-09-13 23:00:35,994 INFO [Listener at jenkins-hbase4.apache.org/37017] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/62bf382e-8712-1db5-f7ab-e78a401ad305/local-export-1694646022458, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/62bf382e-8712-1db5-f7ab-e78a401ad305/local-export-1694646022458, srcFsUri=hdfs://localhost:36267, srcDir=hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d 2023-09-13 23:00:36,015 DEBUG [Listener at jenkins-hbase4.apache.org/37017] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:36267, inputRoot=hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d 2023-09-13 23:00:36,016 DEBUG [Listener at jenkins-hbase4.apache.org/37017] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@12a5a1bf, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/62bf382e-8712-1db5-f7ab-e78a401ad305/local-export-1694646022458, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/62bf382e-8712-1db5-f7ab-e78a401ad305/local-export-1694646022458/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-13 23:00:36,016 INFO [Listener at jenkins-hbase4.apache.org/37017] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:36267, inputRoot=hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d, snapshotDir=hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-09-13 23:00:36,028 INFO [Listener at jenkins-hbase4.apache.org/37017] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/62bf382e-8712-1db5-f7ab-e78a401ad305/local-export-1694646022458/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-13 23:00:36,040 DEBUG [Listener at jenkins-hbase4.apache.org/37017] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-13 23:00:36,041 DEBUG [Listener at jenkins-hbase4.apache.org/37017] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-13 23:00:36,041 DEBUG [Listener at jenkins-hbase4.apache.org/37017] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-13 23:00:36,042 DEBUG [Listener at jenkins-hbase4.apache.org/37017] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-13 23:00:36,912 DEBUG [Listener at jenkins-hbase4.apache.org/37017] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/62bf382e-8712-1db5-f7ab-e78a401ad305/hadoop-5262753734575699238.jar 2023-09-13 23:00:36,913 DEBUG [Listener at jenkins-hbase4.apache.org/37017] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-13 23:00:36,913 DEBUG [Listener at jenkins-hbase4.apache.org/37017] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-13 23:00:36,979 DEBUG [Listener at jenkins-hbase4.apache.org/37017] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/62bf382e-8712-1db5-f7ab-e78a401ad305/hadoop-5199837309923663581.jar 2023-09-13 23:00:36,980 DEBUG [Listener at jenkins-hbase4.apache.org/37017] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-13 23:00:36,980 DEBUG [Listener at jenkins-hbase4.apache.org/37017] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-13 23:00:36,980 DEBUG [Listener at jenkins-hbase4.apache.org/37017] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-13 23:00:36,981 DEBUG [Listener at jenkins-hbase4.apache.org/37017] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-13 23:00:36,981 DEBUG [Listener at jenkins-hbase4.apache.org/37017] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-13 23:00:36,981 DEBUG [Listener at jenkins-hbase4.apache.org/37017] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-13 23:00:36,982 DEBUG [Listener at jenkins-hbase4.apache.org/37017] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-13 23:00:36,982 DEBUG [Listener at jenkins-hbase4.apache.org/37017] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-13 23:00:36,983 DEBUG [Listener at jenkins-hbase4.apache.org/37017] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-13 23:00:36,983 DEBUG [Listener at jenkins-hbase4.apache.org/37017] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-13 23:00:36,983 DEBUG [Listener at jenkins-hbase4.apache.org/37017] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-13 23:00:36,984 DEBUG [Listener at jenkins-hbase4.apache.org/37017] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-13 23:00:36,984 DEBUG [Listener at jenkins-hbase4.apache.org/37017] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-13 23:00:36,984 DEBUG [Listener at jenkins-hbase4.apache.org/37017] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-13 23:00:36,985 DEBUG [Listener at jenkins-hbase4.apache.org/37017] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-13 23:00:36,985 DEBUG [Listener at jenkins-hbase4.apache.org/37017] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-13 23:00:36,986 DEBUG [Listener at jenkins-hbase4.apache.org/37017] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-13 23:00:36,986 DEBUG [Listener at jenkins-hbase4.apache.org/37017] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-13 23:00:36,987 DEBUG [Listener at jenkins-hbase4.apache.org/37017] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-13 23:00:36,987 DEBUG [Listener at jenkins-hbase4.apache.org/37017] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-13 23:00:36,987 DEBUG [Listener at jenkins-hbase4.apache.org/37017] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-13 23:00:36,988 DEBUG [Listener at jenkins-hbase4.apache.org/37017] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-13 23:00:36,988 DEBUG [Listener at jenkins-hbase4.apache.org/37017] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-13 23:00:37,341 WARN [Listener at jenkins-hbase4.apache.org/37017] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-13 23:00:37,343 INFO [Listener at jenkins-hbase4.apache.org/37017] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-09-13 23:00:37,346 DEBUG [Listener at jenkins-hbase4.apache.org/37017] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-09-13 23:00:40,203 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-13 23:00:40,203 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-13 23:00:40,206 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694645986290_0003_000001 (auth:SIMPLE) 2023-09-13 23:00:40,960 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694645986290_0004_000001 (auth:SIMPLE) 2023-09-13 23:00:44,609 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694645986290_0004_000001 (auth:SIMPLE) 2023-09-13 23:00:46,824 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694645986290_0004_000001 (auth:SIMPLE) 2023-09-13 23:00:49,024 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694645986290_0004_000001 (auth:SIMPLE) 2023-09-13 23:00:50,498 INFO [Listener at jenkins-hbase4.apache.org/37017] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-13 23:00:50,499 INFO [Listener at jenkins-hbase4.apache.org/37017] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-13 23:00:50,502 INFO [Listener at jenkins-hbase4.apache.org/37017] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-09-13 23:00:50,502 INFO [Listener at jenkins-hbase4.apache.org/37017] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-13 23:00:50,502 INFO [Listener at jenkins-hbase4.apache.org/37017] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-13 23:00:50,502 DEBUG [Listener at jenkins-hbase4.apache.org/37017] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-527948888_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-09-13 23:00:50,506 DEBUG [Listener at jenkins-hbase4.apache.org/37017] snapshot.TestExportSnapshot(367): hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-09-13 23:00:50,506 DEBUG [Listener at jenkins-hbase4.apache.org/37017] snapshot.TestExportSnapshot(367): hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-09-13 23:00:50,506 DEBUG [Listener at jenkins-hbase4.apache.org/37017] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@48cb9aa1 in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/62bf382e-8712-1db5-f7ab-e78a401ad305/local-export-1694646022458/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/62bf382e-8712-1db5-f7ab-e78a401ad305/local-export-1694646022458/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-09-13 23:00:50,506 DEBUG [Listener at jenkins-hbase4.apache.org/37017] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/62bf382e-8712-1db5-f7ab-e78a401ad305/local-export-1694646022458/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-09-13 23:00:50,507 DEBUG [Listener at jenkins-hbase4.apache.org/37017] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/62bf382e-8712-1db5-f7ab-e78a401ad305/local-export-1694646022458/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-09-13 23:00:50,519 INFO [Listener at jenkins-hbase4.apache.org/37017] client.HBaseAdmin$15(890): Started disable of testtb-testConsecutiveExports 2023-09-13 23:00:50,519 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testConsecutiveExports 2023-09-13 23:00:50,520 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] procedure2.ProcedureExecutor(1028): Stored pid=51, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testConsecutiveExports 2023-09-13 23:00:50,523 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-09-13 23:00:50,523 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694646050523"}]},"ts":"1694646050523"} 2023-09-13 23:00:50,525 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLING in hbase:meta 2023-09-13 23:00:50,526 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testConsecutiveExports to state=DISABLING 2023-09-13 23:00:50,527 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=dc0500944d9611b80a55560d8e528e94, UNASSIGN}, {pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=077f739ebd1276f66ec48a98c3db64df, UNASSIGN}] 2023-09-13 23:00:50,528 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=dc0500944d9611b80a55560d8e528e94, UNASSIGN 2023-09-13 23:00:50,528 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=077f739ebd1276f66ec48a98c3db64df, UNASSIGN 2023-09-13 23:00:50,529 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=dc0500944d9611b80a55560d8e528e94, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 23:00:50,529 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1694646021121.dc0500944d9611b80a55560d8e528e94.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1694646050529"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694646050529"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694646050529"}]},"ts":"1694646050529"} 2023-09-13 23:00:50,529 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=077f739ebd1276f66ec48a98c3db64df, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34119,1694645979883 2023-09-13 23:00:50,529 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1694646021121.077f739ebd1276f66ec48a98c3db64df.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1694646050529"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694646050529"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694646050529"}]},"ts":"1694646050529"} 2023-09-13 23:00:50,530 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=54, ppid=52, state=RUNNABLE; CloseRegionProcedure dc0500944d9611b80a55560d8e528e94, server=jenkins-hbase4.apache.org,42165,1694645979926}] 2023-09-13 23:00:50,531 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=55, ppid=53, state=RUNNABLE; CloseRegionProcedure 077f739ebd1276f66ec48a98c3db64df, server=jenkins-hbase4.apache.org,34119,1694645979883}] 2023-09-13 23:00:50,624 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-09-13 23:00:50,683 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close dc0500944d9611b80a55560d8e528e94 2023-09-13 23:00:50,683 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing dc0500944d9611b80a55560d8e528e94, disabling compactions & flushes 2023-09-13 23:00:50,683 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1694646021121.dc0500944d9611b80a55560d8e528e94. 2023-09-13 23:00:50,683 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1694646021121.dc0500944d9611b80a55560d8e528e94. 2023-09-13 23:00:50,683 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1694646021121.dc0500944d9611b80a55560d8e528e94. after waiting 0 ms 2023-09-13 23:00:50,683 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1694646021121.dc0500944d9611b80a55560d8e528e94. 2023-09-13 23:00:50,687 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 077f739ebd1276f66ec48a98c3db64df 2023-09-13 23:00:50,687 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 077f739ebd1276f66ec48a98c3db64df, disabling compactions & flushes 2023-09-13 23:00:50,687 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1694646021121.077f739ebd1276f66ec48a98c3db64df. 2023-09-13 23:00:50,687 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1694646021121.077f739ebd1276f66ec48a98c3db64df. 2023-09-13 23:00:50,687 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1694646021121.077f739ebd1276f66ec48a98c3db64df. after waiting 0 ms 2023-09-13 23:00:50,687 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1694646021121.077f739ebd1276f66ec48a98c3db64df. 2023-09-13 23:00:50,695 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/default/testtb-testConsecutiveExports/dc0500944d9611b80a55560d8e528e94/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-13 23:00:50,695 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/default/testtb-testConsecutiveExports/077f739ebd1276f66ec48a98c3db64df/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-13 23:00:50,696 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-13 23:00:50,697 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-13 23:00:50,697 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1694646021121.dc0500944d9611b80a55560d8e528e94. 2023-09-13 23:00:50,698 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1694646021121.077f739ebd1276f66ec48a98c3db64df. 2023-09-13 23:00:50,698 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for dc0500944d9611b80a55560d8e528e94: 2023-09-13 23:00:50,698 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 077f739ebd1276f66ec48a98c3db64df: 2023-09-13 23:00:50,699 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 077f739ebd1276f66ec48a98c3db64df 2023-09-13 23:00:50,700 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=077f739ebd1276f66ec48a98c3db64df, regionState=CLOSED 2023-09-13 23:00:50,700 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1694646021121.077f739ebd1276f66ec48a98c3db64df.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1694646050700"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694646050700"}]},"ts":"1694646050700"} 2023-09-13 23:00:50,700 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed dc0500944d9611b80a55560d8e528e94 2023-09-13 23:00:50,701 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=dc0500944d9611b80a55560d8e528e94, regionState=CLOSED 2023-09-13 23:00:50,701 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1694646021121.dc0500944d9611b80a55560d8e528e94.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1694646050701"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694646050701"}]},"ts":"1694646050701"} 2023-09-13 23:00:50,705 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=55, resume processing ppid=53 2023-09-13 23:00:50,706 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=55, ppid=53, state=SUCCESS; CloseRegionProcedure 077f739ebd1276f66ec48a98c3db64df, server=jenkins-hbase4.apache.org,34119,1694645979883 in 170 msec 2023-09-13 23:00:50,706 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=54, resume processing ppid=52 2023-09-13 23:00:50,706 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=54, ppid=52, state=SUCCESS; CloseRegionProcedure dc0500944d9611b80a55560d8e528e94, server=jenkins-hbase4.apache.org,42165,1694645979926 in 174 msec 2023-09-13 23:00:50,707 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=53, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=077f739ebd1276f66ec48a98c3db64df, UNASSIGN in 179 msec 2023-09-13 23:00:50,708 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=52, resume processing ppid=51 2023-09-13 23:00:50,708 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=52, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=dc0500944d9611b80a55560d8e528e94, UNASSIGN in 179 msec 2023-09-13 23:00:50,709 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694646050708"}]},"ts":"1694646050708"} 2023-09-13 23:00:50,710 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLED in hbase:meta 2023-09-13 23:00:50,712 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testConsecutiveExports to state=DISABLED 2023-09-13 23:00:50,714 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=51, state=SUCCESS; DisableTableProcedure table=testtb-testConsecutiveExports in 194 msec 2023-09-13 23:00:50,825 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-09-13 23:00:50,825 INFO [Listener at jenkins-hbase4.apache.org/37017] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testConsecutiveExports, procId: 51 completed 2023-09-13 23:00:50,826 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testConsecutiveExports 2023-09-13 23:00:50,827 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] procedure2.ProcedureExecutor(1028): Stored pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-13 23:00:50,829 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-13 23:00:50,830 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] access.PermissionStorage(259): Removing permissions of removed table testtb-testConsecutiveExports 2023-09-13 23:00:50,830 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=56, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-13 23:00:50,833 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39163] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testConsecutiveExports 2023-09-13 23:00:50,835 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:42165-0x100a784b9ba0003, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-13 23:00:50,835 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-13 23:00:50,836 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:34119-0x100a784b9ba0002, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-13 23:00:50,836 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:39163-0x100a784b9ba0001, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-13 23:00:50,836 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-09-13 23:00:50,836 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-09-13 23:00:50,836 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-09-13 23:00:50,836 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-09-13 23:00:50,837 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.tmp/data/default/testtb-testConsecutiveExports/dc0500944d9611b80a55560d8e528e94 2023-09-13 23:00:50,837 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.tmp/data/default/testtb-testConsecutiveExports/077f739ebd1276f66ec48a98c3db64df 2023-09-13 23:00:50,837 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:39163-0x100a784b9ba0001, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-13 23:00:50,837 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-13 23:00:50,838 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:34119-0x100a784b9ba0002, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-13 23:00:50,838 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:39163-0x100a784b9ba0001, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-13 23:00:50,837 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:42165-0x100a784b9ba0003, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-13 23:00:50,838 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:34119-0x100a784b9ba0002, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-13 23:00:50,838 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-13 23:00:50,838 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:42165-0x100a784b9ba0003, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-13 23:00:50,839 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-09-13 23:00:50,839 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.tmp/data/default/testtb-testConsecutiveExports/dc0500944d9611b80a55560d8e528e94/cf, FileablePath, hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.tmp/data/default/testtb-testConsecutiveExports/dc0500944d9611b80a55560d8e528e94/recovered.edits] 2023-09-13 23:00:50,839 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.tmp/data/default/testtb-testConsecutiveExports/077f739ebd1276f66ec48a98c3db64df/cf, FileablePath, hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.tmp/data/default/testtb-testConsecutiveExports/077f739ebd1276f66ec48a98c3db64df/recovered.edits] 2023-09-13 23:00:50,844 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.tmp/data/default/testtb-testConsecutiveExports/dc0500944d9611b80a55560d8e528e94/cf/28366f3030004728af3d41f4d0505a4c to hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/archive/data/default/testtb-testConsecutiveExports/dc0500944d9611b80a55560d8e528e94/cf/28366f3030004728af3d41f4d0505a4c 2023-09-13 23:00:50,845 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.tmp/data/default/testtb-testConsecutiveExports/077f739ebd1276f66ec48a98c3db64df/cf/6daad79f3180445aa9daf72bd4f63825 to hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/archive/data/default/testtb-testConsecutiveExports/077f739ebd1276f66ec48a98c3db64df/cf/6daad79f3180445aa9daf72bd4f63825 2023-09-13 23:00:50,848 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.tmp/data/default/testtb-testConsecutiveExports/dc0500944d9611b80a55560d8e528e94/recovered.edits/9.seqid to hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/archive/data/default/testtb-testConsecutiveExports/dc0500944d9611b80a55560d8e528e94/recovered.edits/9.seqid 2023-09-13 23:00:50,848 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.tmp/data/default/testtb-testConsecutiveExports/077f739ebd1276f66ec48a98c3db64df/recovered.edits/9.seqid to hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/archive/data/default/testtb-testConsecutiveExports/077f739ebd1276f66ec48a98c3db64df/recovered.edits/9.seqid 2023-09-13 23:00:50,848 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.tmp/data/default/testtb-testConsecutiveExports/dc0500944d9611b80a55560d8e528e94 2023-09-13 23:00:50,848 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.tmp/data/default/testtb-testConsecutiveExports/077f739ebd1276f66ec48a98c3db64df 2023-09-13 23:00:50,849 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-09-13 23:00:50,849 DEBUG [PEWorker-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-09-13 23:00:50,850 DEBUG [PEWorker-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf] 2023-09-13 23:00:50,853 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230913515ea079c4c04f5698c5eef70c5aee5f to hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230913515ea079c4c04f5698c5eef70c5aee5f 2023-09-13 23:00:50,854 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230913074a0f03495d458fb1ac1e3facb69c3d to hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230913074a0f03495d458fb1ac1e3facb69c3d 2023-09-13 23:00:50,855 DEBUG [PEWorker-5] backup.HFileArchiver(596): Deleted hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-09-13 23:00:50,857 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=56, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-13 23:00:50,859 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testConsecutiveExports from hbase:meta 2023-09-13 23:00:50,861 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testConsecutiveExports' descriptor. 2023-09-13 23:00:50,862 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=56, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-13 23:00:50,862 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testConsecutiveExports' from region states. 2023-09-13 23:00:50,862 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,,1694646021121.dc0500944d9611b80a55560d8e528e94.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1694646050862"}]},"ts":"9223372036854775807"} 2023-09-13 23:00:50,862 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,1,1694646021121.077f739ebd1276f66ec48a98c3db64df.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1694646050862"}]},"ts":"9223372036854775807"} 2023-09-13 23:00:50,864 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-13 23:00:50,864 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => dc0500944d9611b80a55560d8e528e94, NAME => 'testtb-testConsecutiveExports,,1694646021121.dc0500944d9611b80a55560d8e528e94.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 077f739ebd1276f66ec48a98c3db64df, NAME => 'testtb-testConsecutiveExports,1,1694646021121.077f739ebd1276f66ec48a98c3db64df.', STARTKEY => '1', ENDKEY => ''}] 2023-09-13 23:00:50,864 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testConsecutiveExports' as deleted. 2023-09-13 23:00:50,864 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1694646050864"}]},"ts":"9223372036854775807"} 2023-09-13 23:00:50,865 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testConsecutiveExports state from META 2023-09-13 23:00:50,868 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=56, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-13 23:00:50,869 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=56, state=SUCCESS; DeleteTableProcedure table=testtb-testConsecutiveExports in 42 msec 2023-09-13 23:00:50,940 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-09-13 23:00:50,940 INFO [Listener at jenkins-hbase4.apache.org/37017] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testConsecutiveExports, procId: 56 completed 2023-09-13 23:00:50,948 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testConsecutiveExports" 2023-09-13 23:00:50,949 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testConsecutiveExports 2023-09-13 23:00:50,951 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testConsecutiveExports" 2023-09-13 23:00:50,952 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testConsecutiveExports 2023-09-13 23:00:50,977 INFO [Listener at jenkins-hbase4.apache.org/37017] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=753 (was 759), OpenFileDescriptor=903 (was 931), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=200 (was 250), ProcessCount=168 (was 168), AvailableMemoryMB=8577 (was 8739) 2023-09-13 23:00:50,977 WARN [Listener at jenkins-hbase4.apache.org/37017] hbase.ResourceChecker(130): Thread=753 is superior to 500 2023-09-13 23:00:50,994 INFO [Listener at jenkins-hbase4.apache.org/37017] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=750, OpenFileDescriptor=903, MaxFileDescriptor=60000, SystemLoadAverage=200, ProcessCount=168, AvailableMemoryMB=8577 2023-09-13 23:00:50,994 WARN [Listener at jenkins-hbase4.apache.org/37017] hbase.ResourceChecker(130): Thread=750 is superior to 500 2023-09-13 23:00:50,996 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-13 23:00:50,997 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] procedure2.ProcedureExecutor(1028): Stored pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-13 23:00:50,999 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-09-13 23:00:50,999 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion" procId is: 57 2023-09-13 23:00:51,000 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-13 23:00:51,000 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-09-13 23:00:51,002 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/e6660ca969b8a4cd6214cb091aafedf4 2023-09-13 23:00:51,002 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/1906c1473c12e09b8836fb6168104d6a 2023-09-13 23:00:51,003 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/1906c1473c12e09b8836fb6168104d6a empty. 2023-09-13 23:00:51,003 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/e6660ca969b8a4cd6214cb091aafedf4 empty. 2023-09-13 23:00:51,003 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/1906c1473c12e09b8836fb6168104d6a 2023-09-13 23:00:51,003 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/e6660ca969b8a4cd6214cb091aafedf4 2023-09-13 23:00:51,003 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-09-13 23:00:51,013 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/.tabledesc/.tableinfo.0000000001 2023-09-13 23:00:51,014 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(7675): creating {ENCODED => e6660ca969b8a4cd6214cb091aafedf4, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1694646050996.e6660ca969b8a4cd6214cb091aafedf4.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.tmp 2023-09-13 23:00:51,014 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(7675): creating {ENCODED => 1906c1473c12e09b8836fb6168104d6a, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1694646050996.1906c1473c12e09b8836fb6168104d6a.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.tmp 2023-09-13 23:00:51,101 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-09-13 23:00:51,302 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-09-13 23:00:51,422 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1694646050996.e6660ca969b8a4cd6214cb091aafedf4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-13 23:00:51,422 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1694646050996.1906c1473c12e09b8836fb6168104d6a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-13 23:00:51,423 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1604): Closing e6660ca969b8a4cd6214cb091aafedf4, disabling compactions & flushes 2023-09-13 23:00:51,423 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1604): Closing 1906c1473c12e09b8836fb6168104d6a, disabling compactions & flushes 2023-09-13 23:00:51,423 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1694646050996.e6660ca969b8a4cd6214cb091aafedf4. 2023-09-13 23:00:51,423 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1694646050996.1906c1473c12e09b8836fb6168104d6a. 2023-09-13 23:00:51,423 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1694646050996.e6660ca969b8a4cd6214cb091aafedf4. 2023-09-13 23:00:51,423 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1694646050996.1906c1473c12e09b8836fb6168104d6a. 2023-09-13 23:00:51,423 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1694646050996.e6660ca969b8a4cd6214cb091aafedf4. after waiting 0 ms 2023-09-13 23:00:51,423 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1694646050996.1906c1473c12e09b8836fb6168104d6a. after waiting 0 ms 2023-09-13 23:00:51,423 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1694646050996.e6660ca969b8a4cd6214cb091aafedf4. 2023-09-13 23:00:51,423 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1694646050996.1906c1473c12e09b8836fb6168104d6a. 2023-09-13 23:00:51,423 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1694646050996.e6660ca969b8a4cd6214cb091aafedf4. 2023-09-13 23:00:51,423 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1558): Region close journal for e6660ca969b8a4cd6214cb091aafedf4: 2023-09-13 23:00:51,423 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1694646050996.1906c1473c12e09b8836fb6168104d6a. 2023-09-13 23:00:51,423 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1558): Region close journal for 1906c1473c12e09b8836fb6168104d6a: 2023-09-13 23:00:51,426 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ADD_TO_META 2023-09-13 23:00:51,426 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1694646050996.e6660ca969b8a4cd6214cb091aafedf4.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1694646051426"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694646051426"}]},"ts":"1694646051426"} 2023-09-13 23:00:51,427 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1694646050996.1906c1473c12e09b8836fb6168104d6a.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1694646051426"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694646051426"}]},"ts":"1694646051426"} 2023-09-13 23:00:51,432 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-13 23:00:51,433 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-13 23:00:51,433 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694646051433"}]},"ts":"1694646051433"} 2023-09-13 23:00:51,434 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLING in hbase:meta 2023-09-13 23:00:51,438 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-13 23:00:51,439 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-13 23:00:51,439 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-13 23:00:51,439 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-13 23:00:51,439 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-13 23:00:51,439 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=e6660ca969b8a4cd6214cb091aafedf4, ASSIGN}, {pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=1906c1473c12e09b8836fb6168104d6a, ASSIGN}] 2023-09-13 23:00:51,441 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=e6660ca969b8a4cd6214cb091aafedf4, ASSIGN 2023-09-13 23:00:51,441 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=1906c1473c12e09b8836fb6168104d6a, ASSIGN 2023-09-13 23:00:51,442 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=e6660ca969b8a4cd6214cb091aafedf4, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42165,1694645979926; forceNewPlan=false, retain=false 2023-09-13 23:00:51,442 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=1906c1473c12e09b8836fb6168104d6a, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34119,1694645979883; forceNewPlan=false, retain=false 2023-09-13 23:00:51,592 INFO [jenkins-hbase4:36621] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-13 23:00:51,594 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=e6660ca969b8a4cd6214cb091aafedf4, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 23:00:51,594 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=1906c1473c12e09b8836fb6168104d6a, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34119,1694645979883 2023-09-13 23:00:51,595 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1694646050996.e6660ca969b8a4cd6214cb091aafedf4.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1694646051594"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694646051594"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694646051594"}]},"ts":"1694646051594"} 2023-09-13 23:00:51,595 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1694646050996.1906c1473c12e09b8836fb6168104d6a.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1694646051594"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694646051594"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694646051594"}]},"ts":"1694646051594"} 2023-09-13 23:00:51,596 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=60, ppid=58, state=RUNNABLE; OpenRegionProcedure e6660ca969b8a4cd6214cb091aafedf4, server=jenkins-hbase4.apache.org,42165,1694645979926}] 2023-09-13 23:00:51,597 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=61, ppid=59, state=RUNNABLE; OpenRegionProcedure 1906c1473c12e09b8836fb6168104d6a, server=jenkins-hbase4.apache.org,34119,1694645979883}] 2023-09-13 23:00:51,603 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-09-13 23:00:51,753 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,,1694646050996.e6660ca969b8a4cd6214cb091aafedf4. 2023-09-13 23:00:51,753 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,1,1694646050996.1906c1473c12e09b8836fb6168104d6a. 2023-09-13 23:00:51,753 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => e6660ca969b8a4cd6214cb091aafedf4, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1694646050996.e6660ca969b8a4cd6214cb091aafedf4.', STARTKEY => '', ENDKEY => '1'} 2023-09-13 23:00:51,753 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1906c1473c12e09b8836fb6168104d6a, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1694646050996.1906c1473c12e09b8836fb6168104d6a.', STARTKEY => '1', ENDKEY => ''} 2023-09-13 23:00:51,753 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,,1694646050996.e6660ca969b8a4cd6214cb091aafedf4. service=AccessControlService 2023-09-13 23:00:51,753 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,1,1694646050996.1906c1473c12e09b8836fb6168104d6a. service=AccessControlService 2023-09-13 23:00:51,754 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-13 23:00:51,754 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-13 23:00:51,754 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion e6660ca969b8a4cd6214cb091aafedf4 2023-09-13 23:00:51,754 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 1906c1473c12e09b8836fb6168104d6a 2023-09-13 23:00:51,754 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1694646050996.e6660ca969b8a4cd6214cb091aafedf4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-13 23:00:51,754 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1694646050996.1906c1473c12e09b8836fb6168104d6a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-13 23:00:51,754 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for e6660ca969b8a4cd6214cb091aafedf4 2023-09-13 23:00:51,754 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for e6660ca969b8a4cd6214cb091aafedf4 2023-09-13 23:00:51,754 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1906c1473c12e09b8836fb6168104d6a 2023-09-13 23:00:51,754 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1906c1473c12e09b8836fb6168104d6a 2023-09-13 23:00:51,755 INFO [StoreOpener-e6660ca969b8a4cd6214cb091aafedf4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region e6660ca969b8a4cd6214cb091aafedf4 2023-09-13 23:00:51,755 INFO [StoreOpener-1906c1473c12e09b8836fb6168104d6a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 1906c1473c12e09b8836fb6168104d6a 2023-09-13 23:00:51,759 DEBUG [StoreOpener-1906c1473c12e09b8836fb6168104d6a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/default/testtb-testExportFileSystemStateWithMergeRegion/1906c1473c12e09b8836fb6168104d6a/cf 2023-09-13 23:00:51,759 DEBUG [StoreOpener-1906c1473c12e09b8836fb6168104d6a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/default/testtb-testExportFileSystemStateWithMergeRegion/1906c1473c12e09b8836fb6168104d6a/cf 2023-09-13 23:00:51,759 DEBUG [StoreOpener-e6660ca969b8a4cd6214cb091aafedf4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/default/testtb-testExportFileSystemStateWithMergeRegion/e6660ca969b8a4cd6214cb091aafedf4/cf 2023-09-13 23:00:51,760 DEBUG [StoreOpener-e6660ca969b8a4cd6214cb091aafedf4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/default/testtb-testExportFileSystemStateWithMergeRegion/e6660ca969b8a4cd6214cb091aafedf4/cf 2023-09-13 23:00:51,760 INFO [StoreOpener-1906c1473c12e09b8836fb6168104d6a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1906c1473c12e09b8836fb6168104d6a columnFamilyName cf 2023-09-13 23:00:51,760 INFO [StoreOpener-e6660ca969b8a4cd6214cb091aafedf4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e6660ca969b8a4cd6214cb091aafedf4 columnFamilyName cf 2023-09-13 23:00:51,762 INFO [StoreOpener-1906c1473c12e09b8836fb6168104d6a-1] regionserver.HStore(310): Store=1906c1473c12e09b8836fb6168104d6a/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-13 23:00:51,762 INFO [StoreOpener-e6660ca969b8a4cd6214cb091aafedf4-1] regionserver.HStore(310): Store=e6660ca969b8a4cd6214cb091aafedf4/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-13 23:00:51,763 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/default/testtb-testExportFileSystemStateWithMergeRegion/1906c1473c12e09b8836fb6168104d6a 2023-09-13 23:00:51,763 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/default/testtb-testExportFileSystemStateWithMergeRegion/e6660ca969b8a4cd6214cb091aafedf4 2023-09-13 23:00:51,763 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/default/testtb-testExportFileSystemStateWithMergeRegion/1906c1473c12e09b8836fb6168104d6a 2023-09-13 23:00:51,763 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/default/testtb-testExportFileSystemStateWithMergeRegion/e6660ca969b8a4cd6214cb091aafedf4 2023-09-13 23:00:51,766 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1906c1473c12e09b8836fb6168104d6a 2023-09-13 23:00:51,766 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for e6660ca969b8a4cd6214cb091aafedf4 2023-09-13 23:00:51,768 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/default/testtb-testExportFileSystemStateWithMergeRegion/1906c1473c12e09b8836fb6168104d6a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-13 23:00:51,768 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/default/testtb-testExportFileSystemStateWithMergeRegion/e6660ca969b8a4cd6214cb091aafedf4/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-13 23:00:51,768 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1906c1473c12e09b8836fb6168104d6a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69286007, jitterRate=0.03244195878505707}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-13 23:00:51,768 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened e6660ca969b8a4cd6214cb091aafedf4; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61389365, jitterRate=-0.08522717654705048}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-13 23:00:51,768 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1906c1473c12e09b8836fb6168104d6a: 2023-09-13 23:00:51,769 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for e6660ca969b8a4cd6214cb091aafedf4: 2023-09-13 23:00:51,769 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,1,1694646050996.1906c1473c12e09b8836fb6168104d6a., pid=61, masterSystemTime=1694646051749 2023-09-13 23:00:51,769 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,,1694646050996.e6660ca969b8a4cd6214cb091aafedf4., pid=60, masterSystemTime=1694646051748 2023-09-13 23:00:51,771 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,1,1694646050996.1906c1473c12e09b8836fb6168104d6a. 2023-09-13 23:00:51,771 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,1,1694646050996.1906c1473c12e09b8836fb6168104d6a. 2023-09-13 23:00:51,772 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=1906c1473c12e09b8836fb6168104d6a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34119,1694645979883 2023-09-13 23:00:51,772 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,,1694646050996.e6660ca969b8a4cd6214cb091aafedf4. 2023-09-13 23:00:51,772 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,,1694646050996.e6660ca969b8a4cd6214cb091aafedf4. 2023-09-13 23:00:51,772 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1694646050996.1906c1473c12e09b8836fb6168104d6a.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1694646051772"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1694646051772"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1694646051772"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1694646051772"}]},"ts":"1694646051772"} 2023-09-13 23:00:51,772 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=e6660ca969b8a4cd6214cb091aafedf4, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 23:00:51,773 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1694646050996.e6660ca969b8a4cd6214cb091aafedf4.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1694646051772"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1694646051772"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1694646051772"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1694646051772"}]},"ts":"1694646051772"} 2023-09-13 23:00:51,775 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=61, resume processing ppid=59 2023-09-13 23:00:51,775 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=61, ppid=59, state=SUCCESS; OpenRegionProcedure 1906c1473c12e09b8836fb6168104d6a, server=jenkins-hbase4.apache.org,34119,1694645979883 in 177 msec 2023-09-13 23:00:51,777 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=60, resume processing ppid=58 2023-09-13 23:00:51,777 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=59, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=1906c1473c12e09b8836fb6168104d6a, ASSIGN in 336 msec 2023-09-13 23:00:51,777 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=60, ppid=58, state=SUCCESS; OpenRegionProcedure e6660ca969b8a4cd6214cb091aafedf4, server=jenkins-hbase4.apache.org,42165,1694645979926 in 179 msec 2023-09-13 23:00:51,778 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=58, resume processing ppid=57 2023-09-13 23:00:51,778 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=58, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=e6660ca969b8a4cd6214cb091aafedf4, ASSIGN in 338 msec 2023-09-13 23:00:51,779 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-13 23:00:51,779 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694646051779"}]},"ts":"1694646051779"} 2023-09-13 23:00:51,780 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLED in hbase:meta 2023-09-13 23:00:51,782 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_POST_OPERATION 2023-09-13 23:00:51,783 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion jenkins: RWXCA 2023-09-13 23:00:51,784 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39163] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-09-13 23:00:51,787 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:42165-0x100a784b9ba0003, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-13 23:00:51,787 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:39163-0x100a784b9ba0001, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-13 23:00:51,787 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-13 23:00:51,787 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:34119-0x100a784b9ba0002, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-13 23:00:51,788 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-13 23:00:51,788 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-13 23:00:51,788 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-13 23:00:51,788 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-13 23:00:51,789 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=57, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 792 msec 2023-09-13 23:00:52,104 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-09-13 23:00:52,104 INFO [Listener at jenkins-hbase4.apache.org/37017] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 57 completed 2023-09-13 23:00:52,107 DEBUG [Listener at jenkins-hbase4.apache.org/37017] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-09-13 23:00:52,107 DEBUG [Listener at jenkins-hbase4.apache.org/37017] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1694646050996.e6660ca969b8a4cd6214cb091aafedf4. 2023-09-13 23:00:52,109 INFO [Listener at jenkins-hbase4.apache.org/37017] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-13 23:00:52,121 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-13 23:00:52,121 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1694646052121 (current time:1694646052121). 2023-09-13 23:00:52,121 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-13 23:00:52,122 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] zookeeper.ReadOnlyZKClient(139): Connect 0x48d28908 to 127.0.0.1:55012 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-13 23:00:52,129 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1ea186fd, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-13 23:00:52,130 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-13 23:00:52,131 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40864, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-13 23:00:52,132 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x48d28908 to 127.0.0.1:55012 2023-09-13 23:00:52,132 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-13 23:00:52,133 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] zookeeper.ReadOnlyZKClient(139): Connect 0x5bfbb01f to 127.0.0.1:55012 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-13 23:00:52,139 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@73df8a1, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-13 23:00:52,141 DEBUG [hconnection-0x153910d5-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-13 23:00:52,143 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40880, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-13 23:00:52,146 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-13 23:00:52,148 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33376, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-13 23:00:52,149 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5bfbb01f to 127.0.0.1:55012 2023-09-13 23:00:52,149 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-13 23:00:52,149 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-09-13 23:00:52,150 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-13 23:00:52,150 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-13 23:00:52,152 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] procedure2.ProcedureExecutor(1028): Stored pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-13 23:00:52,153 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-13 23:00:52,153 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=62, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1694646652153 2023-09-13 23:00:52,153 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-09-13 23:00:52,153 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-13 23:00:52,155 DEBUG [Listener at jenkins-hbase4.apache.org/37017] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-13 23:00:52,155 DEBUG [Listener at jenkins-hbase4.apache.org/37017] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-13 23:00:52,156 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=62, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-13 23:00:52,156 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-13 23:00:52,157 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=62, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 5 msec 2023-09-13 23:00:52,157 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-13 23:00:52,158 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=63, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1694646652158 2023-09-13 23:00:52,167 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 23:00:52,167 INFO [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' 2023-09-13 23:00:52,167 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-13 23:00:52,168 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-09-13 23:00:52,168 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-09-13 23:00:52,169 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 23:00:52,169 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 23:00:52,170 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:39163-0x100a784b9ba0001, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 23:00:52,170 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:34119-0x100a784b9ba0002, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 23:00:52,170 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 23:00:52,170 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 23:00:52,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 23:00:52,170 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:42165-0x100a784b9ba0003, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 23:00:52,170 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34119,1694645979883 2023-09-13 23:00:52,170 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 23:00:52,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 23:00:52,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 23:00:52,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 23:00:52,171 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34119,1694645979883 2023-09-13 23:00:52,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 23:00:52,171 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 23:00:52,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 23:00:52,171 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34119-0x100a784b9ba0002, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 23:00:52,171 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39163-0x100a784b9ba0001, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 23:00:52,171 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42165-0x100a784b9ba0003, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 23:00:52,171 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 23:00:52,171 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-13 23:00:52,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-09-13 23:00:52,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 23:00:52,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-09-13 23:00:52,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-09-13 23:00:52,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 23:00:52,172 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-13 23:00:52,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 23:00:52,172 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-13 23:00:52,172 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-13 23:00:52,172 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 23:00:52,172 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1694645979883' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-13 23:00:52,172 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1694645979883' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-13 23:00:52,174 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1694645979883' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-13 23:00:52,174 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1694645979883' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-13 23:00:52,174 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1694645979883' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34119,1694645979883' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-13 23:00:52,174 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 23:00:52,174 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 23:00:52,174 DEBUG [member: 'jenkins-hbase4.apache.org,39163,1694645979837' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-13 23:00:52,174 DEBUG [member: 'jenkins-hbase4.apache.org,39163,1694645979837' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-13 23:00:52,174 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-13 23:00:52,175 DEBUG [member: 'jenkins-hbase4.apache.org,39163,1694645979837' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-13 23:00:52,175 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-13 23:00:52,175 DEBUG [member: 'jenkins-hbase4.apache.org,39163,1694645979837' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-13 23:00:52,176 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-13 23:00:52,176 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-13 23:00:52,176 DEBUG [member: 'jenkins-hbase4.apache.org,39163,1694645979837' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39163,1694645979837' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-13 23:00:52,176 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42165,1694645979926' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-13 23:00:52,177 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1694645979883' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 23:00:52,177 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34119,1694645979883 2023-09-13 23:00:52,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34119,1694645979883 2023-09-13 23:00:52,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-13 23:00:52,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-13 23:00:52,179 DEBUG [member: 'jenkins-hbase4.apache.org,39163,1694645979837' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 23:00:52,179 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 23:00:52,180 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1694645979883' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34119-0x100a784b9ba0002, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 23:00:52,180 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1694645979883' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-13 23:00:52,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-13 23:00:52,180 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 23:00:52,180 DEBUG [member: 'jenkins-hbase4.apache.org,39163,1694645979837' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39163-0x100a784b9ba0001, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 23:00:52,180 DEBUG [member: 'jenkins-hbase4.apache.org,39163,1694645979837' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-13 23:00:52,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-13 23:00:52,180 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42165-0x100a784b9ba0003, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 23:00:52,180 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-13 23:00:52,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 23:00:52,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34119,1694645979883 2023-09-13 23:00:52,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 23:00:52,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 23:00:52,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-13 23:00:52,181 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34119,1694645979883' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-09-13 23:00:52,181 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@15ab8e60[Count = 1] remaining members to acquire global barrier 2023-09-13 23:00:52,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 23:00:52,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-13 23:00:52,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-13 23:00:52,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-13 23:00:52,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-13 23:00:52,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 23:00:52,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34119,1694645979883 2023-09-13 23:00:52,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 23:00:52,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 23:00:52,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-13 23:00:52,183 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42165,1694645979926' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-09-13 23:00:52,183 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@15ab8e60[Count = 0] remaining members to acquire global barrier 2023-09-13 23:00:52,183 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-09-13 23:00:52,183 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 23:00:52,184 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:34119-0x100a784b9ba0002, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 23:00:52,185 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:39163-0x100a784b9ba0001, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 23:00:52,185 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 23:00:52,185 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 23:00:52,185 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:42165-0x100a784b9ba0003, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 23:00:52,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 23:00:52,185 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34119,1694645979883 2023-09-13 23:00:52,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 23:00:52,185 DEBUG [member: 'jenkins-hbase4.apache.org,39163,1694645979837' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-13 23:00:52,185 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1694645979883' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-13 23:00:52,185 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 23:00:52,185 DEBUG [member: 'jenkins-hbase4.apache.org,39163,1694645979837' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-13 23:00:52,185 DEBUG [member: 'jenkins-hbase4.apache.org,39163,1694645979837' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,39163,1694645979837' in zk 2023-09-13 23:00:52,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 23:00:52,185 DEBUG [rs(jenkins-hbase4.apache.org,34119,1694645979883)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1694646050996.1906c1473c12e09b8836fb6168104d6a. 2023-09-13 23:00:52,185 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-13 23:00:52,185 DEBUG [rs(jenkins-hbase4.apache.org,34119,1694645979883)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1694646050996.1906c1473c12e09b8836fb6168104d6a. started... 2023-09-13 23:00:52,185 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-13 23:00:52,185 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-13 23:00:52,185 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 23:00:52,186 DEBUG [rs(jenkins-hbase4.apache.org,34119,1694645979883)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 1906c1473c12e09b8836fb6168104d6a: 2023-09-13 23:00:52,185 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1694645979883' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-13 23:00:52,186 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1694645979883' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-13 23:00:52,186 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-13 23:00:52,186 DEBUG [rs(jenkins-hbase4.apache.org,42165,1694645979926)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1694646050996.e6660ca969b8a4cd6214cb091aafedf4. 2023-09-13 23:00:52,186 DEBUG [rs(jenkins-hbase4.apache.org,34119,1694645979883)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1694646050996.1906c1473c12e09b8836fb6168104d6a.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 23:00:52,187 DEBUG [rs(jenkins-hbase4.apache.org,42165,1694645979926)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1694646050996.e6660ca969b8a4cd6214cb091aafedf4. started... 2023-09-13 23:00:52,187 DEBUG [rs(jenkins-hbase4.apache.org,34119,1694645979883)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-13 23:00:52,187 DEBUG [rs(jenkins-hbase4.apache.org,34119,1694645979883)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-13 23:00:52,187 DEBUG [rs(jenkins-hbase4.apache.org,42165,1694645979926)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for e6660ca969b8a4cd6214cb091aafedf4: 2023-09-13 23:00:52,187 DEBUG [rs(jenkins-hbase4.apache.org,42165,1694645979926)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1694646050996.e6660ca969b8a4cd6214cb091aafedf4.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 23:00:52,187 DEBUG [rs(jenkins-hbase4.apache.org,42165,1694645979926)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-13 23:00:52,187 DEBUG [rs(jenkins-hbase4.apache.org,42165,1694645979926)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-13 23:00:52,193 DEBUG [member: 'jenkins-hbase4.apache.org,39163,1694645979837' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-13 23:00:52,193 DEBUG [member: 'jenkins-hbase4.apache.org,39163,1694645979837' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-13 23:00:52,193 DEBUG [member: 'jenkins-hbase4.apache.org,39163,1694645979837' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-13 23:00:52,197 DEBUG [rs(jenkins-hbase4.apache.org,42165,1694645979926)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1694646050996.e6660ca969b8a4cd6214cb091aafedf4. completed. 2023-09-13 23:00:52,197 DEBUG [rs(jenkins-hbase4.apache.org,42165,1694645979926)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1694646050996.e6660ca969b8a4cd6214cb091aafedf4. 2023-09-13 23:00:52,197 DEBUG [rs(jenkins-hbase4.apache.org,34119,1694645979883)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1694646050996.1906c1473c12e09b8836fb6168104d6a. completed. 2023-09-13 23:00:52,197 DEBUG [rs(jenkins-hbase4.apache.org,34119,1694645979883)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1694646050996.1906c1473c12e09b8836fb6168104d6a. 2023-09-13 23:00:52,197 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-13 23:00:52,197 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1694645979883' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-13 23:00:52,197 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1694645979883' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-13 23:00:52,197 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1694645979883' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34119,1694645979883 2023-09-13 23:00:52,197 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-13 23:00:52,197 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1694645979883' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-13 23:00:52,197 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 23:00:52,197 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1694645979883' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,34119,1694645979883' in zk 2023-09-13 23:00:52,197 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-13 23:00:52,197 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,42165,1694645979926' in zk 2023-09-13 23:00:52,199 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34119,1694645979883 2023-09-13 23:00:52,199 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-13 23:00:52,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34119,1694645979883 2023-09-13 23:00:52,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-13 23:00:52,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-13 23:00:52,199 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-13 23:00:52,199 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 23:00:52,199 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1694645979883' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-13 23:00:52,199 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-13 23:00:52,200 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1694645979883' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-13 23:00:52,200 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1694645979883' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-13 23:00:52,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-13 23:00:52,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-13 23:00:52,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 23:00:52,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34119,1694645979883 2023-09-13 23:00:52,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 23:00:52,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 23:00:52,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-13 23:00:52,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 23:00:52,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34119,1694645979883 2023-09-13 23:00:52,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 23:00:52,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 23:00:52,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,34119,1694645979883': 2023-09-13 23:00:52,203 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34119,1694645979883' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-09-13 23:00:52,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 23:00:52,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-13 23:00:52,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-13 23:00:52,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-13 23:00:52,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-13 23:00:52,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 23:00:52,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34119,1694645979883 2023-09-13 23:00:52,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 23:00:52,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 23:00:52,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-13 23:00:52,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 23:00:52,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34119,1694645979883 2023-09-13 23:00:52,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 23:00:52,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 23:00:52,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,42165,1694645979926': 2023-09-13 23:00:52,207 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42165,1694645979926' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-09-13 23:00:52,207 INFO [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-09-13 23:00:52,207 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-13 23:00:52,207 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-13 23:00:52,207 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 23:00:52,207 INFO [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-13 23:00:52,208 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:39163-0x100a784b9ba0001, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 23:00:52,208 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:42165-0x100a784b9ba0003, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 23:00:52,208 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 23:00:52,208 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:34119-0x100a784b9ba0002, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 23:00:52,208 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 23:00:52,209 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 23:00:52,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 23:00:52,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-13 23:00:52,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-13 23:00:52,209 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:34119-0x100a784b9ba0002, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 23:00:52,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 23:00:52,209 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 23:00:52,209 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:42165-0x100a784b9ba0003, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 23:00:52,208 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:39163-0x100a784b9ba0001, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 23:00:52,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 23:00:52,209 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34119,1694645979883 2023-09-13 23:00:52,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-13 23:00:52,209 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 23:00:52,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 23:00:52,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 23:00:52,209 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 23:00:52,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 23:00:52,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 23:00:52,210 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 23:00:52,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 23:00:52,210 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 23:00:52,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 23:00:52,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 23:00:52,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-13 23:00:52,210 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 23:00:52,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 23:00:52,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 23:00:52,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34119,1694645979883 2023-09-13 23:00:52,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 23:00:52,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 23:00:52,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-13 23:00:52,213 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34119,1694645979883 2023-09-13 23:00:52,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 23:00:52,213 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 23:00:52,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34119,1694645979883 2023-09-13 23:00:52,213 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 23:00:52,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 23:00:52,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 23:00:52,216 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 23:00:52,216 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-13 23:00:52,216 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:42165-0x100a784b9ba0003, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 23:00:52,216 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:34119-0x100a784b9ba0002, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 23:00:52,217 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 23:00:52,217 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:34119-0x100a784b9ba0002, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 23:00:52,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 23:00:52,216 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:39163-0x100a784b9ba0001, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 23:00:52,217 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 23:00:52,217 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:42165-0x100a784b9ba0003, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 23:00:52,216 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 23:00:52,216 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 23:00:52,217 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 23:00:52,218 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-09-13 23:00:52,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 23:00:52,218 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 23:00:52,217 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 23:00:52,218 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-13 23:00:52,217 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:39163-0x100a784b9ba0001, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 23:00:52,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 23:00:52,218 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34119,1694645979883 2023-09-13 23:00:52,217 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 23:00:52,218 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 23:00:52,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 23:00:52,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 23:00:52,218 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 23:00:52,218 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 23:00:52,218 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 23:00:52,218 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 23:00:52,218 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34119,1694645979883 2023-09-13 23:00:52,218 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 23:00:52,218 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 23:00:52,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 23:00:52,218 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-13 23:00:52,218 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 23:00:52,225 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 23:00:52,225 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 23:00:52,242 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 23:00:52,242 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-09-13 23:00:52,242 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 23:00:52,243 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 23:00:52,243 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1694646052153Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1694646052225 (+72 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1694646052225Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1694646052225Writing data manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1694646052228 (+3 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1694646052236 (+8 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1694646052242 (+6 ms) 2023-09-13 23:00:52,244 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=63, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-13 23:00:52,246 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=63, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 90 msec 2023-09-13 23:00:52,255 DEBUG [Listener at jenkins-hbase4.apache.org/37017] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-13 23:00:52,256 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-09-13 23:00:52,256 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-13 23:00:52,258 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42165] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,,1694646050996.e6660ca969b8a4cd6214cb091aafedf4. with WAL disabled. Data may be lost in the event of a crash. 2023-09-13 23:00:52,259 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34119] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,1,1694646050996.1906c1473c12e09b8836fb6168104d6a. with WAL disabled. Data may be lost in the event of a crash. 2023-09-13 23:00:52,262 DEBUG [Listener at jenkins-hbase4.apache.org/37017] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-09-13 23:00:52,262 DEBUG [Listener at jenkins-hbase4.apache.org/37017] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1694646050996.e6660ca969b8a4cd6214cb091aafedf4. 2023-09-13 23:00:52,262 INFO [Listener at jenkins-hbase4.apache.org/37017] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-13 23:00:52,271 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-13 23:00:52,271 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1694646052271 (current time:1694646052271). 2023-09-13 23:00:52,271 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-13 23:00:52,272 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] zookeeper.ReadOnlyZKClient(139): Connect 0x3f254e97 to 127.0.0.1:55012 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-13 23:00:52,279 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6023a6ae, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-13 23:00:52,280 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-13 23:00:52,282 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40896, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-13 23:00:52,283 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3f254e97 to 127.0.0.1:55012 2023-09-13 23:00:52,283 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-13 23:00:52,284 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] zookeeper.ReadOnlyZKClient(139): Connect 0x081339f4 to 127.0.0.1:55012 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-13 23:00:52,289 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1dd79f97, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-13 23:00:52,290 DEBUG [hconnection-0x603c4c55-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-13 23:00:52,293 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40902, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-13 23:00:52,296 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-13 23:00:52,298 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33384, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-13 23:00:52,299 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x081339f4 to 127.0.0.1:55012 2023-09-13 23:00:52,299 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-13 23:00:52,299 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-09-13 23:00:52,300 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-13 23:00:52,300 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-13 23:00:52,302 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] procedure2.ProcedureExecutor(1028): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-13 23:00:52,303 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-13 23:00:52,304 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1694646652304 2023-09-13 23:00:52,304 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-09-13 23:00:52,304 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-13 23:00:52,305 DEBUG [Listener at jenkins-hbase4.apache.org/37017] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-13 23:00:52,305 DEBUG [Listener at jenkins-hbase4.apache.org/37017] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-13 23:00:52,306 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-13 23:00:52,306 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-13 23:00:52,307 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 5 msec 2023-09-13 23:00:52,308 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-13 23:00:52,308 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=65, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1694646652308 2023-09-13 23:00:52,319 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 23:00:52,320 INFO [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' 2023-09-13 23:00:52,320 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-13 23:00:52,320 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-09-13 23:00:52,320 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-09-13 23:00:52,321 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 23:00:52,321 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 23:00:52,323 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34119,1694645979883 2023-09-13 23:00:52,323 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:34119-0x100a784b9ba0002, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 23:00:52,323 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:42165-0x100a784b9ba0003, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 23:00:52,323 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 23:00:52,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 23:00:52,323 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:39163-0x100a784b9ba0001, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 23:00:52,323 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34119,1694645979883 2023-09-13 23:00:52,323 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 23:00:52,323 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 23:00:52,323 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 23:00:52,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 23:00:52,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 23:00:52,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 23:00:52,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 23:00:52,324 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34119-0x100a784b9ba0002, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 23:00:52,324 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 23:00:52,324 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-13 23:00:52,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 23:00:52,324 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42165-0x100a784b9ba0003, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 23:00:52,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-09-13 23:00:52,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 23:00:52,324 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39163-0x100a784b9ba0001, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 23:00:52,324 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-13 23:00:52,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-09-13 23:00:52,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 23:00:52,325 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 23:00:52,325 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-13 23:00:52,325 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1694645979883' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-13 23:00:52,325 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1694645979883' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-13 23:00:52,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-09-13 23:00:52,326 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 23:00:52,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 23:00:52,326 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-13 23:00:52,326 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-13 23:00:52,326 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1694645979883' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-13 23:00:52,326 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-13 23:00:52,327 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-13 23:00:52,327 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-13 23:00:52,327 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42165,1694645979926' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-13 23:00:52,327 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1694645979883' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-13 23:00:52,327 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 23:00:52,327 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1694645979883' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34119,1694645979883' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-13 23:00:52,327 DEBUG [member: 'jenkins-hbase4.apache.org,39163,1694645979837' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-13 23:00:52,327 DEBUG [member: 'jenkins-hbase4.apache.org,39163,1694645979837' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-13 23:00:52,328 DEBUG [member: 'jenkins-hbase4.apache.org,39163,1694645979837' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-13 23:00:52,328 DEBUG [member: 'jenkins-hbase4.apache.org,39163,1694645979837' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-13 23:00:52,328 DEBUG [member: 'jenkins-hbase4.apache.org,39163,1694645979837' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39163,1694645979837' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-13 23:00:52,329 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 23:00:52,329 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 23:00:52,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 23:00:52,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-13 23:00:52,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-13 23:00:52,330 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34119,1694645979883 2023-09-13 23:00:52,330 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42165-0x100a784b9ba0003, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 23:00:52,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-13 23:00:52,330 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-13 23:00:52,330 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1694645979883' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 23:00:52,330 DEBUG [member: 'jenkins-hbase4.apache.org,39163,1694645979837' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 23:00:52,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-13 23:00:52,330 DEBUG [member: 'jenkins-hbase4.apache.org,39163,1694645979837' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39163-0x100a784b9ba0001, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 23:00:52,330 DEBUG [member: 'jenkins-hbase4.apache.org,39163,1694645979837' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-13 23:00:52,330 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1694645979883' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34119-0x100a784b9ba0002, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 23:00:52,330 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1694645979883' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-13 23:00:52,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 23:00:52,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34119,1694645979883 2023-09-13 23:00:52,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 23:00:52,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 23:00:52,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-13 23:00:52,332 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42165,1694645979926' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-09-13 23:00:52,332 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6cd399d2[Count = 1] remaining members to acquire global barrier 2023-09-13 23:00:52,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34119,1694645979883 2023-09-13 23:00:52,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-13 23:00:52,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-13 23:00:52,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-13 23:00:52,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-13 23:00:52,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 23:00:52,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34119,1694645979883 2023-09-13 23:00:52,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 23:00:52,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 23:00:52,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-13 23:00:52,333 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34119,1694645979883' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-09-13 23:00:52,333 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6cd399d2[Count = 0] remaining members to acquire global barrier 2023-09-13 23:00:52,333 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-09-13 23:00:52,334 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 23:00:52,335 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:42165-0x100a784b9ba0003, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 23:00:52,335 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:34119-0x100a784b9ba0002, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 23:00:52,335 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 23:00:52,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 23:00:52,335 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:39163-0x100a784b9ba0001, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 23:00:52,335 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-13 23:00:52,335 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 23:00:52,335 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 23:00:52,336 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-13 23:00:52,336 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-13 23:00:52,336 DEBUG [rs(jenkins-hbase4.apache.org,42165,1694645979926)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1694646050996.e6660ca969b8a4cd6214cb091aafedf4. 2023-09-13 23:00:52,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 23:00:52,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 23:00:52,336 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1694645979883' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-13 23:00:52,336 DEBUG [member: 'jenkins-hbase4.apache.org,39163,1694645979837' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-13 23:00:52,336 DEBUG [member: 'jenkins-hbase4.apache.org,39163,1694645979837' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-13 23:00:52,336 DEBUG [member: 'jenkins-hbase4.apache.org,39163,1694645979837' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,39163,1694645979837' in zk 2023-09-13 23:00:52,336 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1694645979883' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-13 23:00:52,336 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1694645979883' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-13 23:00:52,336 DEBUG [rs(jenkins-hbase4.apache.org,34119,1694645979883)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1694646050996.1906c1473c12e09b8836fb6168104d6a. 2023-09-13 23:00:52,335 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 23:00:52,336 DEBUG [rs(jenkins-hbase4.apache.org,34119,1694645979883)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1694646050996.1906c1473c12e09b8836fb6168104d6a. started... 2023-09-13 23:00:52,336 DEBUG [rs(jenkins-hbase4.apache.org,42165,1694645979926)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1694646050996.e6660ca969b8a4cd6214cb091aafedf4. started... 2023-09-13 23:00:52,336 INFO [rs(jenkins-hbase4.apache.org,42165,1694645979926)-snapshot-pool-0] regionserver.HRegion(2745): Flushing e6660ca969b8a4cd6214cb091aafedf4 1/1 column families, dataSize=266 B heapSize=832 B 2023-09-13 23:00:52,336 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34119,1694645979883 2023-09-13 23:00:52,336 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-13 23:00:52,336 INFO [rs(jenkins-hbase4.apache.org,34119,1694645979883)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 1906c1473c12e09b8836fb6168104d6a 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-09-13 23:00:52,343 DEBUG [member: 'jenkins-hbase4.apache.org,39163,1694645979837' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-13 23:00:52,343 DEBUG [member: 'jenkins-hbase4.apache.org,39163,1694645979837' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-13 23:00:52,343 DEBUG [member: 'jenkins-hbase4.apache.org,39163,1694645979837' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-13 23:00:52,354 INFO [rs(jenkins-hbase4.apache.org,42165,1694645979926)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230913a723b59c8aa4434fb3057e6e1a7f289f to hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230913a723b59c8aa4434fb3057e6e1a7f289f 2023-09-13 23:00:52,354 INFO [rs(jenkins-hbase4.apache.org,34119,1694645979883)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230913f02f1e40902441d2bcf16a4a58ea943b to hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230913f02f1e40902441d2bcf16a4a58ea943b 2023-09-13 23:00:52,367 INFO [rs(jenkins-hbase4.apache.org,42165,1694645979926)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=266, hasBloomFilter=true, into tmp file hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/default/testtb-testExportFileSystemStateWithMergeRegion/e6660ca969b8a4cd6214cb091aafedf4/.tmp/cf/939b0724c70648dd84053349513cac3a 2023-09-13 23:00:52,367 INFO [rs(jenkins-hbase4.apache.org,34119,1694645979883)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.0 K, hasBloomFilter=true, into tmp file hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/default/testtb-testExportFileSystemStateWithMergeRegion/1906c1473c12e09b8836fb6168104d6a/.tmp/cf/b40c7ea569f34267a1557fac147083ab 2023-09-13 23:00:52,372 DEBUG [rs(jenkins-hbase4.apache.org,42165,1694645979926)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/default/testtb-testExportFileSystemStateWithMergeRegion/e6660ca969b8a4cd6214cb091aafedf4/.tmp/cf/939b0724c70648dd84053349513cac3a as hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/default/testtb-testExportFileSystemStateWithMergeRegion/e6660ca969b8a4cd6214cb091aafedf4/cf/939b0724c70648dd84053349513cac3a 2023-09-13 23:00:52,372 DEBUG [rs(jenkins-hbase4.apache.org,34119,1694645979883)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/default/testtb-testExportFileSystemStateWithMergeRegion/1906c1473c12e09b8836fb6168104d6a/.tmp/cf/b40c7ea569f34267a1557fac147083ab as hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/default/testtb-testExportFileSystemStateWithMergeRegion/1906c1473c12e09b8836fb6168104d6a/cf/b40c7ea569f34267a1557fac147083ab 2023-09-13 23:00:52,377 INFO [rs(jenkins-hbase4.apache.org,42165,1694645979926)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/default/testtb-testExportFileSystemStateWithMergeRegion/e6660ca969b8a4cd6214cb091aafedf4/cf/939b0724c70648dd84053349513cac3a, entries=4, sequenceid=6, filesize=5.6 K 2023-09-13 23:00:52,377 INFO [rs(jenkins-hbase4.apache.org,42165,1694645979926)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for e6660ca969b8a4cd6214cb091aafedf4 in 41ms, sequenceid=6, compaction requested=false 2023-09-13 23:00:52,378 DEBUG [rs(jenkins-hbase4.apache.org,42165,1694645979926)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion' 2023-09-13 23:00:52,378 INFO [rs(jenkins-hbase4.apache.org,34119,1694645979883)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/default/testtb-testExportFileSystemStateWithMergeRegion/1906c1473c12e09b8836fb6168104d6a/cf/b40c7ea569f34267a1557fac147083ab, entries=46, sequenceid=6, filesize=13.3 K 2023-09-13 23:00:52,378 DEBUG [rs(jenkins-hbase4.apache.org,42165,1694645979926)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for e6660ca969b8a4cd6214cb091aafedf4: 2023-09-13 23:00:52,379 DEBUG [rs(jenkins-hbase4.apache.org,42165,1694645979926)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1694646050996.e6660ca969b8a4cd6214cb091aafedf4.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 23:00:52,379 DEBUG [rs(jenkins-hbase4.apache.org,42165,1694645979926)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-13 23:00:52,379 INFO [rs(jenkins-hbase4.apache.org,34119,1694645979883)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for 1906c1473c12e09b8836fb6168104d6a in 43ms, sequenceid=6, compaction requested=false 2023-09-13 23:00:52,379 DEBUG [rs(jenkins-hbase4.apache.org,42165,1694645979926)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/default/testtb-testExportFileSystemStateWithMergeRegion/e6660ca969b8a4cd6214cb091aafedf4/cf/939b0724c70648dd84053349513cac3a] hfiles 2023-09-13 23:00:52,380 DEBUG [rs(jenkins-hbase4.apache.org,34119,1694645979883)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 1906c1473c12e09b8836fb6168104d6a: 2023-09-13 23:00:52,380 DEBUG [rs(jenkins-hbase4.apache.org,42165,1694645979926)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/default/testtb-testExportFileSystemStateWithMergeRegion/e6660ca969b8a4cd6214cb091aafedf4/cf/939b0724c70648dd84053349513cac3a for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 23:00:52,380 DEBUG [rs(jenkins-hbase4.apache.org,34119,1694645979883)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1694646050996.1906c1473c12e09b8836fb6168104d6a.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 23:00:52,380 DEBUG [rs(jenkins-hbase4.apache.org,34119,1694645979883)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-13 23:00:52,381 DEBUG [rs(jenkins-hbase4.apache.org,34119,1694645979883)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/default/testtb-testExportFileSystemStateWithMergeRegion/1906c1473c12e09b8836fb6168104d6a/cf/b40c7ea569f34267a1557fac147083ab] hfiles 2023-09-13 23:00:52,381 DEBUG [rs(jenkins-hbase4.apache.org,34119,1694645979883)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/default/testtb-testExportFileSystemStateWithMergeRegion/1906c1473c12e09b8836fb6168104d6a/cf/b40c7ea569f34267a1557fac147083ab for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 23:00:52,388 DEBUG [rs(jenkins-hbase4.apache.org,42165,1694645979926)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1694646050996.e6660ca969b8a4cd6214cb091aafedf4. completed. 2023-09-13 23:00:52,388 DEBUG [rs(jenkins-hbase4.apache.org,34119,1694645979883)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1694646050996.1906c1473c12e09b8836fb6168104d6a. completed. 2023-09-13 23:00:52,388 DEBUG [rs(jenkins-hbase4.apache.org,42165,1694645979926)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1694646050996.e6660ca969b8a4cd6214cb091aafedf4. 2023-09-13 23:00:52,388 DEBUG [rs(jenkins-hbase4.apache.org,34119,1694645979883)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1694646050996.1906c1473c12e09b8836fb6168104d6a. 2023-09-13 23:00:52,388 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-13 23:00:52,388 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1694645979883' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-13 23:00:52,388 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1694645979883' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-13 23:00:52,388 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1694645979883' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34119,1694645979883 2023-09-13 23:00:52,388 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-13 23:00:52,389 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 23:00:52,389 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1694645979883' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-13 23:00:52,389 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-13 23:00:52,389 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,42165,1694645979926' in zk 2023-09-13 23:00:52,389 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1694645979883' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,34119,1694645979883' in zk 2023-09-13 23:00:52,391 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 23:00:52,391 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-13 23:00:52,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 23:00:52,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-13 23:00:52,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-13 23:00:52,391 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-13 23:00:52,391 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-13 23:00:52,392 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34119,1694645979883 2023-09-13 23:00:52,392 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1694645979883' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-13 23:00:52,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-13 23:00:52,392 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1694645979883' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-13 23:00:52,393 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1694645979883' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-13 23:00:52,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-13 23:00:52,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 23:00:52,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34119,1694645979883 2023-09-13 23:00:52,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 23:00:52,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 23:00:52,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-13 23:00:52,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 23:00:52,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34119,1694645979883 2023-09-13 23:00:52,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 23:00:52,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 23:00:52,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,42165,1694645979926': 2023-09-13 23:00:52,396 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42165,1694645979926' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-09-13 23:00:52,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34119,1694645979883 2023-09-13 23:00:52,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-13 23:00:52,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-13 23:00:52,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-13 23:00:52,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-13 23:00:52,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 23:00:52,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34119,1694645979883 2023-09-13 23:00:52,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 23:00:52,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 23:00:52,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-13 23:00:52,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 23:00:52,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34119,1694645979883 2023-09-13 23:00:52,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 23:00:52,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 23:00:52,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,34119,1694645979883': 2023-09-13 23:00:52,399 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34119,1694645979883' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-09-13 23:00:52,399 INFO [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-09-13 23:00:52,399 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-13 23:00:52,399 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-13 23:00:52,399 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 23:00:52,399 INFO [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-13 23:00:52,405 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:42165-0x100a784b9ba0003, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 23:00:52,405 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:39163-0x100a784b9ba0001, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 23:00:52,405 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 23:00:52,405 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:42165-0x100a784b9ba0003, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 23:00:52,405 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 23:00:52,405 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:34119-0x100a784b9ba0002, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 23:00:52,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 23:00:52,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-13 23:00:52,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-13 23:00:52,405 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 23:00:52,405 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:34119-0x100a784b9ba0002, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 23:00:52,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 23:00:52,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 23:00:52,405 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 23:00:52,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 23:00:52,405 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:39163-0x100a784b9ba0001, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 23:00:52,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-13 23:00:52,405 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34119,1694645979883 2023-09-13 23:00:52,405 DEBUG [Listener at jenkins-hbase4.apache.org/37017] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-13 23:00:52,406 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 23:00:52,406 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 23:00:52,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 23:00:52,406 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 23:00:52,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 23:00:52,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 23:00:52,406 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 23:00:52,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 23:00:52,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 23:00:52,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 23:00:52,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-13 23:00:52,407 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-09-13 23:00:52,407 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 23:00:52,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 23:00:52,407 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-09-13 23:00:52,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 23:00:52,407 DEBUG [Listener at jenkins-hbase4.apache.org/37017] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-13 23:00:52,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34119,1694645979883 2023-09-13 23:00:52,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 23:00:52,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 23:00:52,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-13 23:00:52,408 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34119,1694645979883 2023-09-13 23:00:52,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 23:00:52,408 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 23:00:52,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34119,1694645979883 2023-09-13 23:00:52,409 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 23:00:52,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 23:00:52,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 23:00:52,411 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 23:00:52,411 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 23:00:52,411 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:39163-0x100a784b9ba0001, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 23:00:52,411 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:42165-0x100a784b9ba0003, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 23:00:52,411 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:34119-0x100a784b9ba0002, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 23:00:52,412 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:42165-0x100a784b9ba0003, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 23:00:52,412 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 23:00:52,412 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-13 23:00:52,412 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 23:00:52,412 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 23:00:52,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 23:00:52,412 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:39163-0x100a784b9ba0001, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 23:00:52,412 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 23:00:52,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 23:00:52,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 23:00:52,412 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 23:00:52,412 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:34119-0x100a784b9ba0002, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 23:00:52,413 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-09-13 23:00:52,413 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 23:00:52,413 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 23:00:52,413 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 23:00:52,413 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34119,1694645979883 2023-09-13 23:00:52,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 23:00:52,414 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-13 23:00:52,414 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 23:00:52,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 23:00:52,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 23:00:52,414 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 23:00:52,414 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 23:00:52,414 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 23:00:52,414 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 23:00:52,414 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34119,1694645979883 2023-09-13 23:00:52,414 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 23:00:52,415 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 23:00:52,416 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230913f02f1e40902441d2bcf16a4a58ea943b, hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230913a723b59c8aa4434fb3057e6e1a7f289f] mob files 2023-09-13 23:00:52,416 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230913f02f1e40902441d2bcf16a4a58ea943b 2023-09-13 23:00:52,416 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230913a723b59c8aa4434fb3057e6e1a7f289f 2023-09-13 23:00:52,423 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 23:00:52,423 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 23:00:52,449 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 23:00:52,449 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-09-13 23:00:52,449 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 23:00:52,450 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 23:00:52,450 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1694646052304Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1694646052423 (+119 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1694646052423Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion at 1694646052423Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion at 1694646052426 (+3 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1694646052442 (+16 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1694646052449 (+7 ms) 2023-09-13 23:00:52,452 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=65, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-13 23:00:52,453 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=65, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 147 msec 2023-09-13 23:00:52,607 DEBUG [Listener at jenkins-hbase4.apache.org/37017] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-13 23:00:52,608 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-09-13 23:00:52,608 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-13 23:00:52,636 DEBUG [Listener at jenkins-hbase4.apache.org/37017] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-13 23:00:52,639 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53360, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-13 23:00:52,640 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34119] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-09-13 23:00:52,641 DEBUG [Listener at jenkins-hbase4.apache.org/37017] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-13 23:00:52,644 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33390, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-13 23:00:52,644 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39163] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-09-13 23:00:52,644 DEBUG [Listener at jenkins-hbase4.apache.org/37017] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-13 23:00:52,649 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40906, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-13 23:00:52,649 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42165] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-09-13 23:00:52,651 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-09-13 23:00:52,652 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] procedure2.ProcedureExecutor(1028): Stored pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-13 23:00:52,654 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_PRE_OPERATION 2023-09-13 23:00:52,654 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion-1" procId is: 66 2023-09-13 23:00:52,655 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-13 23:00:52,655 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-09-13 23:00:52,657 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a947fb4731004a75fb5f46a5db9e0680 2023-09-13 23:00:52,657 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ef2bb2f29c8ee0403af44695496c6a20 2023-09-13 23:00:52,657 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a947fb4731004a75fb5f46a5db9e0680 empty. 2023-09-13 23:00:52,657 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ef2bb2f29c8ee0403af44695496c6a20 empty. 2023-09-13 23:00:52,658 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a947fb4731004a75fb5f46a5db9e0680 2023-09-13 23:00:52,658 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ef2bb2f29c8ee0403af44695496c6a20 2023-09-13 23:00:52,658 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-09-13 23:00:52,667 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/.tabledesc/.tableinfo.0000000001 2023-09-13 23:00:52,668 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(7675): creating {ENCODED => a947fb4731004a75fb5f46a5db9e0680, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1694646052651.a947fb4731004a75fb5f46a5db9e0680.', STARTKEY => '', ENDKEY => '2'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.tmp 2023-09-13 23:00:52,668 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(7675): creating {ENCODED => ef2bb2f29c8ee0403af44695496c6a20, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1694646052651.ef2bb2f29c8ee0403af44695496c6a20.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.tmp 2023-09-13 23:00:52,675 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1694646052651.ef2bb2f29c8ee0403af44695496c6a20.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-13 23:00:52,675 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1604): Closing ef2bb2f29c8ee0403af44695496c6a20, disabling compactions & flushes 2023-09-13 23:00:52,675 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1694646052651.ef2bb2f29c8ee0403af44695496c6a20. 2023-09-13 23:00:52,675 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1694646052651.ef2bb2f29c8ee0403af44695496c6a20. 2023-09-13 23:00:52,675 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1694646052651.ef2bb2f29c8ee0403af44695496c6a20. after waiting 0 ms 2023-09-13 23:00:52,675 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1694646052651.ef2bb2f29c8ee0403af44695496c6a20. 2023-09-13 23:00:52,676 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1694646052651.ef2bb2f29c8ee0403af44695496c6a20. 2023-09-13 23:00:52,676 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1558): Region close journal for ef2bb2f29c8ee0403af44695496c6a20: 2023-09-13 23:00:52,676 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1694646052651.a947fb4731004a75fb5f46a5db9e0680.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-13 23:00:52,676 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1604): Closing a947fb4731004a75fb5f46a5db9e0680, disabling compactions & flushes 2023-09-13 23:00:52,676 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1694646052651.a947fb4731004a75fb5f46a5db9e0680. 2023-09-13 23:00:52,676 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1694646052651.a947fb4731004a75fb5f46a5db9e0680. 2023-09-13 23:00:52,676 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1694646052651.a947fb4731004a75fb5f46a5db9e0680. after waiting 0 ms 2023-09-13 23:00:52,676 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1694646052651.a947fb4731004a75fb5f46a5db9e0680. 2023-09-13 23:00:52,676 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1694646052651.a947fb4731004a75fb5f46a5db9e0680. 2023-09-13 23:00:52,676 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1558): Region close journal for a947fb4731004a75fb5f46a5db9e0680: 2023-09-13 23:00:52,678 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ADD_TO_META 2023-09-13 23:00:52,679 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1694646052651.ef2bb2f29c8ee0403af44695496c6a20.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1694646052679"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694646052679"}]},"ts":"1694646052679"} 2023-09-13 23:00:52,679 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1694646052651.a947fb4731004a75fb5f46a5db9e0680.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1694646052679"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694646052679"}]},"ts":"1694646052679"} 2023-09-13 23:00:52,681 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-13 23:00:52,682 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-13 23:00:52,682 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694646052682"}]},"ts":"1694646052682"} 2023-09-13 23:00:52,683 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLING in hbase:meta 2023-09-13 23:00:52,686 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-13 23:00:52,687 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-13 23:00:52,687 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-13 23:00:52,687 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-13 23:00:52,687 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-13 23:00:52,688 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=a947fb4731004a75fb5f46a5db9e0680, ASSIGN}, {pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=ef2bb2f29c8ee0403af44695496c6a20, ASSIGN}] 2023-09-13 23:00:52,690 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=a947fb4731004a75fb5f46a5db9e0680, ASSIGN 2023-09-13 23:00:52,690 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=ef2bb2f29c8ee0403af44695496c6a20, ASSIGN 2023-09-13 23:00:52,691 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=ef2bb2f29c8ee0403af44695496c6a20, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34119,1694645979883; forceNewPlan=false, retain=false 2023-09-13 23:00:52,691 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=a947fb4731004a75fb5f46a5db9e0680, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39163,1694645979837; forceNewPlan=false, retain=false 2023-09-13 23:00:52,756 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-09-13 23:00:52,841 INFO [jenkins-hbase4:36621] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-13 23:00:52,844 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=ef2bb2f29c8ee0403af44695496c6a20, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34119,1694645979883 2023-09-13 23:00:52,844 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=a947fb4731004a75fb5f46a5db9e0680, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 23:00:52,844 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1694646052651.ef2bb2f29c8ee0403af44695496c6a20.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1694646052844"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694646052844"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694646052844"}]},"ts":"1694646052844"} 2023-09-13 23:00:52,844 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1694646052651.a947fb4731004a75fb5f46a5db9e0680.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1694646052844"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694646052844"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694646052844"}]},"ts":"1694646052844"} 2023-09-13 23:00:52,846 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=69, ppid=68, state=RUNNABLE; OpenRegionProcedure ef2bb2f29c8ee0403af44695496c6a20, server=jenkins-hbase4.apache.org,34119,1694645979883}] 2023-09-13 23:00:52,847 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=70, ppid=67, state=RUNNABLE; OpenRegionProcedure a947fb4731004a75fb5f46a5db9e0680, server=jenkins-hbase4.apache.org,39163,1694645979837}] 2023-09-13 23:00:52,957 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-09-13 23:00:53,002 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,2,1694646052651.ef2bb2f29c8ee0403af44695496c6a20. 2023-09-13 23:00:53,002 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => ef2bb2f29c8ee0403af44695496c6a20, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1694646052651.ef2bb2f29c8ee0403af44695496c6a20.', STARTKEY => '2', ENDKEY => ''} 2023-09-13 23:00:53,004 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,2,1694646052651.ef2bb2f29c8ee0403af44695496c6a20. service=AccessControlService 2023-09-13 23:00:53,004 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-13 23:00:53,004 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 ef2bb2f29c8ee0403af44695496c6a20 2023-09-13 23:00:53,004 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1694646052651.ef2bb2f29c8ee0403af44695496c6a20.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-13 23:00:53,005 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for ef2bb2f29c8ee0403af44695496c6a20 2023-09-13 23:00:53,005 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for ef2bb2f29c8ee0403af44695496c6a20 2023-09-13 23:00:53,005 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1694646052651.a947fb4731004a75fb5f46a5db9e0680. 2023-09-13 23:00:53,005 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => a947fb4731004a75fb5f46a5db9e0680, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1694646052651.a947fb4731004a75fb5f46a5db9e0680.', STARTKEY => '', ENDKEY => '2'} 2023-09-13 23:00:53,006 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1694646052651.a947fb4731004a75fb5f46a5db9e0680. service=AccessControlService 2023-09-13 23:00:53,006 INFO [StoreOpener-ef2bb2f29c8ee0403af44695496c6a20-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region ef2bb2f29c8ee0403af44695496c6a20 2023-09-13 23:00:53,006 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-13 23:00:53,006 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 a947fb4731004a75fb5f46a5db9e0680 2023-09-13 23:00:53,006 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1694646052651.a947fb4731004a75fb5f46a5db9e0680.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-13 23:00:53,006 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for a947fb4731004a75fb5f46a5db9e0680 2023-09-13 23:00:53,006 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for a947fb4731004a75fb5f46a5db9e0680 2023-09-13 23:00:53,007 DEBUG [StoreOpener-ef2bb2f29c8ee0403af44695496c6a20-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ef2bb2f29c8ee0403af44695496c6a20/cf 2023-09-13 23:00:53,007 DEBUG [StoreOpener-ef2bb2f29c8ee0403af44695496c6a20-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ef2bb2f29c8ee0403af44695496c6a20/cf 2023-09-13 23:00:53,007 INFO [StoreOpener-a947fb4731004a75fb5f46a5db9e0680-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region a947fb4731004a75fb5f46a5db9e0680 2023-09-13 23:00:53,008 INFO [StoreOpener-ef2bb2f29c8ee0403af44695496c6a20-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ef2bb2f29c8ee0403af44695496c6a20 columnFamilyName cf 2023-09-13 23:00:53,008 INFO [StoreOpener-ef2bb2f29c8ee0403af44695496c6a20-1] regionserver.HStore(310): Store=ef2bb2f29c8ee0403af44695496c6a20/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-13 23:00:53,009 DEBUG [StoreOpener-a947fb4731004a75fb5f46a5db9e0680-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a947fb4731004a75fb5f46a5db9e0680/cf 2023-09-13 23:00:53,009 DEBUG [StoreOpener-a947fb4731004a75fb5f46a5db9e0680-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a947fb4731004a75fb5f46a5db9e0680/cf 2023-09-13 23:00:53,009 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ef2bb2f29c8ee0403af44695496c6a20 2023-09-13 23:00:53,009 INFO [StoreOpener-a947fb4731004a75fb5f46a5db9e0680-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a947fb4731004a75fb5f46a5db9e0680 columnFamilyName cf 2023-09-13 23:00:53,009 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ef2bb2f29c8ee0403af44695496c6a20 2023-09-13 23:00:53,010 INFO [StoreOpener-a947fb4731004a75fb5f46a5db9e0680-1] regionserver.HStore(310): Store=a947fb4731004a75fb5f46a5db9e0680/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-13 23:00:53,010 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a947fb4731004a75fb5f46a5db9e0680 2023-09-13 23:00:53,011 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a947fb4731004a75fb5f46a5db9e0680 2023-09-13 23:00:53,012 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for ef2bb2f29c8ee0403af44695496c6a20 2023-09-13 23:00:53,013 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for a947fb4731004a75fb5f46a5db9e0680 2023-09-13 23:00:53,014 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ef2bb2f29c8ee0403af44695496c6a20/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-13 23:00:53,014 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened ef2bb2f29c8ee0403af44695496c6a20; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73556566, jitterRate=0.09607824683189392}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-13 23:00:53,014 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for ef2bb2f29c8ee0403af44695496c6a20: 2023-09-13 23:00:53,015 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,2,1694646052651.ef2bb2f29c8ee0403af44695496c6a20., pid=69, masterSystemTime=1694646052997 2023-09-13 23:00:53,015 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a947fb4731004a75fb5f46a5db9e0680/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-13 23:00:53,016 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened a947fb4731004a75fb5f46a5db9e0680; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73098140, jitterRate=0.08924716711044312}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-13 23:00:53,016 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for a947fb4731004a75fb5f46a5db9e0680: 2023-09-13 23:00:53,016 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1694646052651.a947fb4731004a75fb5f46a5db9e0680., pid=70, masterSystemTime=1694646053000 2023-09-13 23:00:53,016 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,2,1694646052651.ef2bb2f29c8ee0403af44695496c6a20. 2023-09-13 23:00:53,017 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,2,1694646052651.ef2bb2f29c8ee0403af44695496c6a20. 2023-09-13 23:00:53,017 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=ef2bb2f29c8ee0403af44695496c6a20, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34119,1694645979883 2023-09-13 23:00:53,017 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1694646052651.ef2bb2f29c8ee0403af44695496c6a20.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1694646053017"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1694646053017"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1694646053017"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1694646053017"}]},"ts":"1694646053017"} 2023-09-13 23:00:53,018 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1694646052651.a947fb4731004a75fb5f46a5db9e0680. 2023-09-13 23:00:53,018 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1694646052651.a947fb4731004a75fb5f46a5db9e0680. 2023-09-13 23:00:53,018 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=a947fb4731004a75fb5f46a5db9e0680, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 23:00:53,018 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1694646052651.a947fb4731004a75fb5f46a5db9e0680.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1694646053018"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1694646053018"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1694646053018"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1694646053018"}]},"ts":"1694646053018"} 2023-09-13 23:00:53,021 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=69, resume processing ppid=68 2023-09-13 23:00:53,021 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=69, ppid=68, state=SUCCESS; OpenRegionProcedure ef2bb2f29c8ee0403af44695496c6a20, server=jenkins-hbase4.apache.org,34119,1694645979883 in 173 msec 2023-09-13 23:00:53,021 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=70, resume processing ppid=67 2023-09-13 23:00:53,021 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=70, ppid=67, state=SUCCESS; OpenRegionProcedure a947fb4731004a75fb5f46a5db9e0680, server=jenkins-hbase4.apache.org,39163,1694645979837 in 172 msec 2023-09-13 23:00:53,022 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=68, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=ef2bb2f29c8ee0403af44695496c6a20, ASSIGN in 333 msec 2023-09-13 23:00:53,023 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=67, resume processing ppid=66 2023-09-13 23:00:53,023 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=a947fb4731004a75fb5f46a5db9e0680, ASSIGN in 333 msec 2023-09-13 23:00:53,024 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-13 23:00:53,024 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694646053024"}]},"ts":"1694646053024"} 2023-09-13 23:00:53,025 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLED in hbase:meta 2023-09-13 23:00:53,033 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_POST_OPERATION 2023-09-13 23:00:53,033 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion-1 jenkins: RWXCA 2023-09-13 23:00:53,035 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39163] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-09-13 23:00:53,036 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:42165-0x100a784b9ba0003, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-13 23:00:53,036 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-13 23:00:53,036 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:34119-0x100a784b9ba0002, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-13 23:00:53,036 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:39163-0x100a784b9ba0001, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-13 23:00:53,038 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-13 23:00:53,039 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-09-13 23:00:53,039 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-13 23:00:53,039 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-13 23:00:53,039 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-13 23:00:53,039 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-09-13 23:00:53,039 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-09-13 23:00:53,039 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-09-13 23:00:53,040 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=66, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 387 msec 2023-09-13 23:00:53,258 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-09-13 23:00:53,259 INFO [Listener at jenkins-hbase4.apache.org/37017] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 66 completed 2023-09-13 23:00:53,280 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] master.HMaster$2(1952): Client=jenkins//172.31.14.131 merge regions a947fb4731004a75fb5f46a5db9e0680, ef2bb2f29c8ee0403af44695496c6a20 2023-09-13 23:00:53,288 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] procedure2.ProcedureExecutor(1028): Stored pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[a947fb4731004a75fb5f46a5db9e0680, ef2bb2f29c8ee0403af44695496c6a20], force=true 2023-09-13 23:00:53,290 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[a947fb4731004a75fb5f46a5db9e0680, ef2bb2f29c8ee0403af44695496c6a20], force=true 2023-09-13 23:00:53,290 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[a947fb4731004a75fb5f46a5db9e0680, ef2bb2f29c8ee0403af44695496c6a20], force=true 2023-09-13 23:00:53,290 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[a947fb4731004a75fb5f46a5db9e0680, ef2bb2f29c8ee0403af44695496c6a20], force=true 2023-09-13 23:00:53,292 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-09-13 23:00:53,311 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=a947fb4731004a75fb5f46a5db9e0680, UNASSIGN}, {pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=ef2bb2f29c8ee0403af44695496c6a20, UNASSIGN}] 2023-09-13 23:00:53,313 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=a947fb4731004a75fb5f46a5db9e0680, UNASSIGN 2023-09-13 23:00:53,313 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=ef2bb2f29c8ee0403af44695496c6a20, UNASSIGN 2023-09-13 23:00:53,314 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=ef2bb2f29c8ee0403af44695496c6a20, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34119,1694645979883 2023-09-13 23:00:53,314 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=a947fb4731004a75fb5f46a5db9e0680, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 23:00:53,314 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1694646052651.ef2bb2f29c8ee0403af44695496c6a20.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1694646053314"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694646053314"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694646053314"}]},"ts":"1694646053314"} 2023-09-13 23:00:53,314 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1694646052651.a947fb4731004a75fb5f46a5db9e0680.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1694646053314"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694646053314"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694646053314"}]},"ts":"1694646053314"} 2023-09-13 23:00:53,316 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=74, ppid=73, state=RUNNABLE; CloseRegionProcedure ef2bb2f29c8ee0403af44695496c6a20, server=jenkins-hbase4.apache.org,34119,1694645979883}] 2023-09-13 23:00:53,317 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=75, ppid=72, state=RUNNABLE; CloseRegionProcedure a947fb4731004a75fb5f46a5db9e0680, server=jenkins-hbase4.apache.org,39163,1694645979837}] 2023-09-13 23:00:53,393 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-09-13 23:00:53,468 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close ef2bb2f29c8ee0403af44695496c6a20 2023-09-13 23:00:53,470 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing ef2bb2f29c8ee0403af44695496c6a20, disabling compactions & flushes 2023-09-13 23:00:53,470 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1694646052651.ef2bb2f29c8ee0403af44695496c6a20. 2023-09-13 23:00:53,470 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1694646052651.ef2bb2f29c8ee0403af44695496c6a20. 2023-09-13 23:00:53,470 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1694646052651.ef2bb2f29c8ee0403af44695496c6a20. after waiting 0 ms 2023-09-13 23:00:53,470 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1694646052651.ef2bb2f29c8ee0403af44695496c6a20. 2023-09-13 23:00:53,470 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing ef2bb2f29c8ee0403af44695496c6a20 1/1 column families, dataSize=24 B heapSize=352 B 2023-09-13 23:00:53,470 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close a947fb4731004a75fb5f46a5db9e0680 2023-09-13 23:00:53,471 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing a947fb4731004a75fb5f46a5db9e0680, disabling compactions & flushes 2023-09-13 23:00:53,472 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1694646052651.a947fb4731004a75fb5f46a5db9e0680. 2023-09-13 23:00:53,472 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1694646052651.a947fb4731004a75fb5f46a5db9e0680. 2023-09-13 23:00:53,472 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1694646052651.a947fb4731004a75fb5f46a5db9e0680. after waiting 0 ms 2023-09-13 23:00:53,472 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1694646052651.a947fb4731004a75fb5f46a5db9e0680. 2023-09-13 23:00:53,472 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing a947fb4731004a75fb5f46a5db9e0680 1/1 column families, dataSize=24 B heapSize=352 B 2023-09-13 23:00:53,482 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a947fb4731004a75fb5f46a5db9e0680/.tmp/cf/f81b8e78bdc4460aaf405efec9e8a579 2023-09-13 23:00:53,483 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ef2bb2f29c8ee0403af44695496c6a20/.tmp/cf/143d4e1048344664ab707906ccd6a7f0 2023-09-13 23:00:53,489 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ef2bb2f29c8ee0403af44695496c6a20/.tmp/cf/143d4e1048344664ab707906ccd6a7f0 as hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ef2bb2f29c8ee0403af44695496c6a20/cf/143d4e1048344664ab707906ccd6a7f0 2023-09-13 23:00:53,489 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a947fb4731004a75fb5f46a5db9e0680/.tmp/cf/f81b8e78bdc4460aaf405efec9e8a579 as hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a947fb4731004a75fb5f46a5db9e0680/cf/f81b8e78bdc4460aaf405efec9e8a579 2023-09-13 23:00:53,494 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ef2bb2f29c8ee0403af44695496c6a20/cf/143d4e1048344664ab707906ccd6a7f0, entries=1, sequenceid=5, filesize=4.7 K 2023-09-13 23:00:53,494 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a947fb4731004a75fb5f46a5db9e0680/cf/f81b8e78bdc4460aaf405efec9e8a579, entries=1, sequenceid=5, filesize=4.7 K 2023-09-13 23:00:53,495 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for ef2bb2f29c8ee0403af44695496c6a20 in 25ms, sequenceid=5, compaction requested=false 2023-09-13 23:00:53,495 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion-1' 2023-09-13 23:00:53,495 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for a947fb4731004a75fb5f46a5db9e0680 in 23ms, sequenceid=5, compaction requested=false 2023-09-13 23:00:53,495 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion-1' 2023-09-13 23:00:53,504 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a947fb4731004a75fb5f46a5db9e0680/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-09-13 23:00:53,504 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ef2bb2f29c8ee0403af44695496c6a20/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-09-13 23:00:53,505 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-13 23:00:53,505 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-13 23:00:53,505 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1694646052651.a947fb4731004a75fb5f46a5db9e0680. 2023-09-13 23:00:53,505 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for a947fb4731004a75fb5f46a5db9e0680: 2023-09-13 23:00:53,505 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1694646052651.ef2bb2f29c8ee0403af44695496c6a20. 2023-09-13 23:00:53,505 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for ef2bb2f29c8ee0403af44695496c6a20: 2023-09-13 23:00:53,506 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed a947fb4731004a75fb5f46a5db9e0680 2023-09-13 23:00:53,507 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=a947fb4731004a75fb5f46a5db9e0680, regionState=CLOSED 2023-09-13 23:00:53,507 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed ef2bb2f29c8ee0403af44695496c6a20 2023-09-13 23:00:53,507 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1694646052651.a947fb4731004a75fb5f46a5db9e0680.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1694646053507"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694646053507"}]},"ts":"1694646053507"} 2023-09-13 23:00:53,507 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=ef2bb2f29c8ee0403af44695496c6a20, regionState=CLOSED 2023-09-13 23:00:53,507 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1694646052651.ef2bb2f29c8ee0403af44695496c6a20.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1694646053507"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694646053507"}]},"ts":"1694646053507"} 2023-09-13 23:00:53,510 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=75, resume processing ppid=72 2023-09-13 23:00:53,510 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=75, ppid=72, state=SUCCESS; CloseRegionProcedure a947fb4731004a75fb5f46a5db9e0680, server=jenkins-hbase4.apache.org,39163,1694645979837 in 191 msec 2023-09-13 23:00:53,510 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=74, resume processing ppid=73 2023-09-13 23:00:53,510 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=74, ppid=73, state=SUCCESS; CloseRegionProcedure ef2bb2f29c8ee0403af44695496c6a20, server=jenkins-hbase4.apache.org,34119,1694645979883 in 193 msec 2023-09-13 23:00:53,511 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=a947fb4731004a75fb5f46a5db9e0680, UNASSIGN in 202 msec 2023-09-13 23:00:53,512 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=73, resume processing ppid=71 2023-09-13 23:00:53,512 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=73, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=ef2bb2f29c8ee0403af44695496c6a20, UNASSIGN in 199 msec 2023-09-13 23:00:53,558 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2399ce741225bd1e61edf4463adc70f4/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=-1 2023-09-13 23:00:53,560 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1694646052651.a947fb4731004a75fb5f46a5db9e0680.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-09-13 23:00:53,560 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1694646052651.ef2bb2f29c8ee0403af44695496c6a20.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-09-13 23:00:53,560 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":7,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1694646052652.2399ce741225bd1e61edf4463adc70f4.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0000","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0001","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-09-13 23:00:53,595 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-09-13 23:00:53,616 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=2399ce741225bd1e61edf4463adc70f4, ASSIGN}] 2023-09-13 23:00:53,617 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=2399ce741225bd1e61edf4463adc70f4, ASSIGN 2023-09-13 23:00:53,618 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=2399ce741225bd1e61edf4463adc70f4, ASSIGN; state=MERGED, location=jenkins-hbase4.apache.org,39163,1694645979837; forceNewPlan=false, retain=false 2023-09-13 23:00:53,768 INFO [jenkins-hbase4:36621] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-09-13 23:00:53,770 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=2399ce741225bd1e61edf4463adc70f4, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 23:00:53,770 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1694646052652.2399ce741225bd1e61edf4463adc70f4.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1694646053770"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694646053770"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694646053770"}]},"ts":"1694646053770"} 2023-09-13 23:00:53,772 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; OpenRegionProcedure 2399ce741225bd1e61edf4463adc70f4, server=jenkins-hbase4.apache.org,39163,1694645979837}] 2023-09-13 23:00:53,896 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-09-13 23:00:53,927 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1694646052652.2399ce741225bd1e61edf4463adc70f4. 2023-09-13 23:00:53,927 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 2399ce741225bd1e61edf4463adc70f4, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1694646052652.2399ce741225bd1e61edf4463adc70f4.', STARTKEY => '', ENDKEY => ''} 2023-09-13 23:00:53,928 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1694646052652.2399ce741225bd1e61edf4463adc70f4. service=AccessControlService 2023-09-13 23:00:53,928 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-13 23:00:53,928 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 2399ce741225bd1e61edf4463adc70f4 2023-09-13 23:00:53,928 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1694646052652.2399ce741225bd1e61edf4463adc70f4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-13 23:00:53,928 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 2399ce741225bd1e61edf4463adc70f4 2023-09-13 23:00:53,928 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 2399ce741225bd1e61edf4463adc70f4 2023-09-13 23:00:53,929 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(950): Rewriting .regioninfo file at: hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2399ce741225bd1e61edf4463adc70f4/.regioninfo 2023-09-13 23:00:53,937 INFO [StoreOpener-2399ce741225bd1e61edf4463adc70f4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 2399ce741225bd1e61edf4463adc70f4 2023-09-13 23:00:53,938 DEBUG [StoreOpener-2399ce741225bd1e61edf4463adc70f4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2399ce741225bd1e61edf4463adc70f4/cf 2023-09-13 23:00:53,938 DEBUG [StoreOpener-2399ce741225bd1e61edf4463adc70f4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2399ce741225bd1e61edf4463adc70f4/cf 2023-09-13 23:00:53,938 INFO [StoreOpener-2399ce741225bd1e61edf4463adc70f4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2399ce741225bd1e61edf4463adc70f4 columnFamilyName cf 2023-09-13 23:00:53,966 DEBUG [StoreOpener-2399ce741225bd1e61edf4463adc70f4-1] regionserver.HStore(539): loaded hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2399ce741225bd1e61edf4463adc70f4/cf/143d4e1048344664ab707906ccd6a7f0.ef2bb2f29c8ee0403af44695496c6a20->hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ef2bb2f29c8ee0403af44695496c6a20/cf/143d4e1048344664ab707906ccd6a7f0-top 2023-09-13 23:00:53,971 DEBUG [StoreOpener-2399ce741225bd1e61edf4463adc70f4-1] regionserver.HStore(539): loaded hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2399ce741225bd1e61edf4463adc70f4/cf/f81b8e78bdc4460aaf405efec9e8a579.a947fb4731004a75fb5f46a5db9e0680->hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a947fb4731004a75fb5f46a5db9e0680/cf/f81b8e78bdc4460aaf405efec9e8a579-top 2023-09-13 23:00:53,972 INFO [StoreOpener-2399ce741225bd1e61edf4463adc70f4-1] regionserver.HStore(310): Store=2399ce741225bd1e61edf4463adc70f4/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-13 23:00:53,973 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2399ce741225bd1e61edf4463adc70f4 2023-09-13 23:00:53,974 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2399ce741225bd1e61edf4463adc70f4 2023-09-13 23:00:53,977 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 2399ce741225bd1e61edf4463adc70f4 2023-09-13 23:00:53,978 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 2399ce741225bd1e61edf4463adc70f4; next sequenceid=9; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75365921, jitterRate=0.12303973734378815}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-13 23:00:53,978 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 2399ce741225bd1e61edf4463adc70f4: 2023-09-13 23:00:53,979 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1694646052652.2399ce741225bd1e61edf4463adc70f4., pid=77, masterSystemTime=1694646053924 2023-09-13 23:00:53,980 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(328): Ignoring compaction request for testtb-testExportFileSystemStateWithMergeRegion-1,,1694646052652.2399ce741225bd1e61edf4463adc70f4.,because compaction is disabled. 2023-09-13 23:00:53,981 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1694646052652.2399ce741225bd1e61edf4463adc70f4. 2023-09-13 23:00:53,981 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1694646052652.2399ce741225bd1e61edf4463adc70f4. 2023-09-13 23:00:53,981 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=2399ce741225bd1e61edf4463adc70f4, regionState=OPEN, openSeqNum=9, regionLocation=jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 23:00:53,982 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1694646052652.2399ce741225bd1e61edf4463adc70f4.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1694646053981"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1694646053981"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1694646053981"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1694646053981"}]},"ts":"1694646053981"} 2023-09-13 23:00:53,985 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=77, resume processing ppid=76 2023-09-13 23:00:53,985 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=77, ppid=76, state=SUCCESS; OpenRegionProcedure 2399ce741225bd1e61edf4463adc70f4, server=jenkins-hbase4.apache.org,39163,1694645979837 in 211 msec 2023-09-13 23:00:53,986 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=76, resume processing ppid=71 2023-09-13 23:00:53,986 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=76, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=2399ce741225bd1e61edf4463adc70f4, ASSIGN in 369 msec 2023-09-13 23:00:53,987 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=71, state=SUCCESS; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[a947fb4731004a75fb5f46a5db9e0680, ef2bb2f29c8ee0403af44695496c6a20], force=true in 703 msec 2023-09-13 23:00:54,397 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-09-13 23:00:54,397 INFO [Listener at jenkins-hbase4.apache.org/37017] client.HBaseAdmin$TableFuture(3541): Operation: MERGE_REGIONS, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 71 completed 2023-09-13 23:00:54,398 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-09-13 23:00:54,398 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1694646054398 (current time:1694646054398). 2023-09-13 23:00:54,398 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-13 23:00:54,399 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] zookeeper.ReadOnlyZKClient(139): Connect 0x4df50384 to 127.0.0.1:55012 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-13 23:00:54,405 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4bedabd3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-13 23:00:54,406 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-13 23:00:54,409 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40910, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-13 23:00:54,410 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4df50384 to 127.0.0.1:55012 2023-09-13 23:00:54,410 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-13 23:00:54,411 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] zookeeper.ReadOnlyZKClient(139): Connect 0x56b116c6 to 127.0.0.1:55012 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-13 23:00:54,416 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@333dc6b7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-13 23:00:54,417 DEBUG [hconnection-0x15285030-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-13 23:00:54,420 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40912, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-13 23:00:54,424 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-13 23:00:54,426 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33402, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-13 23:00:54,427 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x56b116c6 to 127.0.0.1:55012 2023-09-13 23:00:54,427 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-13 23:00:54,427 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-09-13 23:00:54,428 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-13 23:00:54,428 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-09-13 23:00:54,430 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] procedure2.ProcedureExecutor(1028): Stored pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-09-13 23:00:54,431 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-09-13 23:00:54,431 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=78, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE; timeout=600000, timestamp=1694646654431 2023-09-13 23:00:54,431 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-09-13 23:00:54,431 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-13 23:00:54,435 DEBUG [Listener at jenkins-hbase4.apache.org/37017] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-13 23:00:54,435 DEBUG [Listener at jenkins-hbase4.apache.org/37017] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-13 23:00:54,436 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=78, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-09-13 23:00:54,436 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-09-13 23:00:54,437 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=78, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE in 7 msec 2023-09-13 23:00:54,437 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-09-13 23:00:54,438 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=79, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED; timeout=600000, timestamp=1694646654438 2023-09-13 23:00:54,447 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-13 23:00:54,447 INFO [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' 2023-09-13 23:00:54,447 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-13 23:00:54,449 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' 2023-09-13 23:00:54,449 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1', kicking off acquire phase on members. 2023-09-13 23:00:54,449 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-13 23:00:54,449 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-13 23:00:54,451 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:34119-0x100a784b9ba0002, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 23:00:54,451 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:42165-0x100a784b9ba0003, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 23:00:54,451 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 23:00:54,451 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 23:00:54,451 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:39163-0x100a784b9ba0001, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 23:00:54,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 23:00:54,451 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 23:00:54,451 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 23:00:54,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 23:00:54,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 23:00:54,451 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 23:00:54,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-13 23:00:54,451 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-13 23:00:54,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-13 23:00:54,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-13 23:00:54,452 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34119-0x100a784b9ba0002, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-13 23:00:54,452 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39163-0x100a784b9ba0001, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-13 23:00:54,452 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42165-0x100a784b9ba0003, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-13 23:00:54,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-09-13 23:00:54,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-13 23:00:54,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-09-13 23:00:54,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-09-13 23:00:54,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-13 23:00:54,452 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-09-13 23:00:54,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-13 23:00:54,452 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-09-13 23:00:54,452 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-09-13 23:00:54,452 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-13 23:00:54,452 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1694645979883' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-09-13 23:00:54,453 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-13 23:00:54,453 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-13 23:00:54,453 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-09-13 23:00:54,453 DEBUG [member: 'jenkins-hbase4.apache.org,39163,1694645979837' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-09-13 23:00:54,453 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-13 23:00:54,453 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1694645979883' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-13 23:00:54,454 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-09-13 23:00:54,455 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1694645979883' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-09-13 23:00:54,455 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1694645979883' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-09-13 23:00:54,453 DEBUG [member: 'jenkins-hbase4.apache.org,39163,1694645979837' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-13 23:00:54,455 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1694645979883' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34119,1694645979883' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-09-13 23:00:54,455 DEBUG [member: 'jenkins-hbase4.apache.org,39163,1694645979837' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-09-13 23:00:54,456 DEBUG [member: 'jenkins-hbase4.apache.org,39163,1694645979837' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-09-13 23:00:54,456 DEBUG [member: 'jenkins-hbase4.apache.org,39163,1694645979837' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39163,1694645979837' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-09-13 23:00:54,455 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-09-13 23:00:54,456 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42165,1694645979926' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-09-13 23:00:54,457 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1694645979883' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-13 23:00:54,459 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-13 23:00:54,459 DEBUG [member: 'jenkins-hbase4.apache.org,39163,1694645979837' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-13 23:00:54,459 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 23:00:54,459 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1694645979883' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34119-0x100a784b9ba0002, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-13 23:00:54,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 23:00:54,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-13 23:00:54,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-13 23:00:54,459 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1694645979883' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-13 23:00:54,459 DEBUG [member: 'jenkins-hbase4.apache.org,39163,1694645979837' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39163-0x100a784b9ba0001, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-13 23:00:54,459 DEBUG [member: 'jenkins-hbase4.apache.org,39163,1694645979837' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-13 23:00:54,459 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42165-0x100a784b9ba0003, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-13 23:00:54,459 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-13 23:00:54,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-13 23:00:54,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-13 23:00:54,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-13 23:00:54,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34119,1694645979883 2023-09-13 23:00:54,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 23:00:54,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 23:00:54,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-13 23:00:54,462 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39163,1694645979837' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' on coordinator 2023-09-13 23:00:54,462 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@75a73f04[Count = 0] remaining members to acquire global barrier 2023-09-13 23:00:54,462 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'in-barrier' execution. 2023-09-13 23:00:54,462 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-13 23:00:54,463 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:34119-0x100a784b9ba0002, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-13 23:00:54,463 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:39163-0x100a784b9ba0001, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-13 23:00:54,463 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-13 23:00:54,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-13 23:00:54,463 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:42165-0x100a784b9ba0003, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-13 23:00:54,463 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1694645979883' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-09-13 23:00:54,463 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 23:00:54,463 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-13 23:00:54,463 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1694645979883' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-09-13 23:00:54,463 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-13 23:00:54,463 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-13 23:00:54,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-13 23:00:54,463 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1694645979883' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,34119,1694645979883' in zk 2023-09-13 23:00:54,464 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-09-13 23:00:54,464 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-09-13 23:00:54,464 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,42165,1694645979926' in zk 2023-09-13 23:00:54,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-13 23:00:54,464 DEBUG [member: 'jenkins-hbase4.apache.org,39163,1694645979837' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-09-13 23:00:54,464 DEBUG [member: 'jenkins-hbase4.apache.org,39163,1694645979837' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-13 23:00:54,464 DEBUG [member: 'jenkins-hbase4.apache.org,39163,1694645979837' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-13 23:00:54,464 DEBUG [rs(jenkins-hbase4.apache.org,39163,1694645979837)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1694646052652.2399ce741225bd1e61edf4463adc70f4. 2023-09-13 23:00:54,464 DEBUG [rs(jenkins-hbase4.apache.org,39163,1694645979837)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1694646052652.2399ce741225bd1e61edf4463adc70f4. started... 2023-09-13 23:00:54,465 DEBUG [rs(jenkins-hbase4.apache.org,39163,1694645979837)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 2399ce741225bd1e61edf4463adc70f4: 2023-09-13 23:00:54,465 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1694645979883' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-09-13 23:00:54,465 DEBUG [rs(jenkins-hbase4.apache.org,39163,1694645979837)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion-1,,1694646052652.2399ce741225bd1e61edf4463adc70f4.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-13 23:00:54,465 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1694645979883' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-13 23:00:54,465 DEBUG [rs(jenkins-hbase4.apache.org,39163,1694645979837)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-13 23:00:54,465 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1694645979883' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-09-13 23:00:54,466 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-09-13 23:00:54,466 DEBUG [rs(jenkins-hbase4.apache.org,39163,1694645979837)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2399ce741225bd1e61edf4463adc70f4/cf/143d4e1048344664ab707906ccd6a7f0.ef2bb2f29c8ee0403af44695496c6a20->hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ef2bb2f29c8ee0403af44695496c6a20/cf/143d4e1048344664ab707906ccd6a7f0-top, hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2399ce741225bd1e61edf4463adc70f4/cf/f81b8e78bdc4460aaf405efec9e8a579.a947fb4731004a75fb5f46a5db9e0680->hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a947fb4731004a75fb5f46a5db9e0680/cf/f81b8e78bdc4460aaf405efec9e8a579-top] hfiles 2023-09-13 23:00:54,466 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-13 23:00:54,467 DEBUG [rs(jenkins-hbase4.apache.org,39163,1694645979837)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/2): hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2399ce741225bd1e61edf4463adc70f4/cf/143d4e1048344664ab707906ccd6a7f0.ef2bb2f29c8ee0403af44695496c6a20 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-13 23:00:54,467 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-09-13 23:00:54,470 DEBUG [rs(jenkins-hbase4.apache.org,39163,1694645979837)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/2): hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2399ce741225bd1e61edf4463adc70f4/cf/f81b8e78bdc4460aaf405efec9e8a579.a947fb4731004a75fb5f46a5db9e0680 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-13 23:00:54,477 DEBUG [rs(jenkins-hbase4.apache.org,39163,1694645979837)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1694646052652.2399ce741225bd1e61edf4463adc70f4. completed. 2023-09-13 23:00:54,477 DEBUG [rs(jenkins-hbase4.apache.org,39163,1694645979837)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1694646052652.2399ce741225bd1e61edf4463adc70f4. 2023-09-13 23:00:54,477 DEBUG [member: 'jenkins-hbase4.apache.org,39163,1694645979837' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-13 23:00:54,477 DEBUG [member: 'jenkins-hbase4.apache.org,39163,1694645979837' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-13 23:00:54,477 DEBUG [member: 'jenkins-hbase4.apache.org,39163,1694645979837' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 23:00:54,477 DEBUG [member: 'jenkins-hbase4.apache.org,39163,1694645979837' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-09-13 23:00:54,477 DEBUG [member: 'jenkins-hbase4.apache.org,39163,1694645979837' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,39163,1694645979837' in zk 2023-09-13 23:00:54,482 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 23:00:54,482 DEBUG [member: 'jenkins-hbase4.apache.org,39163,1694645979837' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-09-13 23:00:54,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 23:00:54,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-13 23:00:54,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-13 23:00:54,482 DEBUG [member: 'jenkins-hbase4.apache.org,39163,1694645979837' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-13 23:00:54,482 DEBUG [member: 'jenkins-hbase4.apache.org,39163,1694645979837' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-09-13 23:00:54,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-13 23:00:54,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-13 23:00:54,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-13 23:00:54,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34119,1694645979883 2023-09-13 23:00:54,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 23:00:54,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 23:00:54,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-13 23:00:54,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-13 23:00:54,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34119,1694645979883 2023-09-13 23:00:54,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 23:00:54,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 23:00:54,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' member 'jenkins-hbase4.apache.org,39163,1694645979837': 2023-09-13 23:00:54,485 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39163,1694645979837' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion-1', counting down latch. Waiting for 0 more 2023-09-13 23:00:54,485 INFO [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' execution completed 2023-09-13 23:00:54,485 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-13 23:00:54,485 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-13 23:00:54,485 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-13 23:00:54,485 INFO [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegion-1including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-13 23:00:54,486 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:39163-0x100a784b9ba0001, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-13 23:00:54,486 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-13 23:00:54,487 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-13 23:00:54,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-13 23:00:54,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-13 23:00:54,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-13 23:00:54,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-13 23:00:54,486 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:39163-0x100a784b9ba0001, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 23:00:54,486 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:34119-0x100a784b9ba0002, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-13 23:00:54,486 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:42165-0x100a784b9ba0003, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-13 23:00:54,487 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-13 23:00:54,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-13 23:00:54,487 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:34119-0x100a784b9ba0002, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 23:00:54,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-13 23:00:54,487 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 23:00:54,487 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,34119,1694645979883 2023-09-13 23:00:54,487 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-13 23:00:54,487 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:42165-0x100a784b9ba0003, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 23:00:54,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-13 23:00:54,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-13 23:00:54,487 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 23:00:54,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 23:00:54,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 23:00:54,488 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 23:00:54,488 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 23:00:54,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-13 23:00:54,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-13 23:00:54,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 23:00:54,488 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 23:00:54,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-13 23:00:54,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-13 23:00:54,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-13 23:00:54,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34119,1694645979883 2023-09-13 23:00:54,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 23:00:54,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 23:00:54,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-13 23:00:54,490 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,34119,1694645979883 2023-09-13 23:00:54,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-13 23:00:54,490 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 23:00:54,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34119,1694645979883 2023-09-13 23:00:54,490 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 23:00:54,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 23:00:54,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 23:00:54,493 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 23:00:54,493 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-13 23:00:54,493 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:39163-0x100a784b9ba0001, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 23:00:54,493 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:34119-0x100a784b9ba0002, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 23:00:54,493 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:42165-0x100a784b9ba0003, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 23:00:54,494 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-13 23:00:54,494 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 23:00:54,494 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-13 23:00:54,494 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:34119-0x100a784b9ba0002, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 23:00:54,494 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-13 23:00:54,494 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 23:00:54,494 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:39163-0x100a784b9ba0001, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 23:00:54,494 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 23:00:54,494 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 23:00:54,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 23:00:54,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 23:00:54,494 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:42165-0x100a784b9ba0003, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 23:00:54,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 23:00:54,494 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,34119,1694645979883 2023-09-13 23:00:54,495 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-13 23:00:54,495 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-13 23:00:54,495 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 23:00:54,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 23:00:54,495 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 23:00:54,495 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 23:00:54,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 23:00:54,495 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-13 23:00:54,495 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 23:00:54,495 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,34119,1694645979883 2023-09-13 23:00:54,495 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-13 23:00:54,495 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 23:00:54,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 23:00:54,495 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-13 23:00:54,517 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-13 23:00:54,518 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed 2023-09-13 23:00:54,518 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-13 23:00:54,518 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-13 23:00:54,518 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 at 1694646054431Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1694646054494 (+63 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1694646054494Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1694646054502 (+8 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1694646054509 (+7 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed at 1694646054518 (+9 ms) 2023-09-13 23:00:54,520 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=79, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-09-13 23:00:54,522 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=79, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED in 86 msec 2023-09-13 23:00:54,535 DEBUG [Listener at jenkins-hbase4.apache.org/37017] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-13 23:00:54,536 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-09-13 23:00:54,536 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-13 23:00:54,536 INFO [Listener at jenkins-hbase4.apache.org/37017] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/export-test/export-1694646054536 2023-09-13 23:00:54,537 INFO [Listener at jenkins-hbase4.apache.org/37017] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:36267, tgtDir=hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/export-test/export-1694646054536, rawTgtDir=hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/export-test/export-1694646054536, srcFsUri=hdfs://localhost:36267, srcDir=hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d 2023-09-13 23:00:54,567 DEBUG [Listener at jenkins-hbase4.apache.org/37017] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:36267, inputRoot=hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d 2023-09-13 23:00:54,567 DEBUG [Listener at jenkins-hbase4.apache.org/37017] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1272312942_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/export-test/export-1694646054536, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/export-test/export-1694646054536/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-13 23:00:54,567 INFO [Listener at jenkins-hbase4.apache.org/37017] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:36267, inputRoot=hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d, snapshotDir=hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1. 2023-09-13 23:00:54,576 INFO [Listener at jenkins-hbase4.apache.org/37017] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/export-test/export-1694646054536/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-13 23:00:54,593 DEBUG [Listener at jenkins-hbase4.apache.org/37017] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-13 23:00:54,594 DEBUG [Listener at jenkins-hbase4.apache.org/37017] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-13 23:00:54,594 DEBUG [Listener at jenkins-hbase4.apache.org/37017] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-13 23:00:54,594 DEBUG [Listener at jenkins-hbase4.apache.org/37017] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-13 23:00:55,203 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694645986290_0004_000001 (auth:SIMPLE) 2023-09-13 23:00:55,472 DEBUG [Listener at jenkins-hbase4.apache.org/37017] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/62bf382e-8712-1db5-f7ab-e78a401ad305/hadoop-393957206035417792.jar 2023-09-13 23:00:55,473 DEBUG [Listener at jenkins-hbase4.apache.org/37017] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-13 23:00:55,473 DEBUG [Listener at jenkins-hbase4.apache.org/37017] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-13 23:00:55,539 DEBUG [Listener at jenkins-hbase4.apache.org/37017] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/62bf382e-8712-1db5-f7ab-e78a401ad305/hadoop-6347862070076695430.jar 2023-09-13 23:00:55,540 DEBUG [Listener at jenkins-hbase4.apache.org/37017] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-13 23:00:55,540 DEBUG [Listener at jenkins-hbase4.apache.org/37017] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-13 23:00:55,541 DEBUG [Listener at jenkins-hbase4.apache.org/37017] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-13 23:00:55,541 DEBUG [Listener at jenkins-hbase4.apache.org/37017] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-13 23:00:55,541 DEBUG [Listener at jenkins-hbase4.apache.org/37017] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-13 23:00:55,542 DEBUG [Listener at jenkins-hbase4.apache.org/37017] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-13 23:00:55,542 DEBUG [Listener at jenkins-hbase4.apache.org/37017] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-13 23:00:55,542 DEBUG [Listener at jenkins-hbase4.apache.org/37017] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-13 23:00:55,543 DEBUG [Listener at jenkins-hbase4.apache.org/37017] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-13 23:00:55,543 DEBUG [Listener at jenkins-hbase4.apache.org/37017] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-13 23:00:55,543 DEBUG [Listener at jenkins-hbase4.apache.org/37017] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-13 23:00:55,544 DEBUG [Listener at jenkins-hbase4.apache.org/37017] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-13 23:00:55,544 DEBUG [Listener at jenkins-hbase4.apache.org/37017] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-13 23:00:55,545 DEBUG [Listener at jenkins-hbase4.apache.org/37017] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-13 23:00:55,545 DEBUG [Listener at jenkins-hbase4.apache.org/37017] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-13 23:00:55,546 DEBUG [Listener at jenkins-hbase4.apache.org/37017] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-13 23:00:55,546 DEBUG [Listener at jenkins-hbase4.apache.org/37017] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-13 23:00:55,546 DEBUG [Listener at jenkins-hbase4.apache.org/37017] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-13 23:00:55,547 DEBUG [Listener at jenkins-hbase4.apache.org/37017] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-13 23:00:55,547 DEBUG [Listener at jenkins-hbase4.apache.org/37017] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-13 23:00:55,547 DEBUG [Listener at jenkins-hbase4.apache.org/37017] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-13 23:00:55,548 DEBUG [Listener at jenkins-hbase4.apache.org/37017] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-13 23:00:55,548 DEBUG [Listener at jenkins-hbase4.apache.org/37017] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-13 23:00:55,967 WARN [Listener at jenkins-hbase4.apache.org/37017] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-13 23:00:55,969 INFO [Listener at jenkins-hbase4.apache.org/37017] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithMergeRegion-1' hfile list 2023-09-13 23:00:55,971 DEBUG [Listener at jenkins-hbase4.apache.org/37017] snapshot.ExportSnapshot(671): export split=0 size=9.5 K 2023-09-13 23:00:56,028 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-13 23:00:56,028 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-13 23:00:56,206 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694645986290_0005_000001 (auth:SIMPLE) 2023-09-13 23:00:56,320 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-13 23:00:59,839 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694645986290_0005_000001 (auth:SIMPLE) 2023-09-13 23:01:02,046 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694645986290_0005_000001 (auth:SIMPLE) 2023-09-13 23:01:04,372 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694645986290_0005_000001 (auth:SIMPLE) 2023-09-13 23:01:06,132 INFO [Listener at jenkins-hbase4.apache.org/37017] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-13 23:01:06,135 INFO [Listener at jenkins-hbase4.apache.org/37017] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-13 23:01:06,143 INFO [Listener at jenkins-hbase4.apache.org/37017] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-13 23:01:06,143 INFO [Listener at jenkins-hbase4.apache.org/37017] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-13 23:01:06,144 INFO [Listener at jenkins-hbase4.apache.org/37017] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-13 23:01:06,144 DEBUG [Listener at jenkins-hbase4.apache.org/37017] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-527948888_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-13 23:01:06,145 DEBUG [Listener at jenkins-hbase4.apache.org/37017] snapshot.TestExportSnapshot(367): hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-09-13 23:01:06,145 DEBUG [Listener at jenkins-hbase4.apache.org/37017] snapshot.TestExportSnapshot(367): hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-09-13 23:01:06,145 DEBUG [Listener at jenkins-hbase4.apache.org/37017] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-527948888_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/export-test/export-1694646054536/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/export-test/export-1694646054536/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-13 23:01:06,145 DEBUG [Listener at jenkins-hbase4.apache.org/37017] snapshot.TestExportSnapshot(367): hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/export-test/export-1694646054536/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-09-13 23:01:06,145 DEBUG [Listener at jenkins-hbase4.apache.org/37017] snapshot.TestExportSnapshot(367): hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/export-test/export-1694646054536/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-09-13 23:01:06,151 INFO [Listener at jenkins-hbase4.apache.org/37017] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-13 23:01:06,151 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-13 23:01:06,152 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] procedure2.ProcedureExecutor(1028): Stored pid=80, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-13 23:01:06,155 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-09-13 23:01:06,155 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694646066155"}]},"ts":"1694646066155"} 2023-09-13 23:01:06,157 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLING in hbase:meta 2023-09-13 23:01:06,159 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLING 2023-09-13 23:01:06,159 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=2399ce741225bd1e61edf4463adc70f4, UNASSIGN}] 2023-09-13 23:01:06,161 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=2399ce741225bd1e61edf4463adc70f4, UNASSIGN 2023-09-13 23:01:06,161 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=2399ce741225bd1e61edf4463adc70f4, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 23:01:06,162 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1694646052652.2399ce741225bd1e61edf4463adc70f4.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1694646066161"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694646066161"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694646066161"}]},"ts":"1694646066161"} 2023-09-13 23:01:06,163 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=82, ppid=81, state=RUNNABLE; CloseRegionProcedure 2399ce741225bd1e61edf4463adc70f4, server=jenkins-hbase4.apache.org,39163,1694645979837}] 2023-09-13 23:01:06,256 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-09-13 23:01:06,315 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 2399ce741225bd1e61edf4463adc70f4 2023-09-13 23:01:06,315 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 2399ce741225bd1e61edf4463adc70f4, disabling compactions & flushes 2023-09-13 23:01:06,315 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1694646052652.2399ce741225bd1e61edf4463adc70f4. 2023-09-13 23:01:06,315 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1694646052652.2399ce741225bd1e61edf4463adc70f4. 2023-09-13 23:01:06,315 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1694646052652.2399ce741225bd1e61edf4463adc70f4. after waiting 0 ms 2023-09-13 23:01:06,315 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1694646052652.2399ce741225bd1e61edf4463adc70f4. 2023-09-13 23:01:06,326 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2399ce741225bd1e61edf4463adc70f4/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=8 2023-09-13 23:01:06,326 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-13 23:01:06,327 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1694646052652.2399ce741225bd1e61edf4463adc70f4. 2023-09-13 23:01:06,327 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 2399ce741225bd1e61edf4463adc70f4: 2023-09-13 23:01:06,328 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 2399ce741225bd1e61edf4463adc70f4 2023-09-13 23:01:06,328 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=2399ce741225bd1e61edf4463adc70f4, regionState=CLOSED 2023-09-13 23:01:06,329 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1694646052652.2399ce741225bd1e61edf4463adc70f4.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1694646066328"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694646066328"}]},"ts":"1694646066328"} 2023-09-13 23:01:06,331 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=82, resume processing ppid=81 2023-09-13 23:01:06,331 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=82, ppid=81, state=SUCCESS; CloseRegionProcedure 2399ce741225bd1e61edf4463adc70f4, server=jenkins-hbase4.apache.org,39163,1694645979837 in 167 msec 2023-09-13 23:01:06,333 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=81, resume processing ppid=80 2023-09-13 23:01:06,333 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=81, ppid=80, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=2399ce741225bd1e61edf4463adc70f4, UNASSIGN in 172 msec 2023-09-13 23:01:06,333 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694646066333"}]},"ts":"1694646066333"} 2023-09-13 23:01:06,334 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLED in hbase:meta 2023-09-13 23:01:06,336 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLED 2023-09-13 23:01:06,337 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=80, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 185 msec 2023-09-13 23:01:06,458 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-09-13 23:01:06,458 INFO [Listener at jenkins-hbase4.apache.org/37017] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 80 completed 2023-09-13 23:01:06,459 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-13 23:01:06,459 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] procedure2.ProcedureExecutor(1028): Stored pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-13 23:01:06,462 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-13 23:01:06,462 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-13 23:01:06,462 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=83, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-13 23:01:06,464 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39163] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-13 23:01:06,466 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ef2bb2f29c8ee0403af44695496c6a20 2023-09-13 23:01:06,466 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a947fb4731004a75fb5f46a5db9e0680 2023-09-13 23:01:06,466 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2399ce741225bd1e61edf4463adc70f4 2023-09-13 23:01:06,467 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:39163-0x100a784b9ba0001, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-13 23:01:06,467 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:42165-0x100a784b9ba0003, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-13 23:01:06,467 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:34119-0x100a784b9ba0002, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-13 23:01:06,467 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-13 23:01:06,468 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-09-13 23:01:06,468 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-09-13 23:01:06,468 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-09-13 23:01:06,468 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-09-13 23:01:06,468 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ef2bb2f29c8ee0403af44695496c6a20/cf, FileablePath, hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ef2bb2f29c8ee0403af44695496c6a20/recovered.edits] 2023-09-13 23:01:06,468 DEBUG [HFileArchiver-19] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2399ce741225bd1e61edf4463adc70f4/cf, FileablePath, hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2399ce741225bd1e61edf4463adc70f4/recovered.edits] 2023-09-13 23:01:06,469 DEBUG [HFileArchiver-20] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a947fb4731004a75fb5f46a5db9e0680/cf, FileablePath, hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a947fb4731004a75fb5f46a5db9e0680/recovered.edits] 2023-09-13 23:01:06,469 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-13 23:01:06,469 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:39163-0x100a784b9ba0001, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-13 23:01:06,469 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:42165-0x100a784b9ba0003, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-13 23:01:06,469 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:39163-0x100a784b9ba0001, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-13 23:01:06,469 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:42165-0x100a784b9ba0003, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-13 23:01:06,469 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-13 23:01:06,469 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:34119-0x100a784b9ba0002, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-13 23:01:06,470 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:34119-0x100a784b9ba0002, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-13 23:01:06,470 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-09-13 23:01:06,470 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-13 23:01:06,470 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-13 23:01:06,471 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-13 23:01:06,471 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-13 23:01:06,474 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ef2bb2f29c8ee0403af44695496c6a20/cf/143d4e1048344664ab707906ccd6a7f0 to hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ef2bb2f29c8ee0403af44695496c6a20/cf/143d4e1048344664ab707906ccd6a7f0 2023-09-13 23:01:06,474 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2399ce741225bd1e61edf4463adc70f4/cf/143d4e1048344664ab707906ccd6a7f0.ef2bb2f29c8ee0403af44695496c6a20 to hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2399ce741225bd1e61edf4463adc70f4/cf/143d4e1048344664ab707906ccd6a7f0.ef2bb2f29c8ee0403af44695496c6a20 2023-09-13 23:01:06,475 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a947fb4731004a75fb5f46a5db9e0680/cf/f81b8e78bdc4460aaf405efec9e8a579 to hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a947fb4731004a75fb5f46a5db9e0680/cf/f81b8e78bdc4460aaf405efec9e8a579 2023-09-13 23:01:06,475 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2399ce741225bd1e61edf4463adc70f4/cf/f81b8e78bdc4460aaf405efec9e8a579.a947fb4731004a75fb5f46a5db9e0680 to hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2399ce741225bd1e61edf4463adc70f4/cf/f81b8e78bdc4460aaf405efec9e8a579.a947fb4731004a75fb5f46a5db9e0680 2023-09-13 23:01:06,477 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ef2bb2f29c8ee0403af44695496c6a20/recovered.edits/8.seqid to hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ef2bb2f29c8ee0403af44695496c6a20/recovered.edits/8.seqid 2023-09-13 23:01:06,478 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ef2bb2f29c8ee0403af44695496c6a20 2023-09-13 23:01:06,478 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a947fb4731004a75fb5f46a5db9e0680/recovered.edits/8.seqid to hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a947fb4731004a75fb5f46a5db9e0680/recovered.edits/8.seqid 2023-09-13 23:01:06,478 DEBUG [HFileArchiver-20] backup.HFileArchiver(596): Deleted hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a947fb4731004a75fb5f46a5db9e0680 2023-09-13 23:01:06,479 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2399ce741225bd1e61edf4463adc70f4/recovered.edits/12.seqid to hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2399ce741225bd1e61edf4463adc70f4/recovered.edits/12.seqid 2023-09-13 23:01:06,479 DEBUG [HFileArchiver-19] backup.HFileArchiver(596): Deleted hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2399ce741225bd1e61edf4463adc70f4 2023-09-13 23:01:06,479 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-09-13 23:01:06,481 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=83, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-13 23:01:06,483 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testtb-testExportFileSystemStateWithMergeRegion-1 from hbase:meta 2023-09-13 23:01:06,485 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' descriptor. 2023-09-13 23:01:06,486 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=83, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-13 23:01:06,486 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' from region states. 2023-09-13 23:01:06,486 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1694646052652.2399ce741225bd1e61edf4463adc70f4.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1694646066486"}]},"ts":"9223372036854775807"} 2023-09-13 23:01:06,487 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-09-13 23:01:06,487 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 2399ce741225bd1e61edf4463adc70f4, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1694646052652.2399ce741225bd1e61edf4463adc70f4.', STARTKEY => '', ENDKEY => ''}] 2023-09-13 23:01:06,487 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion-1' as deleted. 2023-09-13 23:01:06,488 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1694646066487"}]},"ts":"9223372036854775807"} 2023-09-13 23:01:06,489 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion-1 state from META 2023-09-13 23:01:06,491 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=83, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-13 23:01:06,492 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=83, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 32 msec 2023-09-13 23:01:06,571 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-09-13 23:01:06,572 INFO [Listener at jenkins-hbase4.apache.org/37017] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 83 completed 2023-09-13 23:01:06,572 INFO [Listener at jenkins-hbase4.apache.org/37017] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion 2023-09-13 23:01:06,573 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion 2023-09-13 23:01:06,573 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] procedure2.ProcedureExecutor(1028): Stored pid=84, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-13 23:01:06,576 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-09-13 23:01:06,577 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694646066577"}]},"ts":"1694646066577"} 2023-09-13 23:01:06,578 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLING in hbase:meta 2023-09-13 23:01:06,580 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLING 2023-09-13 23:01:06,580 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=e6660ca969b8a4cd6214cb091aafedf4, UNASSIGN}, {pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=1906c1473c12e09b8836fb6168104d6a, UNASSIGN}] 2023-09-13 23:01:06,582 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=e6660ca969b8a4cd6214cb091aafedf4, UNASSIGN 2023-09-13 23:01:06,582 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=1906c1473c12e09b8836fb6168104d6a, UNASSIGN 2023-09-13 23:01:06,583 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=e6660ca969b8a4cd6214cb091aafedf4, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 23:01:06,583 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=1906c1473c12e09b8836fb6168104d6a, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34119,1694645979883 2023-09-13 23:01:06,583 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1694646050996.e6660ca969b8a4cd6214cb091aafedf4.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1694646066583"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694646066583"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694646066583"}]},"ts":"1694646066583"} 2023-09-13 23:01:06,583 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1694646050996.1906c1473c12e09b8836fb6168104d6a.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1694646066583"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694646066583"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694646066583"}]},"ts":"1694646066583"} 2023-09-13 23:01:06,585 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=87, ppid=85, state=RUNNABLE; CloseRegionProcedure e6660ca969b8a4cd6214cb091aafedf4, server=jenkins-hbase4.apache.org,42165,1694645979926}] 2023-09-13 23:01:06,585 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=88, ppid=86, state=RUNNABLE; CloseRegionProcedure 1906c1473c12e09b8836fb6168104d6a, server=jenkins-hbase4.apache.org,34119,1694645979883}] 2023-09-13 23:01:06,677 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-09-13 23:01:06,737 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close e6660ca969b8a4cd6214cb091aafedf4 2023-09-13 23:01:06,737 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing e6660ca969b8a4cd6214cb091aafedf4, disabling compactions & flushes 2023-09-13 23:01:06,737 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1694646050996.e6660ca969b8a4cd6214cb091aafedf4. 2023-09-13 23:01:06,737 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1694646050996.e6660ca969b8a4cd6214cb091aafedf4. 2023-09-13 23:01:06,737 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1694646050996.e6660ca969b8a4cd6214cb091aafedf4. after waiting 0 ms 2023-09-13 23:01:06,737 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1694646050996.e6660ca969b8a4cd6214cb091aafedf4. 2023-09-13 23:01:06,741 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 1906c1473c12e09b8836fb6168104d6a 2023-09-13 23:01:06,741 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1906c1473c12e09b8836fb6168104d6a, disabling compactions & flushes 2023-09-13 23:01:06,741 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1694646050996.1906c1473c12e09b8836fb6168104d6a. 2023-09-13 23:01:06,741 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1694646050996.1906c1473c12e09b8836fb6168104d6a. 2023-09-13 23:01:06,741 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1694646050996.1906c1473c12e09b8836fb6168104d6a. after waiting 0 ms 2023-09-13 23:01:06,741 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1694646050996.1906c1473c12e09b8836fb6168104d6a. 2023-09-13 23:01:06,752 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/default/testtb-testExportFileSystemStateWithMergeRegion/e6660ca969b8a4cd6214cb091aafedf4/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-13 23:01:06,752 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-13 23:01:06,753 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/default/testtb-testExportFileSystemStateWithMergeRegion/1906c1473c12e09b8836fb6168104d6a/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-13 23:01:06,753 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1694646050996.e6660ca969b8a4cd6214cb091aafedf4. 2023-09-13 23:01:06,753 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for e6660ca969b8a4cd6214cb091aafedf4: 2023-09-13 23:01:06,754 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-13 23:01:06,755 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1694646050996.1906c1473c12e09b8836fb6168104d6a. 2023-09-13 23:01:06,755 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1906c1473c12e09b8836fb6168104d6a: 2023-09-13 23:01:06,755 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed e6660ca969b8a4cd6214cb091aafedf4 2023-09-13 23:01:06,756 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=e6660ca969b8a4cd6214cb091aafedf4, regionState=CLOSED 2023-09-13 23:01:06,756 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1694646050996.e6660ca969b8a4cd6214cb091aafedf4.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1694646066756"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694646066756"}]},"ts":"1694646066756"} 2023-09-13 23:01:06,756 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 1906c1473c12e09b8836fb6168104d6a 2023-09-13 23:01:06,756 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=1906c1473c12e09b8836fb6168104d6a, regionState=CLOSED 2023-09-13 23:01:06,756 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1694646050996.1906c1473c12e09b8836fb6168104d6a.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1694646066756"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694646066756"}]},"ts":"1694646066756"} 2023-09-13 23:01:06,759 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=87, resume processing ppid=85 2023-09-13 23:01:06,759 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=87, ppid=85, state=SUCCESS; CloseRegionProcedure e6660ca969b8a4cd6214cb091aafedf4, server=jenkins-hbase4.apache.org,42165,1694645979926 in 172 msec 2023-09-13 23:01:06,759 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=88, resume processing ppid=86 2023-09-13 23:01:06,760 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=88, ppid=86, state=SUCCESS; CloseRegionProcedure 1906c1473c12e09b8836fb6168104d6a, server=jenkins-hbase4.apache.org,34119,1694645979883 in 173 msec 2023-09-13 23:01:06,760 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=85, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=e6660ca969b8a4cd6214cb091aafedf4, UNASSIGN in 179 msec 2023-09-13 23:01:06,761 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=86, resume processing ppid=84 2023-09-13 23:01:06,761 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=86, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=1906c1473c12e09b8836fb6168104d6a, UNASSIGN in 180 msec 2023-09-13 23:01:06,761 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694646066761"}]},"ts":"1694646066761"} 2023-09-13 23:01:06,762 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLED in hbase:meta 2023-09-13 23:01:06,766 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLED 2023-09-13 23:01:06,767 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=84, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 193 msec 2023-09-13 23:01:06,878 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-09-13 23:01:06,879 INFO [Listener at jenkins-hbase4.apache.org/37017] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 84 completed 2023-09-13 23:01:06,879 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion 2023-09-13 23:01:06,880 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] procedure2.ProcedureExecutor(1028): Stored pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-13 23:01:06,882 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-13 23:01:06,883 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion 2023-09-13 23:01:06,883 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=89, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-13 23:01:06,884 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39163] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion 2023-09-13 23:01:06,887 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:39163-0x100a784b9ba0001, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-13 23:01:06,887 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:34119-0x100a784b9ba0002, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-13 23:01:06,887 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:42165-0x100a784b9ba0003, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-13 23:01:06,887 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-13 23:01:06,887 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/e6660ca969b8a4cd6214cb091aafedf4 2023-09-13 23:01:06,887 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/1906c1473c12e09b8836fb6168104d6a 2023-09-13 23:01:06,888 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-09-13 23:01:06,888 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-09-13 23:01:06,888 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-09-13 23:01:06,889 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:39163-0x100a784b9ba0001, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-13 23:01:06,889 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:34119-0x100a784b9ba0002, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-13 23:01:06,889 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data null 2023-09-13 23:01:06,889 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:39163-0x100a784b9ba0001, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-13 23:01:06,889 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:42165-0x100a784b9ba0003, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-13 23:01:06,889 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-09-13 23:01:06,889 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:34119-0x100a784b9ba0002, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-13 23:01:06,890 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/e6660ca969b8a4cd6214cb091aafedf4/cf, FileablePath, hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/e6660ca969b8a4cd6214cb091aafedf4/recovered.edits] 2023-09-13 23:01:06,890 DEBUG [HFileArchiver-16] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/1906c1473c12e09b8836fb6168104d6a/cf, FileablePath, hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/1906c1473c12e09b8836fb6168104d6a/recovered.edits] 2023-09-13 23:01:06,894 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/e6660ca969b8a4cd6214cb091aafedf4/cf/939b0724c70648dd84053349513cac3a to hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/e6660ca969b8a4cd6214cb091aafedf4/cf/939b0724c70648dd84053349513cac3a 2023-09-13 23:01:06,895 DEBUG [HFileArchiver-16] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/1906c1473c12e09b8836fb6168104d6a/cf/b40c7ea569f34267a1557fac147083ab to hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/1906c1473c12e09b8836fb6168104d6a/cf/b40c7ea569f34267a1557fac147083ab 2023-09-13 23:01:06,897 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-13 23:01:06,897 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-13 23:01:06,898 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/e6660ca969b8a4cd6214cb091aafedf4/recovered.edits/9.seqid to hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/e6660ca969b8a4cd6214cb091aafedf4/recovered.edits/9.seqid 2023-09-13 23:01:06,898 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-09-13 23:01:06,898 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/e6660ca969b8a4cd6214cb091aafedf4 2023-09-13 23:01:06,899 DEBUG [HFileArchiver-16] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/1906c1473c12e09b8836fb6168104d6a/recovered.edits/9.seqid to hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/1906c1473c12e09b8836fb6168104d6a/recovered.edits/9.seqid 2023-09-13 23:01:06,899 DEBUG [HFileArchiver-16] backup.HFileArchiver(596): Deleted hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/1906c1473c12e09b8836fb6168104d6a 2023-09-13 23:01:06,899 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-09-13 23:01:06,900 DEBUG [PEWorker-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-09-13 23:01:06,900 DEBUG [PEWorker-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf] 2023-09-13 23:01:06,903 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230913f02f1e40902441d2bcf16a4a58ea943b to hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230913f02f1e40902441d2bcf16a4a58ea943b 2023-09-13 23:01:06,904 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230913a723b59c8aa4434fb3057e6e1a7f289f to hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230913a723b59c8aa4434fb3057e6e1a7f289f 2023-09-13 23:01:06,905 DEBUG [PEWorker-1] backup.HFileArchiver(596): Deleted hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-09-13 23:01:06,906 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=89, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-13 23:01:06,908 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithMergeRegion from hbase:meta 2023-09-13 23:01:06,910 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion' descriptor. 2023-09-13 23:01:06,911 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=89, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-13 23:01:06,911 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion' from region states. 2023-09-13 23:01:06,911 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1694646050996.e6660ca969b8a4cd6214cb091aafedf4.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1694646066911"}]},"ts":"9223372036854775807"} 2023-09-13 23:01:06,911 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1694646050996.1906c1473c12e09b8836fb6168104d6a.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1694646066911"}]},"ts":"9223372036854775807"} 2023-09-13 23:01:06,913 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-13 23:01:06,913 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => e6660ca969b8a4cd6214cb091aafedf4, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1694646050996.e6660ca969b8a4cd6214cb091aafedf4.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 1906c1473c12e09b8836fb6168104d6a, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1694646050996.1906c1473c12e09b8836fb6168104d6a.', STARTKEY => '1', ENDKEY => ''}] 2023-09-13 23:01:06,913 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion' as deleted. 2023-09-13 23:01:06,913 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1694646066913"}]},"ts":"9223372036854775807"} 2023-09-13 23:01:06,914 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion state from META 2023-09-13 23:01:06,917 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=89, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-13 23:01:06,918 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=89, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 37 msec 2023-09-13 23:01:06,999 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-09-13 23:01:06,999 INFO [Listener at jenkins-hbase4.apache.org/37017] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 89 completed 2023-09-13 23:01:07,008 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithMergeRegion" 2023-09-13 23:01:07,010 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 23:01:07,011 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion" 2023-09-13 23:01:07,013 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 23:01:07,014 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion-1" 2023-09-13 23:01:07,015 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-13 23:01:07,039 INFO [Listener at jenkins-hbase4.apache.org/37017] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=761 (was 750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-527948888_17 at /127.0.0.1:42648 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Parameter Sending Thread #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x73fd7489-shared-pool-27 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1506713691) connection to jenkins-hbase4.apache.org/172.31.14.131:41693 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: HFileArchiver-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-20 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-222475018_1 at /127.0.0.1:44932 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-3955 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: HFileArchiver-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-527948888_17 at /127.0.0.1:54520 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-527948888_17 at /127.0.0.1:53280 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x73fd7489-shared-pool-32 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x73fd7489-shared-pool-30 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x73fd7489-shared-pool-29 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-527948888_17 at /127.0.0.1:53264 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x73fd7489-shared-pool-31 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x73fd7489-shared-pool-28 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-222475018_1 at /127.0.0.1:38958 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-19 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=915 (was 903) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=151 (was 200), ProcessCount=168 (was 168), AvailableMemoryMB=8466 (was 8577) 2023-09-13 23:01:07,039 WARN [Listener at jenkins-hbase4.apache.org/37017] hbase.ResourceChecker(130): Thread=761 is superior to 500 2023-09-13 23:01:07,058 INFO [Listener at jenkins-hbase4.apache.org/37017] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=761, OpenFileDescriptor=915, MaxFileDescriptor=60000, SystemLoadAverage=151, ProcessCount=168, AvailableMemoryMB=8465 2023-09-13 23:01:07,059 WARN [Listener at jenkins-hbase4.apache.org/37017] hbase.ResourceChecker(130): Thread=761 is superior to 500 2023-09-13 23:01:07,060 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-13 23:01:07,061 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] procedure2.ProcedureExecutor(1028): Stored pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-13 23:01:07,063 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-09-13 23:01:07,063 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testEmptyExportFileSystemState" procId is: 90 2023-09-13 23:01:07,063 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-13 23:01:07,064 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-09-13 23:01:07,066 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.tmp/data/default/testtb-testEmptyExportFileSystemState/f80fb935d61d9c4b7d1ebdca9aadf3d0 2023-09-13 23:01:07,066 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.tmp/data/default/testtb-testEmptyExportFileSystemState/bec6a7441f41b9c3f629041f7afc7882 2023-09-13 23:01:07,066 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.tmp/data/default/testtb-testEmptyExportFileSystemState/f80fb935d61d9c4b7d1ebdca9aadf3d0 empty. 2023-09-13 23:01:07,066 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.tmp/data/default/testtb-testEmptyExportFileSystemState/bec6a7441f41b9c3f629041f7afc7882 empty. 2023-09-13 23:01:07,066 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.tmp/data/default/testtb-testEmptyExportFileSystemState/f80fb935d61d9c4b7d1ebdca9aadf3d0 2023-09-13 23:01:07,066 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.tmp/data/default/testtb-testEmptyExportFileSystemState/bec6a7441f41b9c3f629041f7afc7882 2023-09-13 23:01:07,067 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-09-13 23:01:07,075 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.tmp/data/default/testtb-testEmptyExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-09-13 23:01:07,076 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => bec6a7441f41b9c3f629041f7afc7882, NAME => 'testtb-testEmptyExportFileSystemState,1,1694646067060.bec6a7441f41b9c3f629041f7afc7882.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.tmp 2023-09-13 23:01:07,076 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => f80fb935d61d9c4b7d1ebdca9aadf3d0, NAME => 'testtb-testEmptyExportFileSystemState,,1694646067060.f80fb935d61d9c4b7d1ebdca9aadf3d0.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.tmp 2023-09-13 23:01:07,084 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1694646067060.bec6a7441f41b9c3f629041f7afc7882.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-13 23:01:07,084 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing bec6a7441f41b9c3f629041f7afc7882, disabling compactions & flushes 2023-09-13 23:01:07,084 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1694646067060.bec6a7441f41b9c3f629041f7afc7882. 2023-09-13 23:01:07,084 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1694646067060.bec6a7441f41b9c3f629041f7afc7882. 2023-09-13 23:01:07,084 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1694646067060.bec6a7441f41b9c3f629041f7afc7882. after waiting 0 ms 2023-09-13 23:01:07,084 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1694646067060.bec6a7441f41b9c3f629041f7afc7882. 2023-09-13 23:01:07,084 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1694646067060.bec6a7441f41b9c3f629041f7afc7882. 2023-09-13 23:01:07,084 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for bec6a7441f41b9c3f629041f7afc7882: 2023-09-13 23:01:07,085 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1694646067060.f80fb935d61d9c4b7d1ebdca9aadf3d0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-13 23:01:07,085 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing f80fb935d61d9c4b7d1ebdca9aadf3d0, disabling compactions & flushes 2023-09-13 23:01:07,085 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1694646067060.f80fb935d61d9c4b7d1ebdca9aadf3d0. 2023-09-13 23:01:07,085 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1694646067060.f80fb935d61d9c4b7d1ebdca9aadf3d0. 2023-09-13 23:01:07,085 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1694646067060.f80fb935d61d9c4b7d1ebdca9aadf3d0. after waiting 0 ms 2023-09-13 23:01:07,085 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1694646067060.f80fb935d61d9c4b7d1ebdca9aadf3d0. 2023-09-13 23:01:07,085 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1694646067060.f80fb935d61d9c4b7d1ebdca9aadf3d0. 2023-09-13 23:01:07,085 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for f80fb935d61d9c4b7d1ebdca9aadf3d0: 2023-09-13 23:01:07,087 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-09-13 23:01:07,088 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1694646067060.bec6a7441f41b9c3f629041f7afc7882.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1694646067088"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694646067088"}]},"ts":"1694646067088"} 2023-09-13 23:01:07,088 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1694646067060.f80fb935d61d9c4b7d1ebdca9aadf3d0.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1694646067088"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694646067088"}]},"ts":"1694646067088"} 2023-09-13 23:01:07,090 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-13 23:01:07,090 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-13 23:01:07,090 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694646067090"}]},"ts":"1694646067090"} 2023-09-13 23:01:07,091 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLING in hbase:meta 2023-09-13 23:01:07,095 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-13 23:01:07,096 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-13 23:01:07,096 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-13 23:01:07,096 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-13 23:01:07,096 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-13 23:01:07,096 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=f80fb935d61d9c4b7d1ebdca9aadf3d0, ASSIGN}, {pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=bec6a7441f41b9c3f629041f7afc7882, ASSIGN}] 2023-09-13 23:01:07,098 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=f80fb935d61d9c4b7d1ebdca9aadf3d0, ASSIGN 2023-09-13 23:01:07,098 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=bec6a7441f41b9c3f629041f7afc7882, ASSIGN 2023-09-13 23:01:07,099 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=f80fb935d61d9c4b7d1ebdca9aadf3d0, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42165,1694645979926; forceNewPlan=false, retain=false 2023-09-13 23:01:07,099 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=bec6a7441f41b9c3f629041f7afc7882, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39163,1694645979837; forceNewPlan=false, retain=false 2023-09-13 23:01:07,165 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-09-13 23:01:07,249 INFO [jenkins-hbase4:36621] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-13 23:01:07,252 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=bec6a7441f41b9c3f629041f7afc7882, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 23:01:07,252 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=f80fb935d61d9c4b7d1ebdca9aadf3d0, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 23:01:07,252 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1694646067060.bec6a7441f41b9c3f629041f7afc7882.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1694646067252"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694646067252"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694646067252"}]},"ts":"1694646067252"} 2023-09-13 23:01:07,252 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1694646067060.f80fb935d61d9c4b7d1ebdca9aadf3d0.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1694646067252"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694646067252"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694646067252"}]},"ts":"1694646067252"} 2023-09-13 23:01:07,253 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=93, ppid=92, state=RUNNABLE; OpenRegionProcedure bec6a7441f41b9c3f629041f7afc7882, server=jenkins-hbase4.apache.org,39163,1694645979837}] 2023-09-13 23:01:07,254 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=94, ppid=91, state=RUNNABLE; OpenRegionProcedure f80fb935d61d9c4b7d1ebdca9aadf3d0, server=jenkins-hbase4.apache.org,42165,1694645979926}] 2023-09-13 23:01:07,366 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-09-13 23:01:07,408 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,1,1694646067060.bec6a7441f41b9c3f629041f7afc7882. 2023-09-13 23:01:07,408 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,,1694646067060.f80fb935d61d9c4b7d1ebdca9aadf3d0. 2023-09-13 23:01:07,408 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => bec6a7441f41b9c3f629041f7afc7882, NAME => 'testtb-testEmptyExportFileSystemState,1,1694646067060.bec6a7441f41b9c3f629041f7afc7882.', STARTKEY => '1', ENDKEY => ''} 2023-09-13 23:01:07,408 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => f80fb935d61d9c4b7d1ebdca9aadf3d0, NAME => 'testtb-testEmptyExportFileSystemState,,1694646067060.f80fb935d61d9c4b7d1ebdca9aadf3d0.', STARTKEY => '', ENDKEY => '1'} 2023-09-13 23:01:07,408 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,1,1694646067060.bec6a7441f41b9c3f629041f7afc7882. service=AccessControlService 2023-09-13 23:01:07,408 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,,1694646067060.f80fb935d61d9c4b7d1ebdca9aadf3d0. service=AccessControlService 2023-09-13 23:01:07,409 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-13 23:01:07,409 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-13 23:01:07,409 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState bec6a7441f41b9c3f629041f7afc7882 2023-09-13 23:01:07,409 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState f80fb935d61d9c4b7d1ebdca9aadf3d0 2023-09-13 23:01:07,409 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1694646067060.bec6a7441f41b9c3f629041f7afc7882.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-13 23:01:07,409 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1694646067060.f80fb935d61d9c4b7d1ebdca9aadf3d0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-13 23:01:07,409 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for bec6a7441f41b9c3f629041f7afc7882 2023-09-13 23:01:07,409 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for f80fb935d61d9c4b7d1ebdca9aadf3d0 2023-09-13 23:01:07,409 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for bec6a7441f41b9c3f629041f7afc7882 2023-09-13 23:01:07,409 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for f80fb935d61d9c4b7d1ebdca9aadf3d0 2023-09-13 23:01:07,410 INFO [StoreOpener-bec6a7441f41b9c3f629041f7afc7882-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region bec6a7441f41b9c3f629041f7afc7882 2023-09-13 23:01:07,410 INFO [StoreOpener-f80fb935d61d9c4b7d1ebdca9aadf3d0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region f80fb935d61d9c4b7d1ebdca9aadf3d0 2023-09-13 23:01:07,411 DEBUG [StoreOpener-bec6a7441f41b9c3f629041f7afc7882-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/default/testtb-testEmptyExportFileSystemState/bec6a7441f41b9c3f629041f7afc7882/cf 2023-09-13 23:01:07,411 DEBUG [StoreOpener-f80fb935d61d9c4b7d1ebdca9aadf3d0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/default/testtb-testEmptyExportFileSystemState/f80fb935d61d9c4b7d1ebdca9aadf3d0/cf 2023-09-13 23:01:07,411 DEBUG [StoreOpener-f80fb935d61d9c4b7d1ebdca9aadf3d0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/default/testtb-testEmptyExportFileSystemState/f80fb935d61d9c4b7d1ebdca9aadf3d0/cf 2023-09-13 23:01:07,411 DEBUG [StoreOpener-bec6a7441f41b9c3f629041f7afc7882-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/default/testtb-testEmptyExportFileSystemState/bec6a7441f41b9c3f629041f7afc7882/cf 2023-09-13 23:01:07,412 INFO [StoreOpener-f80fb935d61d9c4b7d1ebdca9aadf3d0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f80fb935d61d9c4b7d1ebdca9aadf3d0 columnFamilyName cf 2023-09-13 23:01:07,412 INFO [StoreOpener-bec6a7441f41b9c3f629041f7afc7882-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bec6a7441f41b9c3f629041f7afc7882 columnFamilyName cf 2023-09-13 23:01:07,413 INFO [StoreOpener-bec6a7441f41b9c3f629041f7afc7882-1] regionserver.HStore(310): Store=bec6a7441f41b9c3f629041f7afc7882/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-13 23:01:07,413 INFO [StoreOpener-f80fb935d61d9c4b7d1ebdca9aadf3d0-1] regionserver.HStore(310): Store=f80fb935d61d9c4b7d1ebdca9aadf3d0/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-13 23:01:07,414 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/default/testtb-testEmptyExportFileSystemState/bec6a7441f41b9c3f629041f7afc7882 2023-09-13 23:01:07,414 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/default/testtb-testEmptyExportFileSystemState/f80fb935d61d9c4b7d1ebdca9aadf3d0 2023-09-13 23:01:07,414 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/default/testtb-testEmptyExportFileSystemState/bec6a7441f41b9c3f629041f7afc7882 2023-09-13 23:01:07,414 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/default/testtb-testEmptyExportFileSystemState/f80fb935d61d9c4b7d1ebdca9aadf3d0 2023-09-13 23:01:07,417 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for bec6a7441f41b9c3f629041f7afc7882 2023-09-13 23:01:07,418 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for f80fb935d61d9c4b7d1ebdca9aadf3d0 2023-09-13 23:01:07,420 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/default/testtb-testEmptyExportFileSystemState/bec6a7441f41b9c3f629041f7afc7882/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-13 23:01:07,421 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened bec6a7441f41b9c3f629041f7afc7882; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60028052, jitterRate=-0.10551232099533081}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-13 23:01:07,421 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/default/testtb-testEmptyExportFileSystemState/f80fb935d61d9c4b7d1ebdca9aadf3d0/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-13 23:01:07,421 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for bec6a7441f41b9c3f629041f7afc7882: 2023-09-13 23:01:07,422 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened f80fb935d61d9c4b7d1ebdca9aadf3d0; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64118979, jitterRate=-0.0445527583360672}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-13 23:01:07,422 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for f80fb935d61d9c4b7d1ebdca9aadf3d0: 2023-09-13 23:01:07,422 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,1,1694646067060.bec6a7441f41b9c3f629041f7afc7882., pid=93, masterSystemTime=1694646067405 2023-09-13 23:01:07,422 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,,1694646067060.f80fb935d61d9c4b7d1ebdca9aadf3d0., pid=94, masterSystemTime=1694646067405 2023-09-13 23:01:07,423 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,1,1694646067060.bec6a7441f41b9c3f629041f7afc7882. 2023-09-13 23:01:07,423 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,1,1694646067060.bec6a7441f41b9c3f629041f7afc7882. 2023-09-13 23:01:07,424 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=bec6a7441f41b9c3f629041f7afc7882, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 23:01:07,424 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,,1694646067060.f80fb935d61d9c4b7d1ebdca9aadf3d0. 2023-09-13 23:01:07,424 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,1,1694646067060.bec6a7441f41b9c3f629041f7afc7882.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1694646067424"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1694646067424"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1694646067424"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1694646067424"}]},"ts":"1694646067424"} 2023-09-13 23:01:07,424 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,,1694646067060.f80fb935d61d9c4b7d1ebdca9aadf3d0. 2023-09-13 23:01:07,424 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=f80fb935d61d9c4b7d1ebdca9aadf3d0, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 23:01:07,424 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,,1694646067060.f80fb935d61d9c4b7d1ebdca9aadf3d0.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1694646067424"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1694646067424"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1694646067424"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1694646067424"}]},"ts":"1694646067424"} 2023-09-13 23:01:07,427 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=93, resume processing ppid=92 2023-09-13 23:01:07,427 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=93, ppid=92, state=SUCCESS; OpenRegionProcedure bec6a7441f41b9c3f629041f7afc7882, server=jenkins-hbase4.apache.org,39163,1694645979837 in 172 msec 2023-09-13 23:01:07,428 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=94, resume processing ppid=91 2023-09-13 23:01:07,428 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=94, ppid=91, state=SUCCESS; OpenRegionProcedure f80fb935d61d9c4b7d1ebdca9aadf3d0, server=jenkins-hbase4.apache.org,42165,1694645979926 in 172 msec 2023-09-13 23:01:07,428 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=92, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=bec6a7441f41b9c3f629041f7afc7882, ASSIGN in 331 msec 2023-09-13 23:01:07,429 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=91, resume processing ppid=90 2023-09-13 23:01:07,429 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=91, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=f80fb935d61d9c4b7d1ebdca9aadf3d0, ASSIGN in 332 msec 2023-09-13 23:01:07,430 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-13 23:01:07,430 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694646067430"}]},"ts":"1694646067430"} 2023-09-13 23:01:07,431 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLED in hbase:meta 2023-09-13 23:01:07,433 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-09-13 23:01:07,433 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testEmptyExportFileSystemState jenkins: RWXCA 2023-09-13 23:01:07,435 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39163] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-09-13 23:01:07,441 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-13 23:01:07,441 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:42165-0x100a784b9ba0003, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-13 23:01:07,441 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:34119-0x100a784b9ba0002, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-13 23:01:07,441 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:39163-0x100a784b9ba0001, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-13 23:01:07,443 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-13 23:01:07,443 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-13 23:01:07,443 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-13 23:01:07,443 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-13 23:01:07,444 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=90, state=SUCCESS; CreateTableProcedure table=testtb-testEmptyExportFileSystemState in 383 msec 2023-09-13 23:01:07,667 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-09-13 23:01:07,667 INFO [Listener at jenkins-hbase4.apache.org/37017] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 90 completed 2023-09-13 23:01:07,669 DEBUG [Listener at jenkins-hbase4.apache.org/37017] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-09-13 23:01:07,669 DEBUG [Listener at jenkins-hbase4.apache.org/37017] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1694646067060.f80fb935d61d9c4b7d1ebdca9aadf3d0. 2023-09-13 23:01:07,671 INFO [Listener at jenkins-hbase4.apache.org/37017] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-13 23:01:07,681 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-13 23:01:07,681 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1694646067681 (current time:1694646067681). 2023-09-13 23:01:07,681 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-13 23:01:07,681 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] zookeeper.ReadOnlyZKClient(139): Connect 0x4d31cbbb to 127.0.0.1:55012 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-13 23:01:07,687 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@76b769c1, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-13 23:01:07,691 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-13 23:01:07,694 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55738, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-13 23:01:07,695 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4d31cbbb to 127.0.0.1:55012 2023-09-13 23:01:07,695 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-13 23:01:07,696 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] zookeeper.ReadOnlyZKClient(139): Connect 0x37e9f146 to 127.0.0.1:55012 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-13 23:01:07,703 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@74469813, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-13 23:01:07,705 DEBUG [hconnection-0x39f20e3b-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-13 23:01:07,705 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55744, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-13 23:01:07,708 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-13 23:01:07,710 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47848, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-13 23:01:07,711 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x37e9f146 to 127.0.0.1:55012 2023-09-13 23:01:07,711 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-13 23:01:07,711 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-09-13 23:01:07,712 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-13 23:01:07,712 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-13 23:01:07,714 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] procedure2.ProcedureExecutor(1028): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-13 23:01:07,715 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-13 23:01:07,716 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1694646667716 2023-09-13 23:01:07,716 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-13 23:01:07,716 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-09-13 23:01:07,717 DEBUG [Listener at jenkins-hbase4.apache.org/37017] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-13 23:01:07,717 DEBUG [Listener at jenkins-hbase4.apache.org/37017] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-13 23:01:07,717 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-13 23:01:07,718 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-13 23:01:07,719 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 5 msec 2023-09-13 23:01:07,722 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-13 23:01:07,722 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=96, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1694646667722 2023-09-13 23:01:07,729 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testEmptyExportFileSystemState 2023-09-13 23:01:07,730 INFO [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState' 2023-09-13 23:01:07,730 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-13 23:01:07,730 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-09-13 23:01:07,730 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-09-13 23:01:07,731 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-13 23:01:07,731 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-13 23:01:07,737 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:34119-0x100a784b9ba0002, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 23:01:07,737 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:39163-0x100a784b9ba0001, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 23:01:07,737 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 23:01:07,737 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 23:01:07,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 23:01:07,737 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:42165-0x100a784b9ba0003, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 23:01:07,737 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 23:01:07,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 23:01:07,738 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 23:01:07,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 23:01:07,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-13 23:01:07,738 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 23:01:07,738 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 23:01:07,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-13 23:01:07,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-13 23:01:07,738 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34119-0x100a784b9ba0002, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-13 23:01:07,738 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 23:01:07,738 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-13 23:01:07,738 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39163-0x100a784b9ba0001, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-13 23:01:07,738 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42165-0x100a784b9ba0003, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-13 23:01:07,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-09-13 23:01:07,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-13 23:01:07,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-09-13 23:01:07,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-13 23:01:07,739 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-13 23:01:07,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-09-13 23:01:07,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-13 23:01:07,739 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-13 23:01:07,739 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-09-13 23:01:07,739 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-13 23:01:07,739 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1694645979883' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-13 23:01:07,739 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1694645979883' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-13 23:01:07,739 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-09-13 23:01:07,739 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-09-13 23:01:07,740 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1694645979883' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-13 23:01:07,740 DEBUG [member: 'jenkins-hbase4.apache.org,39163,1694645979837' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-13 23:01:07,740 DEBUG [member: 'jenkins-hbase4.apache.org,39163,1694645979837' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-13 23:01:07,740 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1694645979883' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-13 23:01:07,741 DEBUG [member: 'jenkins-hbase4.apache.org,39163,1694645979837' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-13 23:01:07,741 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1694645979883' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34119,1694645979883' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-09-13 23:01:07,740 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-13 23:01:07,741 DEBUG [member: 'jenkins-hbase4.apache.org,39163,1694645979837' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-13 23:01:07,741 DEBUG [member: 'jenkins-hbase4.apache.org,39163,1694645979837' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39163,1694645979837' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-09-13 23:01:07,741 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-13 23:01:07,742 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-13 23:01:07,742 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-13 23:01:07,742 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42165,1694645979926' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-09-13 23:01:07,745 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1694645979883' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-13 23:01:07,746 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 23:01:07,746 DEBUG [member: 'jenkins-hbase4.apache.org,39163,1694645979837' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-13 23:01:07,746 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-13 23:01:07,746 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 23:01:07,746 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1694645979883' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34119-0x100a784b9ba0002, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-13 23:01:07,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 23:01:07,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-13 23:01:07,746 DEBUG [member: 'jenkins-hbase4.apache.org,39163,1694645979837' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39163-0x100a784b9ba0001, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-13 23:01:07,746 DEBUG [member: 'jenkins-hbase4.apache.org,39163,1694645979837' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-13 23:01:07,746 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1694645979883' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-13 23:01:07,746 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42165-0x100a784b9ba0003, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-13 23:01:07,747 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-13 23:01:07,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-13 23:01:07,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-13 23:01:07,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-13 23:01:07,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-13 23:01:07,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34119,1694645979883 2023-09-13 23:01:07,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 23:01:07,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 23:01:07,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-13 23:01:07,749 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39163,1694645979837' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-09-13 23:01:07,749 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@c87f477[Count = 1] remaining members to acquire global barrier 2023-09-13 23:01:07,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 23:01:07,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-13 23:01:07,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-13 23:01:07,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-13 23:01:07,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-13 23:01:07,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-13 23:01:07,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34119,1694645979883 2023-09-13 23:01:07,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 23:01:07,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 23:01:07,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-13 23:01:07,751 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42165,1694645979926' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-09-13 23:01:07,751 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@c87f477[Count = 0] remaining members to acquire global barrier 2023-09-13 23:01:07,751 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-09-13 23:01:07,751 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-13 23:01:07,752 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:34119-0x100a784b9ba0002, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-13 23:01:07,752 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:42165-0x100a784b9ba0003, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-13 23:01:07,752 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-13 23:01:07,752 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:39163-0x100a784b9ba0001, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-13 23:01:07,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-13 23:01:07,752 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-13 23:01:07,752 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-13 23:01:07,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-13 23:01:07,752 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 23:01:07,753 DEBUG [member: 'jenkins-hbase4.apache.org,39163,1694645979837' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-13 23:01:07,752 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1694645979883' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-13 23:01:07,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-13 23:01:07,753 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1694645979883' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-09-13 23:01:07,753 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1694645979883' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,34119,1694645979883' in zk 2023-09-13 23:01:07,753 DEBUG [rs(jenkins-hbase4.apache.org,39163,1694645979837)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1694646067060.bec6a7441f41b9c3f629041f7afc7882. 2023-09-13 23:01:07,753 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-13 23:01:07,753 DEBUG [member: 'jenkins-hbase4.apache.org,39163,1694645979837' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-13 23:01:07,753 DEBUG [member: 'jenkins-hbase4.apache.org,39163,1694645979837' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-13 23:01:07,753 DEBUG [rs(jenkins-hbase4.apache.org,39163,1694645979837)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1694646067060.bec6a7441f41b9c3f629041f7afc7882. started... 2023-09-13 23:01:07,753 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 23:01:07,753 DEBUG [rs(jenkins-hbase4.apache.org,42165,1694645979926)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1694646067060.f80fb935d61d9c4b7d1ebdca9aadf3d0. 2023-09-13 23:01:07,753 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-13 23:01:07,754 DEBUG [rs(jenkins-hbase4.apache.org,39163,1694645979837)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for bec6a7441f41b9c3f629041f7afc7882: 2023-09-13 23:01:07,753 DEBUG [rs(jenkins-hbase4.apache.org,42165,1694645979926)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1694646067060.f80fb935d61d9c4b7d1ebdca9aadf3d0. started... 2023-09-13 23:01:07,753 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-13 23:01:07,754 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-13 23:01:07,754 DEBUG [rs(jenkins-hbase4.apache.org,39163,1694645979837)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1694646067060.bec6a7441f41b9c3f629041f7afc7882.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-09-13 23:01:07,754 DEBUG [rs(jenkins-hbase4.apache.org,42165,1694645979926)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for f80fb935d61d9c4b7d1ebdca9aadf3d0: 2023-09-13 23:01:07,754 DEBUG [rs(jenkins-hbase4.apache.org,39163,1694645979837)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-13 23:01:07,755 DEBUG [rs(jenkins-hbase4.apache.org,39163,1694645979837)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-13 23:01:07,755 DEBUG [rs(jenkins-hbase4.apache.org,42165,1694645979926)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1694646067060.f80fb935d61d9c4b7d1ebdca9aadf3d0.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-09-13 23:01:07,755 DEBUG [rs(jenkins-hbase4.apache.org,42165,1694645979926)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-13 23:01:07,755 DEBUG [rs(jenkins-hbase4.apache.org,42165,1694645979926)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-13 23:01:07,758 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1694645979883' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-13 23:01:07,758 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1694645979883' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-13 23:01:07,758 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1694645979883' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-09-13 23:01:07,766 DEBUG [rs(jenkins-hbase4.apache.org,39163,1694645979837)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1694646067060.bec6a7441f41b9c3f629041f7afc7882. completed. 2023-09-13 23:01:07,766 DEBUG [rs(jenkins-hbase4.apache.org,39163,1694645979837)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1694646067060.bec6a7441f41b9c3f629041f7afc7882. 2023-09-13 23:01:07,766 DEBUG [member: 'jenkins-hbase4.apache.org,39163,1694645979837' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-13 23:01:07,766 DEBUG [member: 'jenkins-hbase4.apache.org,39163,1694645979837' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-13 23:01:07,766 DEBUG [member: 'jenkins-hbase4.apache.org,39163,1694645979837' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 23:01:07,766 DEBUG [member: 'jenkins-hbase4.apache.org,39163,1694645979837' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-09-13 23:01:07,766 DEBUG [member: 'jenkins-hbase4.apache.org,39163,1694645979837' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,39163,1694645979837' in zk 2023-09-13 23:01:07,767 DEBUG [rs(jenkins-hbase4.apache.org,42165,1694645979926)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1694646067060.f80fb935d61d9c4b7d1ebdca9aadf3d0. completed. 2023-09-13 23:01:07,767 DEBUG [rs(jenkins-hbase4.apache.org,42165,1694645979926)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1694646067060.f80fb935d61d9c4b7d1ebdca9aadf3d0. 2023-09-13 23:01:07,767 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-13 23:01:07,767 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-13 23:01:07,767 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 23:01:07,767 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-09-13 23:01:07,767 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,42165,1694645979926' in zk 2023-09-13 23:01:07,768 DEBUG [member: 'jenkins-hbase4.apache.org,39163,1694645979837' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-13 23:01:07,768 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 23:01:07,768 DEBUG [member: 'jenkins-hbase4.apache.org,39163,1694645979837' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-13 23:01:07,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 23:01:07,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-13 23:01:07,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-13 23:01:07,768 DEBUG [member: 'jenkins-hbase4.apache.org,39163,1694645979837' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-09-13 23:01:07,769 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 23:01:07,769 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-13 23:01:07,769 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-13 23:01:07,769 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-09-13 23:01:07,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-13 23:01:07,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-13 23:01:07,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-13 23:01:07,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34119,1694645979883 2023-09-13 23:01:07,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 23:01:07,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 23:01:07,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-13 23:01:07,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-13 23:01:07,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34119,1694645979883 2023-09-13 23:01:07,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 23:01:07,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 23:01:07,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,39163,1694645979837': 2023-09-13 23:01:07,773 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39163,1694645979837' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-09-13 23:01:07,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 23:01:07,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-13 23:01:07,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-13 23:01:07,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-13 23:01:07,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-13 23:01:07,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-13 23:01:07,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34119,1694645979883 2023-09-13 23:01:07,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 23:01:07,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 23:01:07,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-13 23:01:07,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-13 23:01:07,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34119,1694645979883 2023-09-13 23:01:07,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 23:01:07,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 23:01:07,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,42165,1694645979926': 2023-09-13 23:01:07,775 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42165,1694645979926' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-09-13 23:01:07,775 INFO [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' execution completed 2023-09-13 23:01:07,775 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-13 23:01:07,775 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-13 23:01:07,775 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testEmptyExportFileSystemState 2023-09-13 23:01:07,775 INFO [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-13 23:01:07,777 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:39163-0x100a784b9ba0001, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-13 23:01:07,777 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:34119-0x100a784b9ba0002, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-13 23:01:07,777 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-13 23:01:07,777 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-13 23:01:07,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-13 23:01:07,777 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:42165-0x100a784b9ba0003, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-13 23:01:07,777 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-13 23:01:07,777 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:34119-0x100a784b9ba0002, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 23:01:07,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-13 23:01:07,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-13 23:01:07,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-13 23:01:07,777 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:39163-0x100a784b9ba0001, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 23:01:07,777 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-13 23:01:07,777 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:42165-0x100a784b9ba0003, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 23:01:07,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-13 23:01:07,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-13 23:01:07,777 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 23:01:07,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 23:01:07,778 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34119,1694645979883 2023-09-13 23:01:07,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-13 23:01:07,778 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 23:01:07,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 23:01:07,778 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 23:01:07,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 23:01:07,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-13 23:01:07,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-13 23:01:07,778 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 23:01:07,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-13 23:01:07,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-13 23:01:07,779 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 23:01:07,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-13 23:01:07,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-13 23:01:07,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34119,1694645979883 2023-09-13 23:01:07,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 23:01:07,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 23:01:07,780 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34119,1694645979883 2023-09-13 23:01:07,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-13 23:01:07,780 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 23:01:07,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-13 23:01:07,781 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 23:01:07,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34119,1694645979883 2023-09-13 23:01:07,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 23:01:07,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 23:01:07,784 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:34119-0x100a784b9ba0002, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 23:01:07,784 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:39163-0x100a784b9ba0001, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 23:01:07,784 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 23:01:07,784 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:34119-0x100a784b9ba0002, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 23:01:07,784 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 23:01:07,784 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testEmptyExportFileSystemState 2023-09-13 23:01:07,784 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:42165-0x100a784b9ba0003, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 23:01:07,784 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-09-13 23:01:07,784 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 23:01:07,784 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-09-13 23:01:07,784 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:42165-0x100a784b9ba0003, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 23:01:07,784 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-13 23:01:07,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 23:01:07,784 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-13 23:01:07,784 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-13 23:01:07,784 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:39163-0x100a784b9ba0001, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 23:01:07,785 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 23:01:07,784 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 23:01:07,786 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34119,1694645979883 2023-09-13 23:01:07,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 23:01:07,786 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-13 23:01:07,786 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 23:01:07,786 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 23:01:07,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 23:01:07,786 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-13 23:01:07,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 23:01:07,786 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-13 23:01:07,786 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 23:01:07,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 23:01:07,786 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 23:01:07,786 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 23:01:07,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 23:01:07,786 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34119,1694645979883 2023-09-13 23:01:07,786 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-13 23:01:07,786 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-13 23:01:07,792 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testEmptyExportFileSystemState 2023-09-13 23:01:07,793 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-09-13 23:01:07,811 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-09-13 23:01:07,812 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-09-13 23:01:07,812 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-09-13 23:01:07,812 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-09-13 23:01:07,812 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1694646067716Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1694646067792 (+76 ms)Consolidate snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1694646067792Loading Region manifests for emptySnaptb0-testEmptyExportFileSystemState at 1694646067792Writing data manifest for emptySnaptb0-testEmptyExportFileSystemState at 1694646067796 (+4 ms)Verifying snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1694646067806 (+10 ms)Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1694646067812 (+6 ms) 2023-09-13 23:01:07,815 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=96, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-13 23:01:07,816 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=96, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 98 msec 2023-09-13 23:01:07,817 DEBUG [Listener at jenkins-hbase4.apache.org/37017] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-13 23:01:07,818 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-13 23:01:07,818 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-13 23:01:07,819 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42165] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,,1694646067060.f80fb935d61d9c4b7d1ebdca9aadf3d0. with WAL disabled. Data may be lost in the event of a crash. 2023-09-13 23:01:07,820 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39163] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,1,1694646067060.bec6a7441f41b9c3f629041f7afc7882. with WAL disabled. Data may be lost in the event of a crash. 2023-09-13 23:01:07,823 DEBUG [Listener at jenkins-hbase4.apache.org/37017] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-09-13 23:01:07,823 DEBUG [Listener at jenkins-hbase4.apache.org/37017] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1694646067060.f80fb935d61d9c4b7d1ebdca9aadf3d0. 2023-09-13 23:01:07,823 INFO [Listener at jenkins-hbase4.apache.org/37017] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-13 23:01:07,832 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-13 23:01:07,832 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1694646067832 (current time:1694646067832). 2023-09-13 23:01:07,832 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-13 23:01:07,832 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] zookeeper.ReadOnlyZKClient(139): Connect 0x01fc6cbc to 127.0.0.1:55012 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-13 23:01:07,838 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@28d6396e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-13 23:01:07,839 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-13 23:01:07,840 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55756, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-13 23:01:07,840 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x01fc6cbc to 127.0.0.1:55012 2023-09-13 23:01:07,840 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-13 23:01:07,841 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] zookeeper.ReadOnlyZKClient(139): Connect 0x0dc53485 to 127.0.0.1:55012 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-13 23:01:07,846 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6fbe300d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-13 23:01:07,847 DEBUG [hconnection-0x76ba69dd-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-13 23:01:07,849 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55764, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-13 23:01:07,852 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-13 23:01:07,853 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47864, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-13 23:01:07,854 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0dc53485 to 127.0.0.1:55012 2023-09-13 23:01:07,854 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-13 23:01:07,854 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-09-13 23:01:07,854 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-13 23:01:07,855 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-13 23:01:07,856 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] procedure2.ProcedureExecutor(1028): Stored pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-13 23:01:07,857 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-13 23:01:07,858 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=97, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1694646667858 2023-09-13 23:01:07,858 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-09-13 23:01:07,858 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-13 23:01:07,859 DEBUG [Listener at jenkins-hbase4.apache.org/37017] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-13 23:01:07,859 DEBUG [Listener at jenkins-hbase4.apache.org/37017] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-13 23:01:07,860 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-13 23:01:07,860 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=97, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-13 23:01:07,861 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=97, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 4 msec 2023-09-13 23:01:07,862 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-13 23:01:07,863 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=98, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1694646667863 2023-09-13 23:01:07,873 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testEmptyExportFileSystemState 2023-09-13 23:01:07,873 INFO [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testEmptyExportFileSystemState' 2023-09-13 23:01:07,873 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-13 23:01:07,874 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-09-13 23:01:07,874 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-09-13 23:01:07,875 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-13 23:01:07,875 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-13 23:01:07,876 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:34119-0x100a784b9ba0002, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 23:01:07,876 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:42165-0x100a784b9ba0003, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 23:01:07,876 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 23:01:07,876 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 23:01:07,876 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 23:01:07,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 23:01:07,876 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:39163-0x100a784b9ba0001, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 23:01:07,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 23:01:07,876 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 23:01:07,876 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 23:01:07,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 23:01:07,876 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 23:01:07,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-13 23:01:07,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-13 23:01:07,877 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 23:01:07,877 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-13 23:01:07,877 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34119-0x100a784b9ba0002, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-13 23:01:07,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-13 23:01:07,877 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42165-0x100a784b9ba0003, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-13 23:01:07,877 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39163-0x100a784b9ba0001, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-13 23:01:07,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-09-13 23:01:07,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-13 23:01:07,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-09-13 23:01:07,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-13 23:01:07,877 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-13 23:01:07,877 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-13 23:01:07,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-09-13 23:01:07,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-13 23:01:07,877 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-09-13 23:01:07,878 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-13 23:01:07,878 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-13 23:01:07,878 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-09-13 23:01:07,878 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-13 23:01:07,878 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1694645979883' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-13 23:01:07,879 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-13 23:01:07,879 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1694645979883' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-13 23:01:07,879 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-13 23:01:07,879 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42165,1694645979926' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-09-13 23:01:07,878 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-09-13 23:01:07,879 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1694645979883' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-13 23:01:07,879 DEBUG [member: 'jenkins-hbase4.apache.org,39163,1694645979837' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-13 23:01:07,879 DEBUG [member: 'jenkins-hbase4.apache.org,39163,1694645979837' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-13 23:01:07,879 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1694645979883' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-13 23:01:07,880 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1694645979883' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34119,1694645979883' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-09-13 23:01:07,882 DEBUG [member: 'jenkins-hbase4.apache.org,39163,1694645979837' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-13 23:01:07,883 DEBUG [member: 'jenkins-hbase4.apache.org,39163,1694645979837' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-13 23:01:07,883 DEBUG [member: 'jenkins-hbase4.apache.org,39163,1694645979837' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39163,1694645979837' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-09-13 23:01:07,884 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-13 23:01:07,884 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 23:01:07,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 23:01:07,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-13 23:01:07,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-13 23:01:07,884 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1694645979883' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-13 23:01:07,885 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 23:01:07,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-13 23:01:07,885 DEBUG [member: 'jenkins-hbase4.apache.org,39163,1694645979837' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-13 23:01:07,885 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42165-0x100a784b9ba0003, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-13 23:01:07,885 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-13 23:01:07,885 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1694645979883' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34119-0x100a784b9ba0002, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-13 23:01:07,885 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1694645979883' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-13 23:01:07,885 DEBUG [member: 'jenkins-hbase4.apache.org,39163,1694645979837' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39163-0x100a784b9ba0001, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-13 23:01:07,885 DEBUG [member: 'jenkins-hbase4.apache.org,39163,1694645979837' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-13 23:01:07,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-13 23:01:07,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-13 23:01:07,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34119,1694645979883 2023-09-13 23:01:07,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 23:01:07,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 23:01:07,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-13 23:01:07,886 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42165,1694645979926' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-09-13 23:01:07,886 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4516b309[Count = 1] remaining members to acquire global barrier 2023-09-13 23:01:07,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 23:01:07,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-13 23:01:07,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-13 23:01:07,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-13 23:01:07,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-13 23:01:07,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-13 23:01:07,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34119,1694645979883 2023-09-13 23:01:07,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 23:01:07,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 23:01:07,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-13 23:01:07,888 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39163,1694645979837' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-09-13 23:01:07,888 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4516b309[Count = 0] remaining members to acquire global barrier 2023-09-13 23:01:07,888 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-09-13 23:01:07,888 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-13 23:01:07,892 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:34119-0x100a784b9ba0002, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-13 23:01:07,892 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:42165-0x100a784b9ba0003, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-13 23:01:07,893 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-13 23:01:07,892 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:39163-0x100a784b9ba0001, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-13 23:01:07,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-13 23:01:07,893 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-13 23:01:07,893 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1694645979883' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-13 23:01:07,893 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-13 23:01:07,893 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 23:01:07,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-13 23:01:07,893 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1694645979883' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-09-13 23:01:07,893 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-13 23:01:07,893 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1694645979883' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,34119,1694645979883' in zk 2023-09-13 23:01:07,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-13 23:01:07,893 DEBUG [member: 'jenkins-hbase4.apache.org,39163,1694645979837' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-13 23:01:07,893 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 23:01:07,893 DEBUG [rs(jenkins-hbase4.apache.org,42165,1694645979926)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1694646067060.f80fb935d61d9c4b7d1ebdca9aadf3d0. 2023-09-13 23:01:07,893 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-13 23:01:07,893 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-13 23:01:07,893 DEBUG [rs(jenkins-hbase4.apache.org,39163,1694645979837)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1694646067060.bec6a7441f41b9c3f629041f7afc7882. 2023-09-13 23:01:07,893 DEBUG [rs(jenkins-hbase4.apache.org,42165,1694645979926)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1694646067060.f80fb935d61d9c4b7d1ebdca9aadf3d0. started... 2023-09-13 23:01:07,893 DEBUG [member: 'jenkins-hbase4.apache.org,39163,1694645979837' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-13 23:01:07,893 DEBUG [member: 'jenkins-hbase4.apache.org,39163,1694645979837' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-13 23:01:07,893 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-13 23:01:07,894 INFO [rs(jenkins-hbase4.apache.org,42165,1694645979926)-snapshot-pool-0] regionserver.HRegion(2745): Flushing f80fb935d61d9c4b7d1ebdca9aadf3d0 1/1 column families, dataSize=132 B heapSize=544 B 2023-09-13 23:01:07,893 DEBUG [rs(jenkins-hbase4.apache.org,39163,1694645979837)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1694646067060.bec6a7441f41b9c3f629041f7afc7882. started... 2023-09-13 23:01:07,894 INFO [rs(jenkins-hbase4.apache.org,39163,1694645979837)-snapshot-pool-0] regionserver.HRegion(2745): Flushing bec6a7441f41b9c3f629041f7afc7882 1/1 column families, dataSize=3.13 KB heapSize=7 KB 2023-09-13 23:01:07,894 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1694645979883' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-13 23:01:07,894 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1694645979883' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-13 23:01:07,895 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1694645979883' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-09-13 23:01:07,911 INFO [rs(jenkins-hbase4.apache.org,42165,1694645979926)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230913e61b1624df264c11816547c8a266ea50 to hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230913e61b1624df264c11816547c8a266ea50 2023-09-13 23:01:07,911 INFO [rs(jenkins-hbase4.apache.org,39163,1694645979837)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023091337f6f53ee06a48cbb81e97d93ca8810a to hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b2023091337f6f53ee06a48cbb81e97d93ca8810a 2023-09-13 23:01:07,918 INFO [rs(jenkins-hbase4.apache.org,42165,1694645979926)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=132, hasBloomFilter=true, into tmp file hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/default/testtb-testEmptyExportFileSystemState/f80fb935d61d9c4b7d1ebdca9aadf3d0/.tmp/cf/bc2f10aef07849868bd4761988011912 2023-09-13 23:01:07,919 INFO [rs(jenkins-hbase4.apache.org,39163,1694645979837)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/default/testtb-testEmptyExportFileSystemState/bec6a7441f41b9c3f629041f7afc7882/.tmp/cf/ba00ff8fee7c4639b4680329a1134ab0 2023-09-13 23:01:07,923 DEBUG [rs(jenkins-hbase4.apache.org,42165,1694645979926)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/default/testtb-testEmptyExportFileSystemState/f80fb935d61d9c4b7d1ebdca9aadf3d0/.tmp/cf/bc2f10aef07849868bd4761988011912 as hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/default/testtb-testEmptyExportFileSystemState/f80fb935d61d9c4b7d1ebdca9aadf3d0/cf/bc2f10aef07849868bd4761988011912 2023-09-13 23:01:07,924 DEBUG [rs(jenkins-hbase4.apache.org,39163,1694645979837)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/default/testtb-testEmptyExportFileSystemState/bec6a7441f41b9c3f629041f7afc7882/.tmp/cf/ba00ff8fee7c4639b4680329a1134ab0 as hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/default/testtb-testEmptyExportFileSystemState/bec6a7441f41b9c3f629041f7afc7882/cf/ba00ff8fee7c4639b4680329a1134ab0 2023-09-13 23:01:07,929 INFO [rs(jenkins-hbase4.apache.org,39163,1694645979837)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/default/testtb-testEmptyExportFileSystemState/bec6a7441f41b9c3f629041f7afc7882/cf/ba00ff8fee7c4639b4680329a1134ab0, entries=48, sequenceid=6, filesize=13.2 K 2023-09-13 23:01:07,929 INFO [rs(jenkins-hbase4.apache.org,42165,1694645979926)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/default/testtb-testEmptyExportFileSystemState/f80fb935d61d9c4b7d1ebdca9aadf3d0/cf/bc2f10aef07849868bd4761988011912, entries=2, sequenceid=6, filesize=5.2 K 2023-09-13 23:01:07,929 INFO [rs(jenkins-hbase4.apache.org,39163,1694645979837)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.13 KB/3204, heapSize ~6.98 KB/7152, currentSize=0 B/0 for bec6a7441f41b9c3f629041f7afc7882 in 35ms, sequenceid=6, compaction requested=false 2023-09-13 23:01:07,929 DEBUG [rs(jenkins-hbase4.apache.org,39163,1694645979837)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testEmptyExportFileSystemState' 2023-09-13 23:01:07,930 INFO [rs(jenkins-hbase4.apache.org,42165,1694645979926)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~132 B/132, heapSize ~528 B/528, currentSize=0 B/0 for f80fb935d61d9c4b7d1ebdca9aadf3d0 in 36ms, sequenceid=6, compaction requested=false 2023-09-13 23:01:07,930 DEBUG [rs(jenkins-hbase4.apache.org,42165,1694645979926)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testEmptyExportFileSystemState' 2023-09-13 23:01:07,932 DEBUG [rs(jenkins-hbase4.apache.org,39163,1694645979837)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for bec6a7441f41b9c3f629041f7afc7882: 2023-09-13 23:01:07,933 DEBUG [rs(jenkins-hbase4.apache.org,42165,1694645979926)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for f80fb935d61d9c4b7d1ebdca9aadf3d0: 2023-09-13 23:01:07,933 DEBUG [rs(jenkins-hbase4.apache.org,39163,1694645979837)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1694646067060.bec6a7441f41b9c3f629041f7afc7882.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-09-13 23:01:07,933 DEBUG [rs(jenkins-hbase4.apache.org,42165,1694645979926)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1694646067060.f80fb935d61d9c4b7d1ebdca9aadf3d0.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-09-13 23:01:07,933 DEBUG [rs(jenkins-hbase4.apache.org,39163,1694645979837)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-13 23:01:07,934 DEBUG [rs(jenkins-hbase4.apache.org,42165,1694645979926)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-13 23:01:07,934 DEBUG [rs(jenkins-hbase4.apache.org,39163,1694645979837)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/default/testtb-testEmptyExportFileSystemState/bec6a7441f41b9c3f629041f7afc7882/cf/ba00ff8fee7c4639b4680329a1134ab0] hfiles 2023-09-13 23:01:07,934 DEBUG [rs(jenkins-hbase4.apache.org,42165,1694645979926)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/default/testtb-testEmptyExportFileSystemState/f80fb935d61d9c4b7d1ebdca9aadf3d0/cf/bc2f10aef07849868bd4761988011912] hfiles 2023-09-13 23:01:07,934 DEBUG [rs(jenkins-hbase4.apache.org,42165,1694645979926)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/default/testtb-testEmptyExportFileSystemState/f80fb935d61d9c4b7d1ebdca9aadf3d0/cf/bc2f10aef07849868bd4761988011912 for snapshot=snaptb0-testEmptyExportFileSystemState 2023-09-13 23:01:07,934 DEBUG [rs(jenkins-hbase4.apache.org,39163,1694645979837)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/default/testtb-testEmptyExportFileSystemState/bec6a7441f41b9c3f629041f7afc7882/cf/ba00ff8fee7c4639b4680329a1134ab0 for snapshot=snaptb0-testEmptyExportFileSystemState 2023-09-13 23:01:07,940 DEBUG [rs(jenkins-hbase4.apache.org,42165,1694645979926)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1694646067060.f80fb935d61d9c4b7d1ebdca9aadf3d0. completed. 2023-09-13 23:01:07,940 DEBUG [rs(jenkins-hbase4.apache.org,39163,1694645979837)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1694646067060.bec6a7441f41b9c3f629041f7afc7882. completed. 2023-09-13 23:01:07,940 DEBUG [rs(jenkins-hbase4.apache.org,39163,1694645979837)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1694646067060.bec6a7441f41b9c3f629041f7afc7882. 2023-09-13 23:01:07,940 DEBUG [rs(jenkins-hbase4.apache.org,42165,1694645979926)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1694646067060.f80fb935d61d9c4b7d1ebdca9aadf3d0. 2023-09-13 23:01:07,940 DEBUG [member: 'jenkins-hbase4.apache.org,39163,1694645979837' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-13 23:01:07,941 DEBUG [member: 'jenkins-hbase4.apache.org,39163,1694645979837' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-13 23:01:07,940 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-13 23:01:07,941 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-13 23:01:07,941 DEBUG [member: 'jenkins-hbase4.apache.org,39163,1694645979837' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 23:01:07,941 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 23:01:07,941 DEBUG [member: 'jenkins-hbase4.apache.org,39163,1694645979837' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-09-13 23:01:07,941 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-09-13 23:01:07,941 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,42165,1694645979926' in zk 2023-09-13 23:01:07,941 DEBUG [member: 'jenkins-hbase4.apache.org,39163,1694645979837' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,39163,1694645979837' in zk 2023-09-13 23:01:07,942 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-13 23:01:07,942 DEBUG [member: 'jenkins-hbase4.apache.org,39163,1694645979837' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-13 23:01:07,942 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-13 23:01:07,942 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 23:01:07,942 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-09-13 23:01:07,943 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 23:01:07,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 23:01:07,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-13 23:01:07,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-13 23:01:07,942 DEBUG [member: 'jenkins-hbase4.apache.org,39163,1694645979837' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-13 23:01:07,944 DEBUG [member: 'jenkins-hbase4.apache.org,39163,1694645979837' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-09-13 23:01:07,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-13 23:01:07,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-13 23:01:07,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-13 23:01:07,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34119,1694645979883 2023-09-13 23:01:07,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 23:01:07,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 23:01:07,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-13 23:01:07,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-13 23:01:07,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34119,1694645979883 2023-09-13 23:01:07,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 23:01:07,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 23:01:07,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,42165,1694645979926': 2023-09-13 23:01:07,948 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42165,1694645979926' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-09-13 23:01:07,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 23:01:07,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-13 23:01:07,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-13 23:01:07,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-13 23:01:07,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-13 23:01:07,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-13 23:01:07,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34119,1694645979883 2023-09-13 23:01:07,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 23:01:07,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 23:01:07,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-13 23:01:07,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-13 23:01:07,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34119,1694645979883 2023-09-13 23:01:07,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 23:01:07,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 23:01:07,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,39163,1694645979837': 2023-09-13 23:01:07,950 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39163,1694645979837' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-09-13 23:01:07,950 INFO [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testEmptyExportFileSystemState' execution completed 2023-09-13 23:01:07,951 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-13 23:01:07,951 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-13 23:01:07,951 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testEmptyExportFileSystemState 2023-09-13 23:01:07,951 INFO [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-13 23:01:07,952 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:42165-0x100a784b9ba0003, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-13 23:01:07,952 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:39163-0x100a784b9ba0001, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-13 23:01:07,952 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-13 23:01:07,952 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-13 23:01:07,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-13 23:01:07,952 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-13 23:01:07,952 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:39163-0x100a784b9ba0001, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 23:01:07,952 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:42165-0x100a784b9ba0003, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 23:01:07,952 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:34119-0x100a784b9ba0002, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-13 23:01:07,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-13 23:01:07,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-13 23:01:07,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-13 23:01:07,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-13 23:01:07,953 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-13 23:01:07,953 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:34119-0x100a784b9ba0002, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 23:01:07,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-13 23:01:07,953 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 23:01:07,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 23:01:07,953 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34119,1694645979883 2023-09-13 23:01:07,953 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 23:01:07,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 23:01:07,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-13 23:01:07,953 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 23:01:07,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 23:01:07,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-13 23:01:07,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-13 23:01:07,954 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 23:01:07,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-13 23:01:07,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-13 23:01:07,954 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 23:01:07,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-13 23:01:07,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-13 23:01:07,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34119,1694645979883 2023-09-13 23:01:07,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 23:01:07,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 23:01:07,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-13 23:01:07,955 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34119,1694645979883 2023-09-13 23:01:07,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-13 23:01:07,955 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 23:01:07,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34119,1694645979883 2023-09-13 23:01:07,956 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 23:01:07,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 23:01:07,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 23:01:07,959 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 23:01:07,959 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-13 23:01:07,959 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:39163-0x100a784b9ba0001, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 23:01:07,959 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:42165-0x100a784b9ba0003, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 23:01:07,959 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 23:01:07,959 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 23:01:07,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 23:01:07,959 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:34119-0x100a784b9ba0002, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 23:01:07,959 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testEmptyExportFileSystemState 2023-09-13 23:01:07,959 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:34119-0x100a784b9ba0002, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 23:01:07,959 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 23:01:07,959 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-09-13 23:01:07,959 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 23:01:07,959 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-09-13 23:01:07,959 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-13 23:01:07,959 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34119,1694645979883 2023-09-13 23:01:07,959 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:39163-0x100a784b9ba0001, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 23:01:07,961 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-13 23:01:07,959 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:42165-0x100a784b9ba0003, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 23:01:07,961 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 23:01:07,961 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 23:01:07,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 23:01:07,960 DEBUG [Listener at jenkins-hbase4.apache.org/37017] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-13 23:01:07,960 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-13 23:01:07,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 23:01:07,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 23:01:07,961 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-13 23:01:07,961 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 23:01:07,961 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34119,1694645979883 2023-09-13 23:01:07,961 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-13 23:01:07,961 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-13 23:01:07,961 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 23:01:07,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 23:01:07,962 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 23:01:07,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 23:01:07,962 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b2023091337f6f53ee06a48cbb81e97d93ca8810a, hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230913e61b1624df264c11816547c8a266ea50] mob files 2023-09-13 23:01:07,962 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b2023091337f6f53ee06a48cbb81e97d93ca8810a 2023-09-13 23:01:07,962 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230913e61b1624df264c11816547c8a266ea50 2023-09-13 23:01:07,963 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-13 23:01:07,963 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-09-13 23:01:07,963 DEBUG [Listener at jenkins-hbase4.apache.org/37017] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-13 23:01:07,968 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testEmptyExportFileSystemState 2023-09-13 23:01:07,969 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-09-13 23:01:07,992 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState to hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.hbase-snapshot/snaptb0-testEmptyExportFileSystemState 2023-09-13 23:01:07,992 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-09-13 23:01:07,992 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-09-13 23:01:07,993 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-09-13 23:01:07,993 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1694646067858Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1694646067968 (+110 ms)Consolidate snapshot: snaptb0-testEmptyExportFileSystemState at 1694646067968Loading Region manifests for snaptb0-testEmptyExportFileSystemState at 1694646067968Writing data manifest for snaptb0-testEmptyExportFileSystemState at 1694646067972 (+4 ms)Verifying snapshot: snaptb0-testEmptyExportFileSystemState at 1694646067985 (+13 ms)Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1694646067992 (+7 ms) 2023-09-13 23:01:07,995 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=98, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-13 23:01:07,997 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=98, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 137 msec 2023-09-13 23:01:08,163 DEBUG [Listener at jenkins-hbase4.apache.org/37017] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-13 23:01:08,164 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-13 23:01:08,164 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-13 23:01:08,165 INFO [Listener at jenkins-hbase4.apache.org/37017] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/export-test/export-1694646068165 2023-09-13 23:01:08,165 INFO [Listener at jenkins-hbase4.apache.org/37017] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:36267, tgtDir=hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/export-test/export-1694646068165, rawTgtDir=hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/export-test/export-1694646068165, srcFsUri=hdfs://localhost:36267, srcDir=hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d 2023-09-13 23:01:08,187 DEBUG [Listener at jenkins-hbase4.apache.org/37017] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:36267, inputRoot=hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d 2023-09-13 23:01:08,187 DEBUG [Listener at jenkins-hbase4.apache.org/37017] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_244045138_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/export-test/export-1694646068165, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/export-test/export-1694646068165/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-09-13 23:01:08,187 INFO [Listener at jenkins-hbase4.apache.org/37017] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:36267, inputRoot=hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d, snapshotDir=hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState. 2023-09-13 23:01:08,192 INFO [Listener at jenkins-hbase4.apache.org/37017] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/export-test/export-1694646068165/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-09-13 23:01:08,208 DEBUG [Listener at jenkins-hbase4.apache.org/37017] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-13 23:01:08,209 DEBUG [Listener at jenkins-hbase4.apache.org/37017] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-13 23:01:08,209 DEBUG [Listener at jenkins-hbase4.apache.org/37017] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-13 23:01:08,209 DEBUG [Listener at jenkins-hbase4.apache.org/37017] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-13 23:01:09,087 DEBUG [Listener at jenkins-hbase4.apache.org/37017] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/62bf382e-8712-1db5-f7ab-e78a401ad305/hadoop-5738896015566648553.jar 2023-09-13 23:01:09,088 DEBUG [Listener at jenkins-hbase4.apache.org/37017] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-13 23:01:09,088 DEBUG [Listener at jenkins-hbase4.apache.org/37017] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-13 23:01:09,154 DEBUG [Listener at jenkins-hbase4.apache.org/37017] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/62bf382e-8712-1db5-f7ab-e78a401ad305/hadoop-7320355554786142232.jar 2023-09-13 23:01:09,154 DEBUG [Listener at jenkins-hbase4.apache.org/37017] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-13 23:01:09,155 DEBUG [Listener at jenkins-hbase4.apache.org/37017] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-13 23:01:09,155 DEBUG [Listener at jenkins-hbase4.apache.org/37017] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-13 23:01:09,155 DEBUG [Listener at jenkins-hbase4.apache.org/37017] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-13 23:01:09,156 DEBUG [Listener at jenkins-hbase4.apache.org/37017] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-13 23:01:09,156 DEBUG [Listener at jenkins-hbase4.apache.org/37017] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-13 23:01:09,156 DEBUG [Listener at jenkins-hbase4.apache.org/37017] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-13 23:01:09,157 DEBUG [Listener at jenkins-hbase4.apache.org/37017] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-13 23:01:09,157 DEBUG [Listener at jenkins-hbase4.apache.org/37017] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-13 23:01:09,157 DEBUG [Listener at jenkins-hbase4.apache.org/37017] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-13 23:01:09,158 DEBUG [Listener at jenkins-hbase4.apache.org/37017] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-13 23:01:09,158 DEBUG [Listener at jenkins-hbase4.apache.org/37017] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-13 23:01:09,158 DEBUG [Listener at jenkins-hbase4.apache.org/37017] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-13 23:01:09,159 DEBUG [Listener at jenkins-hbase4.apache.org/37017] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-13 23:01:09,159 DEBUG [Listener at jenkins-hbase4.apache.org/37017] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-13 23:01:09,160 DEBUG [Listener at jenkins-hbase4.apache.org/37017] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-13 23:01:09,160 DEBUG [Listener at jenkins-hbase4.apache.org/37017] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-13 23:01:09,160 DEBUG [Listener at jenkins-hbase4.apache.org/37017] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-13 23:01:09,161 DEBUG [Listener at jenkins-hbase4.apache.org/37017] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-13 23:01:09,161 DEBUG [Listener at jenkins-hbase4.apache.org/37017] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-13 23:01:09,161 DEBUG [Listener at jenkins-hbase4.apache.org/37017] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-13 23:01:09,162 DEBUG [Listener at jenkins-hbase4.apache.org/37017] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-13 23:01:09,162 DEBUG [Listener at jenkins-hbase4.apache.org/37017] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-13 23:01:09,508 WARN [Listener at jenkins-hbase4.apache.org/37017] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-13 23:01:09,510 INFO [Listener at jenkins-hbase4.apache.org/37017] snapshot.ExportSnapshot(578): Loading Snapshot 'emptySnaptb0-testEmptyExportFileSystemState' hfile list 2023-09-13 23:01:10,552 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-13 23:01:10,552 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-13 23:01:10,558 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694645986290_0005_000001 (auth:SIMPLE) 2023-09-13 23:01:11,220 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694645986290_0006_000001 (auth:SIMPLE) 2023-09-13 23:01:11,932 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-13 23:01:14,820 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694645986290_0006_000001 (auth:SIMPLE) 2023-09-13 23:01:17,838 INFO [Listener at jenkins-hbase4.apache.org/37017] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-13 23:01:17,839 INFO [Listener at jenkins-hbase4.apache.org/37017] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-13 23:01:17,844 INFO [Listener at jenkins-hbase4.apache.org/37017] snapshot.ExportSnapshot(1127): Export Completed: emptySnaptb0-testEmptyExportFileSystemState 2023-09-13 23:01:17,844 INFO [Listener at jenkins-hbase4.apache.org/37017] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-13 23:01:17,844 INFO [Listener at jenkins-hbase4.apache.org/37017] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-13 23:01:17,844 DEBUG [Listener at jenkins-hbase4.apache.org/37017] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-527948888_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-09-13 23:01:17,845 DEBUG [Listener at jenkins-hbase4.apache.org/37017] snapshot.TestExportSnapshot(367): hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-09-13 23:01:17,845 DEBUG [Listener at jenkins-hbase4.apache.org/37017] snapshot.TestExportSnapshot(367): hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-09-13 23:01:17,845 DEBUG [Listener at jenkins-hbase4.apache.org/37017] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-527948888_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/export-test/export-1694646068165/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/export-test/export-1694646068165/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-09-13 23:01:17,845 DEBUG [Listener at jenkins-hbase4.apache.org/37017] snapshot.TestExportSnapshot(367): hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/export-test/export-1694646068165/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-09-13 23:01:17,845 DEBUG [Listener at jenkins-hbase4.apache.org/37017] snapshot.TestExportSnapshot(367): hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/export-test/export-1694646068165/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-09-13 23:01:17,851 INFO [Listener at jenkins-hbase4.apache.org/37017] client.HBaseAdmin$15(890): Started disable of testtb-testEmptyExportFileSystemState 2023-09-13 23:01:17,851 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testEmptyExportFileSystemState 2023-09-13 23:01:17,852 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] procedure2.ProcedureExecutor(1028): Stored pid=99, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-13 23:01:17,856 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-09-13 23:01:17,856 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694646077856"}]},"ts":"1694646077856"} 2023-09-13 23:01:17,857 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLING in hbase:meta 2023-09-13 23:01:17,859 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testEmptyExportFileSystemState to state=DISABLING 2023-09-13 23:01:17,860 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=f80fb935d61d9c4b7d1ebdca9aadf3d0, UNASSIGN}, {pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=bec6a7441f41b9c3f629041f7afc7882, UNASSIGN}] 2023-09-13 23:01:17,864 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=f80fb935d61d9c4b7d1ebdca9aadf3d0, UNASSIGN 2023-09-13 23:01:17,864 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=bec6a7441f41b9c3f629041f7afc7882, UNASSIGN 2023-09-13 23:01:17,865 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=f80fb935d61d9c4b7d1ebdca9aadf3d0, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 23:01:17,865 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=bec6a7441f41b9c3f629041f7afc7882, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 23:01:17,865 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1694646067060.f80fb935d61d9c4b7d1ebdca9aadf3d0.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1694646077865"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694646077865"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694646077865"}]},"ts":"1694646077865"} 2023-09-13 23:01:17,865 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1694646067060.bec6a7441f41b9c3f629041f7afc7882.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1694646077865"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694646077865"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694646077865"}]},"ts":"1694646077865"} 2023-09-13 23:01:17,867 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=102, ppid=100, state=RUNNABLE; CloseRegionProcedure f80fb935d61d9c4b7d1ebdca9aadf3d0, server=jenkins-hbase4.apache.org,42165,1694645979926}] 2023-09-13 23:01:17,868 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=103, ppid=101, state=RUNNABLE; CloseRegionProcedure bec6a7441f41b9c3f629041f7afc7882, server=jenkins-hbase4.apache.org,39163,1694645979837}] 2023-09-13 23:01:17,956 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-09-13 23:01:18,019 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close f80fb935d61d9c4b7d1ebdca9aadf3d0 2023-09-13 23:01:18,019 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close bec6a7441f41b9c3f629041f7afc7882 2023-09-13 23:01:18,019 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing f80fb935d61d9c4b7d1ebdca9aadf3d0, disabling compactions & flushes 2023-09-13 23:01:18,019 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing bec6a7441f41b9c3f629041f7afc7882, disabling compactions & flushes 2023-09-13 23:01:18,019 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1694646067060.f80fb935d61d9c4b7d1ebdca9aadf3d0. 2023-09-13 23:01:18,019 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1694646067060.f80fb935d61d9c4b7d1ebdca9aadf3d0. 2023-09-13 23:01:18,019 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1694646067060.f80fb935d61d9c4b7d1ebdca9aadf3d0. after waiting 0 ms 2023-09-13 23:01:18,019 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1694646067060.f80fb935d61d9c4b7d1ebdca9aadf3d0. 2023-09-13 23:01:18,019 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1694646067060.bec6a7441f41b9c3f629041f7afc7882. 2023-09-13 23:01:18,019 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1694646067060.bec6a7441f41b9c3f629041f7afc7882. 2023-09-13 23:01:18,019 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1694646067060.bec6a7441f41b9c3f629041f7afc7882. after waiting 0 ms 2023-09-13 23:01:18,019 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1694646067060.bec6a7441f41b9c3f629041f7afc7882. 2023-09-13 23:01:18,027 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/default/testtb-testEmptyExportFileSystemState/bec6a7441f41b9c3f629041f7afc7882/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-13 23:01:18,027 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/default/testtb-testEmptyExportFileSystemState/f80fb935d61d9c4b7d1ebdca9aadf3d0/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-13 23:01:18,027 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-13 23:01:18,027 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-13 23:01:18,028 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1694646067060.bec6a7441f41b9c3f629041f7afc7882. 2023-09-13 23:01:18,029 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1694646067060.f80fb935d61d9c4b7d1ebdca9aadf3d0. 2023-09-13 23:01:18,029 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for bec6a7441f41b9c3f629041f7afc7882: 2023-09-13 23:01:18,029 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for f80fb935d61d9c4b7d1ebdca9aadf3d0: 2023-09-13 23:01:18,030 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed f80fb935d61d9c4b7d1ebdca9aadf3d0 2023-09-13 23:01:18,030 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=f80fb935d61d9c4b7d1ebdca9aadf3d0, regionState=CLOSED 2023-09-13 23:01:18,031 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1694646067060.f80fb935d61d9c4b7d1ebdca9aadf3d0.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1694646078030"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694646078030"}]},"ts":"1694646078030"} 2023-09-13 23:01:18,031 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed bec6a7441f41b9c3f629041f7afc7882 2023-09-13 23:01:18,031 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=bec6a7441f41b9c3f629041f7afc7882, regionState=CLOSED 2023-09-13 23:01:18,031 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1694646067060.bec6a7441f41b9c3f629041f7afc7882.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1694646078031"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694646078031"}]},"ts":"1694646078031"} 2023-09-13 23:01:18,033 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=102, resume processing ppid=100 2023-09-13 23:01:18,033 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=102, ppid=100, state=SUCCESS; CloseRegionProcedure f80fb935d61d9c4b7d1ebdca9aadf3d0, server=jenkins-hbase4.apache.org,42165,1694645979926 in 166 msec 2023-09-13 23:01:18,034 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=103, resume processing ppid=101 2023-09-13 23:01:18,034 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=103, ppid=101, state=SUCCESS; CloseRegionProcedure bec6a7441f41b9c3f629041f7afc7882, server=jenkins-hbase4.apache.org,39163,1694645979837 in 165 msec 2023-09-13 23:01:18,034 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=100, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=f80fb935d61d9c4b7d1ebdca9aadf3d0, UNASSIGN in 173 msec 2023-09-13 23:01:18,035 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=101, resume processing ppid=99 2023-09-13 23:01:18,035 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=101, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=bec6a7441f41b9c3f629041f7afc7882, UNASSIGN in 174 msec 2023-09-13 23:01:18,036 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694646078036"}]},"ts":"1694646078036"} 2023-09-13 23:01:18,037 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLED in hbase:meta 2023-09-13 23:01:18,038 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testEmptyExportFileSystemState to state=DISABLED 2023-09-13 23:01:18,039 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=99, state=SUCCESS; DisableTableProcedure table=testtb-testEmptyExportFileSystemState in 187 msec 2023-09-13 23:01:18,158 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-09-13 23:01:18,158 INFO [Listener at jenkins-hbase4.apache.org/37017] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 99 completed 2023-09-13 23:01:18,159 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testEmptyExportFileSystemState 2023-09-13 23:01:18,160 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] procedure2.ProcedureExecutor(1028): Stored pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-13 23:01:18,162 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-13 23:01:18,162 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] access.PermissionStorage(259): Removing permissions of removed table testtb-testEmptyExportFileSystemState 2023-09-13 23:01:18,162 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=104, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-13 23:01:18,164 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39163] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testEmptyExportFileSystemState 2023-09-13 23:01:18,166 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.tmp/data/default/testtb-testEmptyExportFileSystemState/bec6a7441f41b9c3f629041f7afc7882 2023-09-13 23:01:18,166 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.tmp/data/default/testtb-testEmptyExportFileSystemState/f80fb935d61d9c4b7d1ebdca9aadf3d0 2023-09-13 23:01:18,168 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:42165-0x100a784b9ba0003, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-13 23:01:18,168 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:34119-0x100a784b9ba0002, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-13 23:01:18,168 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:39163-0x100a784b9ba0001, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-13 23:01:18,168 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-13 23:01:18,168 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-09-13 23:01:18,168 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-09-13 23:01:18,168 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-09-13 23:01:18,169 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.tmp/data/default/testtb-testEmptyExportFileSystemState/bec6a7441f41b9c3f629041f7afc7882/cf, FileablePath, hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.tmp/data/default/testtb-testEmptyExportFileSystemState/bec6a7441f41b9c3f629041f7afc7882/recovered.edits] 2023-09-13 23:01:18,169 DEBUG [HFileArchiver-18] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.tmp/data/default/testtb-testEmptyExportFileSystemState/f80fb935d61d9c4b7d1ebdca9aadf3d0/cf, FileablePath, hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.tmp/data/default/testtb-testEmptyExportFileSystemState/f80fb935d61d9c4b7d1ebdca9aadf3d0/recovered.edits] 2023-09-13 23:01:18,169 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:34119-0x100a784b9ba0002, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-13 23:01:18,169 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:39163-0x100a784b9ba0001, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-13 23:01:18,169 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:42165-0x100a784b9ba0003, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-13 23:01:18,169 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data null 2023-09-13 23:01:18,169 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:39163-0x100a784b9ba0001, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-13 23:01:18,169 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-13 23:01:18,169 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:34119-0x100a784b9ba0002, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-13 23:01:18,169 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-09-13 23:01:18,169 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:42165-0x100a784b9ba0003, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-13 23:01:18,170 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-09-13 23:01:18,173 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.tmp/data/default/testtb-testEmptyExportFileSystemState/bec6a7441f41b9c3f629041f7afc7882/cf/ba00ff8fee7c4639b4680329a1134ab0 to hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/archive/data/default/testtb-testEmptyExportFileSystemState/bec6a7441f41b9c3f629041f7afc7882/cf/ba00ff8fee7c4639b4680329a1134ab0 2023-09-13 23:01:18,174 DEBUG [HFileArchiver-18] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.tmp/data/default/testtb-testEmptyExportFileSystemState/f80fb935d61d9c4b7d1ebdca9aadf3d0/cf/bc2f10aef07849868bd4761988011912 to hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/archive/data/default/testtb-testEmptyExportFileSystemState/f80fb935d61d9c4b7d1ebdca9aadf3d0/cf/bc2f10aef07849868bd4761988011912 2023-09-13 23:01:18,176 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.tmp/data/default/testtb-testEmptyExportFileSystemState/bec6a7441f41b9c3f629041f7afc7882/recovered.edits/9.seqid to hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/archive/data/default/testtb-testEmptyExportFileSystemState/bec6a7441f41b9c3f629041f7afc7882/recovered.edits/9.seqid 2023-09-13 23:01:18,176 DEBUG [HFileArchiver-18] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.tmp/data/default/testtb-testEmptyExportFileSystemState/f80fb935d61d9c4b7d1ebdca9aadf3d0/recovered.edits/9.seqid to hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/archive/data/default/testtb-testEmptyExportFileSystemState/f80fb935d61d9c4b7d1ebdca9aadf3d0/recovered.edits/9.seqid 2023-09-13 23:01:18,176 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.tmp/data/default/testtb-testEmptyExportFileSystemState/bec6a7441f41b9c3f629041f7afc7882 2023-09-13 23:01:18,177 DEBUG [HFileArchiver-18] backup.HFileArchiver(596): Deleted hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.tmp/data/default/testtb-testEmptyExportFileSystemState/f80fb935d61d9c4b7d1ebdca9aadf3d0 2023-09-13 23:01:18,177 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-09-13 23:01:18,177 DEBUG [PEWorker-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-09-13 23:01:18,178 DEBUG [PEWorker-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf] 2023-09-13 23:01:18,180 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b2023091337f6f53ee06a48cbb81e97d93ca8810a to hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b2023091337f6f53ee06a48cbb81e97d93ca8810a 2023-09-13 23:01:18,181 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230913e61b1624df264c11816547c8a266ea50 to hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230913e61b1624df264c11816547c8a266ea50 2023-09-13 23:01:18,182 DEBUG [PEWorker-5] backup.HFileArchiver(596): Deleted hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-09-13 23:01:18,183 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=104, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-13 23:01:18,185 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testEmptyExportFileSystemState from hbase:meta 2023-09-13 23:01:18,187 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testEmptyExportFileSystemState' descriptor. 2023-09-13 23:01:18,188 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=104, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-13 23:01:18,188 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testEmptyExportFileSystemState' from region states. 2023-09-13 23:01:18,188 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,,1694646067060.f80fb935d61d9c4b7d1ebdca9aadf3d0.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1694646078188"}]},"ts":"9223372036854775807"} 2023-09-13 23:01:18,188 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,1,1694646067060.bec6a7441f41b9c3f629041f7afc7882.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1694646078188"}]},"ts":"9223372036854775807"} 2023-09-13 23:01:18,189 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-13 23:01:18,190 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => f80fb935d61d9c4b7d1ebdca9aadf3d0, NAME => 'testtb-testEmptyExportFileSystemState,,1694646067060.f80fb935d61d9c4b7d1ebdca9aadf3d0.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => bec6a7441f41b9c3f629041f7afc7882, NAME => 'testtb-testEmptyExportFileSystemState,1,1694646067060.bec6a7441f41b9c3f629041f7afc7882.', STARTKEY => '1', ENDKEY => ''}] 2023-09-13 23:01:18,190 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testEmptyExportFileSystemState' as deleted. 2023-09-13 23:01:18,190 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1694646078190"}]},"ts":"9223372036854775807"} 2023-09-13 23:01:18,191 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testEmptyExportFileSystemState state from META 2023-09-13 23:01:18,192 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=104, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-13 23:01:18,193 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=104, state=SUCCESS; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState in 34 msec 2023-09-13 23:01:18,271 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-09-13 23:01:18,272 INFO [Listener at jenkins-hbase4.apache.org/37017] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 104 completed 2023-09-13 23:01:18,278 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testEmptyExportFileSystemState" 2023-09-13 23:01:18,280 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testEmptyExportFileSystemState 2023-09-13 23:01:18,282 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testEmptyExportFileSystemState" 2023-09-13 23:01:18,283 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testEmptyExportFileSystemState 2023-09-13 23:01:18,307 INFO [Listener at jenkins-hbase4.apache.org/37017] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=766 (was 761) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1275745384_1 at /127.0.0.1:46262 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1275745384_1 at /127.0.0.1:36864 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1506713691) connection to jenkins-hbase4.apache.org/172.31.14.131:39571 from appattempt_1694645986290_0006_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-527948888_17 at /127.0.0.1:46266 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x73fd7489-shared-pool-34 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x73fd7489-shared-pool-36 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-527948888_17 at /127.0.0.1:58808 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1506713691) connection to jenkins-hbase4.apache.org/172.31.14.131:32961 from appattempt_1694645986290_0005_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: Thread-4609 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: hconnection-0x73fd7489-shared-pool-33 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-527948888_17 at /127.0.0.1:36874 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x73fd7489-shared-pool-35 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1506713691) connection to jenkins-hbase4.apache.org/172.31.14.131:37919 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) - Thread LEAK? -, OpenFileDescriptor=927 (was 915) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=128 (was 151), ProcessCount=171 (was 168) - ProcessCount LEAK? -, AvailableMemoryMB=8432 (was 8465) 2023-09-13 23:01:18,308 WARN [Listener at jenkins-hbase4.apache.org/37017] hbase.ResourceChecker(130): Thread=766 is superior to 500 2023-09-13 23:01:18,326 INFO [Listener at jenkins-hbase4.apache.org/37017] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=766, OpenFileDescriptor=927, MaxFileDescriptor=60000, SystemLoadAverage=128, ProcessCount=171, AvailableMemoryMB=8431 2023-09-13 23:01:18,326 WARN [Listener at jenkins-hbase4.apache.org/37017] hbase.ResourceChecker(130): Thread=766 is superior to 500 2023-09-13 23:01:18,327 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-13 23:01:18,328 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] procedure2.ProcedureExecutor(1028): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-13 23:01:18,330 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_PRE_OPERATION 2023-09-13 23:01:18,330 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithSkipTmp" procId is: 105 2023-09-13 23:01:18,331 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-13 23:01:18,331 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-09-13 23:01:18,333 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/4488ef83b66fe8f91cb077c19a761bee 2023-09-13 23:01:18,333 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/af595d247bb344516e7417a7dc99465e 2023-09-13 23:01:18,333 DEBUG [HFileArchiver-20] backup.HFileArchiver(153): Directory hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/4488ef83b66fe8f91cb077c19a761bee empty. 2023-09-13 23:01:18,333 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/af595d247bb344516e7417a7dc99465e empty. 2023-09-13 23:01:18,333 DEBUG [HFileArchiver-20] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/4488ef83b66fe8f91cb077c19a761bee 2023-09-13 23:01:18,334 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/af595d247bb344516e7417a7dc99465e 2023-09-13 23:01:18,334 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-09-13 23:01:18,353 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/.tabledesc/.tableinfo.0000000001 2023-09-13 23:01:18,355 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(7675): creating {ENCODED => af595d247bb344516e7417a7dc99465e, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1694646078327.af595d247bb344516e7417a7dc99465e.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.tmp 2023-09-13 23:01:18,355 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(7675): creating {ENCODED => 4488ef83b66fe8f91cb077c19a761bee, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1694646078327.4488ef83b66fe8f91cb077c19a761bee.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.tmp 2023-09-13 23:01:18,371 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1694646078327.af595d247bb344516e7417a7dc99465e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-13 23:01:18,371 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1604): Closing af595d247bb344516e7417a7dc99465e, disabling compactions & flushes 2023-09-13 23:01:18,371 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1694646078327.af595d247bb344516e7417a7dc99465e. 2023-09-13 23:01:18,371 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1694646078327.af595d247bb344516e7417a7dc99465e. 2023-09-13 23:01:18,371 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1694646078327.af595d247bb344516e7417a7dc99465e. after waiting 0 ms 2023-09-13 23:01:18,371 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1694646078327.af595d247bb344516e7417a7dc99465e. 2023-09-13 23:01:18,371 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1694646078327.af595d247bb344516e7417a7dc99465e. 2023-09-13 23:01:18,371 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1558): Region close journal for af595d247bb344516e7417a7dc99465e: 2023-09-13 23:01:18,372 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1694646078327.4488ef83b66fe8f91cb077c19a761bee.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-13 23:01:18,372 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1604): Closing 4488ef83b66fe8f91cb077c19a761bee, disabling compactions & flushes 2023-09-13 23:01:18,372 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1694646078327.4488ef83b66fe8f91cb077c19a761bee. 2023-09-13 23:01:18,372 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1694646078327.4488ef83b66fe8f91cb077c19a761bee. 2023-09-13 23:01:18,372 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1694646078327.4488ef83b66fe8f91cb077c19a761bee. after waiting 0 ms 2023-09-13 23:01:18,372 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1694646078327.4488ef83b66fe8f91cb077c19a761bee. 2023-09-13 23:01:18,372 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1694646078327.4488ef83b66fe8f91cb077c19a761bee. 2023-09-13 23:01:18,372 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1558): Region close journal for 4488ef83b66fe8f91cb077c19a761bee: 2023-09-13 23:01:18,374 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ADD_TO_META 2023-09-13 23:01:18,375 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1694646078327.af595d247bb344516e7417a7dc99465e.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1694646078375"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694646078375"}]},"ts":"1694646078375"} 2023-09-13 23:01:18,375 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1694646078327.4488ef83b66fe8f91cb077c19a761bee.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1694646078375"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694646078375"}]},"ts":"1694646078375"} 2023-09-13 23:01:18,377 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-13 23:01:18,378 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-13 23:01:18,378 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694646078378"}]},"ts":"1694646078378"} 2023-09-13 23:01:18,379 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLING in hbase:meta 2023-09-13 23:01:18,387 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-13 23:01:18,388 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-13 23:01:18,389 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-13 23:01:18,389 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-13 23:01:18,389 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-13 23:01:18,389 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=4488ef83b66fe8f91cb077c19a761bee, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=af595d247bb344516e7417a7dc99465e, ASSIGN}] 2023-09-13 23:01:18,391 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=af595d247bb344516e7417a7dc99465e, ASSIGN 2023-09-13 23:01:18,391 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=4488ef83b66fe8f91cb077c19a761bee, ASSIGN 2023-09-13 23:01:18,392 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=af595d247bb344516e7417a7dc99465e, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34119,1694645979883; forceNewPlan=false, retain=false 2023-09-13 23:01:18,392 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=4488ef83b66fe8f91cb077c19a761bee, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39163,1694645979837; forceNewPlan=false, retain=false 2023-09-13 23:01:18,432 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-09-13 23:01:18,542 INFO [jenkins-hbase4:36621] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-13 23:01:18,545 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=af595d247bb344516e7417a7dc99465e, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34119,1694645979883 2023-09-13 23:01:18,545 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=4488ef83b66fe8f91cb077c19a761bee, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 23:01:18,545 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1694646078327.af595d247bb344516e7417a7dc99465e.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1694646078545"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694646078545"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694646078545"}]},"ts":"1694646078545"} 2023-09-13 23:01:18,545 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1694646078327.4488ef83b66fe8f91cb077c19a761bee.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1694646078545"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694646078545"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694646078545"}]},"ts":"1694646078545"} 2023-09-13 23:01:18,547 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=108, ppid=106, state=RUNNABLE; OpenRegionProcedure 4488ef83b66fe8f91cb077c19a761bee, server=jenkins-hbase4.apache.org,39163,1694645979837}] 2023-09-13 23:01:18,547 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=109, ppid=107, state=RUNNABLE; OpenRegionProcedure af595d247bb344516e7417a7dc99465e, server=jenkins-hbase4.apache.org,34119,1694645979883}] 2023-09-13 23:01:18,633 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-09-13 23:01:18,701 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,1,1694646078327.af595d247bb344516e7417a7dc99465e. 2023-09-13 23:01:18,701 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,,1694646078327.4488ef83b66fe8f91cb077c19a761bee. 2023-09-13 23:01:18,701 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => af595d247bb344516e7417a7dc99465e, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1694646078327.af595d247bb344516e7417a7dc99465e.', STARTKEY => '1', ENDKEY => ''} 2023-09-13 23:01:18,701 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 4488ef83b66fe8f91cb077c19a761bee, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1694646078327.4488ef83b66fe8f91cb077c19a761bee.', STARTKEY => '', ENDKEY => '1'} 2023-09-13 23:01:18,701 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,1,1694646078327.af595d247bb344516e7417a7dc99465e. service=AccessControlService 2023-09-13 23:01:18,701 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,,1694646078327.4488ef83b66fe8f91cb077c19a761bee. service=AccessControlService 2023-09-13 23:01:18,702 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-13 23:01:18,702 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-13 23:01:18,702 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp af595d247bb344516e7417a7dc99465e 2023-09-13 23:01:18,702 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp 4488ef83b66fe8f91cb077c19a761bee 2023-09-13 23:01:18,702 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1694646078327.af595d247bb344516e7417a7dc99465e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-13 23:01:18,702 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1694646078327.4488ef83b66fe8f91cb077c19a761bee.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-13 23:01:18,702 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for af595d247bb344516e7417a7dc99465e 2023-09-13 23:01:18,702 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 4488ef83b66fe8f91cb077c19a761bee 2023-09-13 23:01:18,702 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for af595d247bb344516e7417a7dc99465e 2023-09-13 23:01:18,702 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 4488ef83b66fe8f91cb077c19a761bee 2023-09-13 23:01:18,703 INFO [StoreOpener-af595d247bb344516e7417a7dc99465e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region af595d247bb344516e7417a7dc99465e 2023-09-13 23:01:18,703 INFO [StoreOpener-4488ef83b66fe8f91cb077c19a761bee-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 4488ef83b66fe8f91cb077c19a761bee 2023-09-13 23:01:18,704 DEBUG [StoreOpener-af595d247bb344516e7417a7dc99465e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/default/testtb-testExportFileSystemStateWithSkipTmp/af595d247bb344516e7417a7dc99465e/cf 2023-09-13 23:01:18,705 DEBUG [StoreOpener-af595d247bb344516e7417a7dc99465e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/default/testtb-testExportFileSystemStateWithSkipTmp/af595d247bb344516e7417a7dc99465e/cf 2023-09-13 23:01:18,705 DEBUG [StoreOpener-4488ef83b66fe8f91cb077c19a761bee-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/default/testtb-testExportFileSystemStateWithSkipTmp/4488ef83b66fe8f91cb077c19a761bee/cf 2023-09-13 23:01:18,705 DEBUG [StoreOpener-4488ef83b66fe8f91cb077c19a761bee-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/default/testtb-testExportFileSystemStateWithSkipTmp/4488ef83b66fe8f91cb077c19a761bee/cf 2023-09-13 23:01:18,705 INFO [StoreOpener-af595d247bb344516e7417a7dc99465e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region af595d247bb344516e7417a7dc99465e columnFamilyName cf 2023-09-13 23:01:18,705 INFO [StoreOpener-4488ef83b66fe8f91cb077c19a761bee-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4488ef83b66fe8f91cb077c19a761bee columnFamilyName cf 2023-09-13 23:01:18,706 INFO [StoreOpener-af595d247bb344516e7417a7dc99465e-1] regionserver.HStore(310): Store=af595d247bb344516e7417a7dc99465e/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-13 23:01:18,706 INFO [StoreOpener-4488ef83b66fe8f91cb077c19a761bee-1] regionserver.HStore(310): Store=4488ef83b66fe8f91cb077c19a761bee/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-13 23:01:18,707 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/default/testtb-testExportFileSystemStateWithSkipTmp/af595d247bb344516e7417a7dc99465e 2023-09-13 23:01:18,707 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/default/testtb-testExportFileSystemStateWithSkipTmp/4488ef83b66fe8f91cb077c19a761bee 2023-09-13 23:01:18,707 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/default/testtb-testExportFileSystemStateWithSkipTmp/4488ef83b66fe8f91cb077c19a761bee 2023-09-13 23:01:18,708 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/default/testtb-testExportFileSystemStateWithSkipTmp/af595d247bb344516e7417a7dc99465e 2023-09-13 23:01:18,710 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for af595d247bb344516e7417a7dc99465e 2023-09-13 23:01:18,710 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 4488ef83b66fe8f91cb077c19a761bee 2023-09-13 23:01:18,712 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/default/testtb-testExportFileSystemStateWithSkipTmp/af595d247bb344516e7417a7dc99465e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-13 23:01:18,712 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/default/testtb-testExportFileSystemStateWithSkipTmp/4488ef83b66fe8f91cb077c19a761bee/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-13 23:01:18,712 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened af595d247bb344516e7417a7dc99465e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68226432, jitterRate=0.016653060913085938}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-13 23:01:18,712 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for af595d247bb344516e7417a7dc99465e: 2023-09-13 23:01:18,713 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 4488ef83b66fe8f91cb077c19a761bee; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74873459, jitterRate=0.11570148169994354}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-13 23:01:18,713 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 4488ef83b66fe8f91cb077c19a761bee: 2023-09-13 23:01:18,713 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,1,1694646078327.af595d247bb344516e7417a7dc99465e., pid=109, masterSystemTime=1694646078698 2023-09-13 23:01:18,713 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,,1694646078327.4488ef83b66fe8f91cb077c19a761bee., pid=108, masterSystemTime=1694646078698 2023-09-13 23:01:18,715 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,1,1694646078327.af595d247bb344516e7417a7dc99465e. 2023-09-13 23:01:18,715 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,1,1694646078327.af595d247bb344516e7417a7dc99465e. 2023-09-13 23:01:18,715 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=af595d247bb344516e7417a7dc99465e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34119,1694645979883 2023-09-13 23:01:18,715 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,,1694646078327.4488ef83b66fe8f91cb077c19a761bee. 2023-09-13 23:01:18,715 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,,1694646078327.4488ef83b66fe8f91cb077c19a761bee. 2023-09-13 23:01:18,716 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1694646078327.af595d247bb344516e7417a7dc99465e.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1694646078715"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1694646078715"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1694646078715"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1694646078715"}]},"ts":"1694646078715"} 2023-09-13 23:01:18,716 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=4488ef83b66fe8f91cb077c19a761bee, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 23:01:18,716 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1694646078327.4488ef83b66fe8f91cb077c19a761bee.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1694646078716"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1694646078716"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1694646078716"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1694646078716"}]},"ts":"1694646078716"} 2023-09-13 23:01:18,719 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=109, resume processing ppid=107 2023-09-13 23:01:18,719 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=109, ppid=107, state=SUCCESS; OpenRegionProcedure af595d247bb344516e7417a7dc99465e, server=jenkins-hbase4.apache.org,34119,1694645979883 in 170 msec 2023-09-13 23:01:18,719 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=108, resume processing ppid=106 2023-09-13 23:01:18,719 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=108, ppid=106, state=SUCCESS; OpenRegionProcedure 4488ef83b66fe8f91cb077c19a761bee, server=jenkins-hbase4.apache.org,39163,1694645979837 in 171 msec 2023-09-13 23:01:18,720 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=af595d247bb344516e7417a7dc99465e, ASSIGN in 330 msec 2023-09-13 23:01:18,721 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=106, resume processing ppid=105 2023-09-13 23:01:18,721 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=4488ef83b66fe8f91cb077c19a761bee, ASSIGN in 330 msec 2023-09-13 23:01:18,721 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-13 23:01:18,721 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694646078721"}]},"ts":"1694646078721"} 2023-09-13 23:01:18,722 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLED in hbase:meta 2023-09-13 23:01:18,724 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_POST_OPERATION 2023-09-13 23:01:18,724 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithSkipTmp jenkins: RWXCA 2023-09-13 23:01:18,725 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39163] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-09-13 23:01:18,727 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:42165-0x100a784b9ba0003, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-13 23:01:18,727 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-13 23:01:18,727 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:34119-0x100a784b9ba0002, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-13 23:01:18,727 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:39163-0x100a784b9ba0001, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-13 23:01:18,729 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-09-13 23:01:18,729 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-09-13 23:01:18,729 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-09-13 23:01:18,729 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-09-13 23:01:18,730 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=105, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 401 msec 2023-09-13 23:01:18,934 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-09-13 23:01:18,934 INFO [Listener at jenkins-hbase4.apache.org/37017] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 105 completed 2023-09-13 23:01:18,936 DEBUG [Listener at jenkins-hbase4.apache.org/37017] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-09-13 23:01:18,936 DEBUG [Listener at jenkins-hbase4.apache.org/37017] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1694646078327.4488ef83b66fe8f91cb077c19a761bee. 2023-09-13 23:01:18,938 INFO [Listener at jenkins-hbase4.apache.org/37017] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-13 23:01:18,948 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-13 23:01:18,948 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1694646078948 (current time:1694646078948). 2023-09-13 23:01:18,948 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-13 23:01:18,948 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] zookeeper.ReadOnlyZKClient(139): Connect 0x53692cb6 to 127.0.0.1:55012 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-13 23:01:18,954 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@10296eea, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-13 23:01:18,955 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-13 23:01:18,958 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33268, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-13 23:01:18,958 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x53692cb6 to 127.0.0.1:55012 2023-09-13 23:01:18,959 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-13 23:01:18,959 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] zookeeper.ReadOnlyZKClient(139): Connect 0x412d1664 to 127.0.0.1:55012 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-13 23:01:18,966 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5bbb9e6b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-13 23:01:18,967 DEBUG [hconnection-0xbef5c8-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-13 23:01:18,970 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33276, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-13 23:01:18,973 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-13 23:01:18,979 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42178, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-13 23:01:18,980 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x412d1664 to 127.0.0.1:55012 2023-09-13 23:01:18,980 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-13 23:01:18,980 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-09-13 23:01:18,981 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-13 23:01:18,981 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-13 23:01:18,983 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] procedure2.ProcedureExecutor(1028): Stored pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-13 23:01:18,984 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-13 23:01:18,985 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=110, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1694646678985 2023-09-13 23:01:18,985 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-09-13 23:01:18,985 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-13 23:01:18,986 DEBUG [Listener at jenkins-hbase4.apache.org/37017] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-13 23:01:18,986 DEBUG [Listener at jenkins-hbase4.apache.org/37017] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-13 23:01:18,986 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-13 23:01:18,987 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=110, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-13 23:01:18,988 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=110, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 5 msec 2023-09-13 23:01:18,988 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-13 23:01:18,989 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=111, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1694646678989 2023-09-13 23:01:18,997 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 23:01:18,997 INFO [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' 2023-09-13 23:01:18,997 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-13 23:01:18,998 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-09-13 23:01:18,998 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-09-13 23:01:18,999 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 23:01:18,999 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 23:01:19,000 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:34119-0x100a784b9ba0002, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 23:01:19,000 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 23:01:19,000 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 23:01:19,000 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:42165-0x100a784b9ba0003, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 23:01:19,000 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:39163-0x100a784b9ba0001, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 23:01:19,000 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 23:01:19,000 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 23:01:19,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 23:01:19,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 23:01:19,000 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 23:01:19,001 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34119,1694645979883 2023-09-13 23:01:19,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 23:01:19,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 23:01:19,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 23:01:19,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 23:01:19,002 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34119,1694645979883 2023-09-13 23:01:19,002 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-13 23:01:19,002 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34119-0x100a784b9ba0002, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 23:01:19,002 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42165-0x100a784b9ba0003, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 23:01:19,002 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39163-0x100a784b9ba0001, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 23:01:19,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-09-13 23:01:19,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-09-13 23:01:19,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 23:01:19,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 23:01:19,003 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-13 23:01:19,003 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-13 23:01:19,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-09-13 23:01:19,003 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 23:01:19,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 23:01:19,003 DEBUG [member: 'jenkins-hbase4.apache.org,39163,1694645979837' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-13 23:01:19,003 DEBUG [member: 'jenkins-hbase4.apache.org,39163,1694645979837' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-13 23:01:19,003 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 23:01:19,004 DEBUG [member: 'jenkins-hbase4.apache.org,39163,1694645979837' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-13 23:01:19,004 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1694645979883' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-13 23:01:19,004 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1694645979883' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-13 23:01:19,003 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-13 23:01:19,005 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1694645979883' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-13 23:01:19,005 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1694645979883' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-13 23:01:19,004 DEBUG [member: 'jenkins-hbase4.apache.org,39163,1694645979837' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-13 23:01:19,005 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1694645979883' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34119,1694645979883' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-13 23:01:19,005 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 23:01:19,005 DEBUG [member: 'jenkins-hbase4.apache.org,39163,1694645979837' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39163,1694645979837' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-13 23:01:19,005 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-13 23:01:19,005 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-13 23:01:19,006 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-13 23:01:19,006 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-13 23:01:19,006 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42165,1694645979926' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-13 23:01:19,012 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34119,1694645979883 2023-09-13 23:01:19,012 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1694645979883' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 23:01:19,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34119,1694645979883 2023-09-13 23:01:19,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-13 23:01:19,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-13 23:01:19,013 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 23:01:19,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-13 23:01:19,013 DEBUG [member: 'jenkins-hbase4.apache.org,39163,1694645979837' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 23:01:19,013 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1694645979883' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34119-0x100a784b9ba0002, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 23:01:19,013 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1694645979883' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-13 23:01:19,013 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 23:01:19,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-13 23:01:19,013 DEBUG [member: 'jenkins-hbase4.apache.org,39163,1694645979837' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39163-0x100a784b9ba0001, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 23:01:19,014 DEBUG [member: 'jenkins-hbase4.apache.org,39163,1694645979837' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-13 23:01:19,014 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42165-0x100a784b9ba0003, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 23:01:19,014 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-13 23:01:19,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 23:01:19,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34119,1694645979883 2023-09-13 23:01:19,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 23:01:19,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 23:01:19,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-13 23:01:19,015 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34119,1694645979883' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-09-13 23:01:19,015 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@357bbf70[Count = 1] remaining members to acquire global barrier 2023-09-13 23:01:19,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 23:01:19,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-13 23:01:19,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-13 23:01:19,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-13 23:01:19,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-13 23:01:19,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 23:01:19,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34119,1694645979883 2023-09-13 23:01:19,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 23:01:19,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 23:01:19,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-13 23:01:19,016 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39163,1694645979837' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-09-13 23:01:19,017 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@357bbf70[Count = 0] remaining members to acquire global barrier 2023-09-13 23:01:19,017 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-09-13 23:01:19,017 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 23:01:19,018 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:34119-0x100a784b9ba0002, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 23:01:19,018 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:39163-0x100a784b9ba0001, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 23:01:19,018 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 23:01:19,018 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 23:01:19,018 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:42165-0x100a784b9ba0003, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 23:01:19,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 23:01:19,018 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 23:01:19,018 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34119,1694645979883 2023-09-13 23:01:19,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 23:01:19,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 23:01:19,018 DEBUG [member: 'jenkins-hbase4.apache.org,39163,1694645979837' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-13 23:01:19,018 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-13 23:01:19,018 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-13 23:01:19,018 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,42165,1694645979926' in zk 2023-09-13 23:01:19,018 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1694645979883' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-13 23:01:19,018 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 23:01:19,018 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-13 23:01:19,018 DEBUG [rs(jenkins-hbase4.apache.org,39163,1694645979837)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1694646078327.4488ef83b66fe8f91cb077c19a761bee. 2023-09-13 23:01:19,018 DEBUG [member: 'jenkins-hbase4.apache.org,39163,1694645979837' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-13 23:01:19,019 DEBUG [rs(jenkins-hbase4.apache.org,34119,1694645979883)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1694646078327.af595d247bb344516e7417a7dc99465e. 2023-09-13 23:01:19,019 DEBUG [rs(jenkins-hbase4.apache.org,39163,1694645979837)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1694646078327.4488ef83b66fe8f91cb077c19a761bee. started... 2023-09-13 23:01:19,018 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1694645979883' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-13 23:01:19,019 DEBUG [rs(jenkins-hbase4.apache.org,34119,1694645979883)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1694646078327.af595d247bb344516e7417a7dc99465e. started... 2023-09-13 23:01:19,019 DEBUG [member: 'jenkins-hbase4.apache.org,39163,1694645979837' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-13 23:01:19,019 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1694645979883' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-13 23:01:19,019 DEBUG [rs(jenkins-hbase4.apache.org,39163,1694645979837)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 4488ef83b66fe8f91cb077c19a761bee: 2023-09-13 23:01:19,020 DEBUG [rs(jenkins-hbase4.apache.org,34119,1694645979883)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for af595d247bb344516e7417a7dc99465e: 2023-09-13 23:01:19,020 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-13 23:01:19,020 DEBUG [rs(jenkins-hbase4.apache.org,39163,1694645979837)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1694646078327.4488ef83b66fe8f91cb077c19a761bee.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 23:01:19,020 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-13 23:01:19,020 DEBUG [rs(jenkins-hbase4.apache.org,34119,1694645979883)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1694646078327.af595d247bb344516e7417a7dc99465e.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 23:01:19,020 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-13 23:01:19,020 DEBUG [rs(jenkins-hbase4.apache.org,39163,1694645979837)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-13 23:01:19,021 DEBUG [rs(jenkins-hbase4.apache.org,34119,1694645979883)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-13 23:01:19,021 DEBUG [rs(jenkins-hbase4.apache.org,39163,1694645979837)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-13 23:01:19,021 DEBUG [rs(jenkins-hbase4.apache.org,34119,1694645979883)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-13 23:01:19,031 DEBUG [rs(jenkins-hbase4.apache.org,34119,1694645979883)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1694646078327.af595d247bb344516e7417a7dc99465e. completed. 2023-09-13 23:01:19,031 DEBUG [rs(jenkins-hbase4.apache.org,34119,1694645979883)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1694646078327.af595d247bb344516e7417a7dc99465e. 2023-09-13 23:01:19,031 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1694645979883' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-13 23:01:19,031 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1694645979883' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-13 23:01:19,031 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1694645979883' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34119,1694645979883 2023-09-13 23:01:19,031 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1694645979883' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-13 23:01:19,031 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1694645979883' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,34119,1694645979883' in zk 2023-09-13 23:01:19,033 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34119,1694645979883 2023-09-13 23:01:19,033 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1694645979883' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-13 23:01:19,033 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1694645979883' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-13 23:01:19,033 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1694645979883' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-13 23:01:19,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34119,1694645979883 2023-09-13 23:01:19,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-13 23:01:19,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-13 23:01:19,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-13 23:01:19,035 DEBUG [rs(jenkins-hbase4.apache.org,39163,1694645979837)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1694646078327.4488ef83b66fe8f91cb077c19a761bee. completed. 2023-09-13 23:01:19,035 DEBUG [rs(jenkins-hbase4.apache.org,39163,1694645979837)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1694646078327.4488ef83b66fe8f91cb077c19a761bee. 2023-09-13 23:01:19,035 DEBUG [member: 'jenkins-hbase4.apache.org,39163,1694645979837' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-13 23:01:19,035 DEBUG [member: 'jenkins-hbase4.apache.org,39163,1694645979837' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-13 23:01:19,036 DEBUG [member: 'jenkins-hbase4.apache.org,39163,1694645979837' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 23:01:19,036 DEBUG [member: 'jenkins-hbase4.apache.org,39163,1694645979837' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-13 23:01:19,036 DEBUG [member: 'jenkins-hbase4.apache.org,39163,1694645979837' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,39163,1694645979837' in zk 2023-09-13 23:01:19,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-13 23:01:19,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 23:01:19,038 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 23:01:19,038 DEBUG [member: 'jenkins-hbase4.apache.org,39163,1694645979837' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-13 23:01:19,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34119,1694645979883 2023-09-13 23:01:19,038 DEBUG [member: 'jenkins-hbase4.apache.org,39163,1694645979837' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-13 23:01:19,039 DEBUG [member: 'jenkins-hbase4.apache.org,39163,1694645979837' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-13 23:01:19,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 23:01:19,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 23:01:19,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-13 23:01:19,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 23:01:19,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34119,1694645979883 2023-09-13 23:01:19,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 23:01:19,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 23:01:19,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,34119,1694645979883': 2023-09-13 23:01:19,042 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34119,1694645979883' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-09-13 23:01:19,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 23:01:19,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-13 23:01:19,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-13 23:01:19,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-13 23:01:19,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-13 23:01:19,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 23:01:19,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34119,1694645979883 2023-09-13 23:01:19,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 23:01:19,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 23:01:19,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-13 23:01:19,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 23:01:19,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34119,1694645979883 2023-09-13 23:01:19,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 23:01:19,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 23:01:19,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,39163,1694645979837': 2023-09-13 23:01:19,045 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39163,1694645979837' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-09-13 23:01:19,045 INFO [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-09-13 23:01:19,045 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-13 23:01:19,045 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-13 23:01:19,045 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 23:01:19,045 INFO [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-13 23:01:19,047 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:39163-0x100a784b9ba0001, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 23:01:19,047 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:42165-0x100a784b9ba0003, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 23:01:19,047 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:34119-0x100a784b9ba0002, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 23:01:19,047 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 23:01:19,047 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:42165-0x100a784b9ba0003, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 23:01:19,047 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 23:01:19,047 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 23:01:19,047 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:39163-0x100a784b9ba0001, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 23:01:19,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 23:01:19,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 23:01:19,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-13 23:01:19,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-13 23:01:19,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 23:01:19,047 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 23:01:19,048 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34119,1694645979883 2023-09-13 23:01:19,048 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 23:01:19,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 23:01:19,047 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:34119-0x100a784b9ba0002, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 23:01:19,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 23:01:19,048 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 23:01:19,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 23:01:19,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-13 23:01:19,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 23:01:19,048 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 23:01:19,048 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 23:01:19,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 23:01:19,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 23:01:19,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 23:01:19,049 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 23:01:19,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 23:01:19,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-13 23:01:19,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 23:01:19,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34119,1694645979883 2023-09-13 23:01:19,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 23:01:19,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 23:01:19,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-13 23:01:19,050 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34119,1694645979883 2023-09-13 23:01:19,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 23:01:19,051 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 23:01:19,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34119,1694645979883 2023-09-13 23:01:19,051 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 23:01:19,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 23:01:19,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 23:01:19,054 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:34119-0x100a784b9ba0002, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 23:01:19,054 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 23:01:19,054 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 23:01:19,054 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:34119-0x100a784b9ba0002, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 23:01:19,054 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:42165-0x100a784b9ba0003, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 23:01:19,054 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 23:01:19,054 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-13 23:01:19,054 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-09-13 23:01:19,054 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:39163-0x100a784b9ba0001, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 23:01:19,055 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 23:01:19,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 23:01:19,054 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 23:01:19,055 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-13 23:01:19,055 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 23:01:19,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 23:01:19,055 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:39163-0x100a784b9ba0001, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 23:01:19,054 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:42165-0x100a784b9ba0003, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 23:01:19,054 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 23:01:19,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 23:01:19,055 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 23:01:19,056 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 23:01:19,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 23:01:19,056 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34119,1694645979883 2023-09-13 23:01:19,056 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 23:01:19,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 23:01:19,056 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 23:01:19,056 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 23:01:19,056 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 23:01:19,056 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 23:01:19,056 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 23:01:19,056 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-13 23:01:19,056 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34119,1694645979883 2023-09-13 23:01:19,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 23:01:19,056 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 23:01:19,056 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 23:01:19,064 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 23:01:19,064 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 23:01:19,078 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 23:01:19,078 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-09-13 23:01:19,078 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 23:01:19,079 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 23:01:19,079 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1694646078985Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1694646079064 (+79 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1694646079064Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1694646079064Writing data manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1694646079067 (+3 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1694646079073 (+6 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1694646079078 (+5 ms) 2023-09-13 23:01:19,081 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=111, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-13 23:01:19,083 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=111, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 96 msec 2023-09-13 23:01:19,086 DEBUG [Listener at jenkins-hbase4.apache.org/37017] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-13 23:01:19,087 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-09-13 23:01:19,087 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-13 23:01:19,089 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39163] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,,1694646078327.4488ef83b66fe8f91cb077c19a761bee. with WAL disabled. Data may be lost in the event of a crash. 2023-09-13 23:01:19,090 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34119] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,1,1694646078327.af595d247bb344516e7417a7dc99465e. with WAL disabled. Data may be lost in the event of a crash. 2023-09-13 23:01:19,092 DEBUG [Listener at jenkins-hbase4.apache.org/37017] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-09-13 23:01:19,092 DEBUG [Listener at jenkins-hbase4.apache.org/37017] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1694646078327.4488ef83b66fe8f91cb077c19a761bee. 2023-09-13 23:01:19,092 INFO [Listener at jenkins-hbase4.apache.org/37017] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-13 23:01:19,100 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-13 23:01:19,100 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1694646079100 (current time:1694646079100). 2023-09-13 23:01:19,100 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-13 23:01:19,101 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] zookeeper.ReadOnlyZKClient(139): Connect 0x5a4f3024 to 127.0.0.1:55012 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-13 23:01:19,107 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2da89e10, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-13 23:01:19,108 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-13 23:01:19,111 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33278, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-13 23:01:19,111 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5a4f3024 to 127.0.0.1:55012 2023-09-13 23:01:19,111 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-13 23:01:19,112 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] zookeeper.ReadOnlyZKClient(139): Connect 0x39bd00de to 127.0.0.1:55012 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-13 23:01:19,117 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1a50c9dd, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-13 23:01:19,118 DEBUG [hconnection-0x73e19c99-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-13 23:01:19,119 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33288, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-13 23:01:19,122 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-13 23:01:19,124 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42186, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-13 23:01:19,125 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x39bd00de to 127.0.0.1:55012 2023-09-13 23:01:19,125 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-13 23:01:19,125 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-09-13 23:01:19,126 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-13 23:01:19,126 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-13 23:01:19,128 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] procedure2.ProcedureExecutor(1028): Stored pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-13 23:01:19,129 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-13 23:01:19,130 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=112, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1694646679130 2023-09-13 23:01:19,130 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-09-13 23:01:19,130 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-13 23:01:19,131 DEBUG [Listener at jenkins-hbase4.apache.org/37017] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-13 23:01:19,131 DEBUG [Listener at jenkins-hbase4.apache.org/37017] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-13 23:01:19,132 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-13 23:01:19,132 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=112, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-13 23:01:19,133 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=112, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 5 msec 2023-09-13 23:01:19,134 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-13 23:01:19,135 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=113, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1694646679135 2023-09-13 23:01:19,146 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 23:01:19,146 INFO [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' 2023-09-13 23:01:19,146 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-13 23:01:19,148 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-09-13 23:01:19,148 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-09-13 23:01:19,148 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 23:01:19,148 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 23:01:19,149 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:34119-0x100a784b9ba0002, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 23:01:19,149 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:39163-0x100a784b9ba0001, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 23:01:19,149 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:42165-0x100a784b9ba0003, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 23:01:19,149 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 23:01:19,149 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 23:01:19,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 23:01:19,149 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 23:01:19,149 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 23:01:19,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 23:01:19,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 23:01:19,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 23:01:19,150 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 23:01:19,150 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34119,1694645979883 2023-09-13 23:01:19,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 23:01:19,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 23:01:19,150 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34119,1694645979883 2023-09-13 23:01:19,150 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-13 23:01:19,150 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34119-0x100a784b9ba0002, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 23:01:19,150 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39163-0x100a784b9ba0001, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 23:01:19,150 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42165-0x100a784b9ba0003, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 23:01:19,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-09-13 23:01:19,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 23:01:19,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-09-13 23:01:19,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-09-13 23:01:19,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 23:01:19,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 23:01:19,151 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-13 23:01:19,151 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-13 23:01:19,151 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-13 23:01:19,151 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 23:01:19,151 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1694645979883' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-13 23:01:19,151 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1694645979883' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-13 23:01:19,151 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 23:01:19,152 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1694645979883' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-13 23:01:19,152 DEBUG [member: 'jenkins-hbase4.apache.org,39163,1694645979837' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-13 23:01:19,152 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1694645979883' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-13 23:01:19,152 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1694645979883' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34119,1694645979883' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-13 23:01:19,151 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 23:01:19,152 DEBUG [member: 'jenkins-hbase4.apache.org,39163,1694645979837' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-13 23:01:19,153 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-13 23:01:19,154 DEBUG [member: 'jenkins-hbase4.apache.org,39163,1694645979837' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-13 23:01:19,154 DEBUG [member: 'jenkins-hbase4.apache.org,39163,1694645979837' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-13 23:01:19,154 DEBUG [member: 'jenkins-hbase4.apache.org,39163,1694645979837' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39163,1694645979837' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-13 23:01:19,154 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-13 23:01:19,155 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-13 23:01:19,155 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-13 23:01:19,155 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42165,1694645979926' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-13 23:01:19,157 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34119,1694645979883 2023-09-13 23:01:19,157 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1694645979883' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 23:01:19,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34119,1694645979883 2023-09-13 23:01:19,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-13 23:01:19,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-13 23:01:19,158 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 23:01:19,158 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1694645979883' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34119-0x100a784b9ba0002, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 23:01:19,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-13 23:01:19,158 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 23:01:19,158 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1694645979883' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-13 23:01:19,158 DEBUG [member: 'jenkins-hbase4.apache.org,39163,1694645979837' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 23:01:19,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-13 23:01:19,158 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42165-0x100a784b9ba0003, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 23:01:19,158 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-13 23:01:19,158 DEBUG [member: 'jenkins-hbase4.apache.org,39163,1694645979837' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39163-0x100a784b9ba0001, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 23:01:19,158 DEBUG [member: 'jenkins-hbase4.apache.org,39163,1694645979837' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-13 23:01:19,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 23:01:19,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34119,1694645979883 2023-09-13 23:01:19,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 23:01:19,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 23:01:19,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-13 23:01:19,160 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34119,1694645979883' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-09-13 23:01:19,160 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@79e8e9c4[Count = 1] remaining members to acquire global barrier 2023-09-13 23:01:19,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 23:01:19,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-13 23:01:19,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-13 23:01:19,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-13 23:01:19,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-13 23:01:19,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 23:01:19,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34119,1694645979883 2023-09-13 23:01:19,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 23:01:19,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 23:01:19,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-13 23:01:19,163 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39163,1694645979837' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-09-13 23:01:19,163 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@79e8e9c4[Count = 0] remaining members to acquire global barrier 2023-09-13 23:01:19,163 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-09-13 23:01:19,163 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 23:01:19,167 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:39163-0x100a784b9ba0001, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 23:01:19,167 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:34119-0x100a784b9ba0002, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 23:01:19,167 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:42165-0x100a784b9ba0003, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 23:01:19,167 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 23:01:19,167 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 23:01:19,167 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34119,1694645979883 2023-09-13 23:01:19,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 23:01:19,167 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 23:01:19,167 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1694645979883' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-13 23:01:19,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 23:01:19,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 23:01:19,167 DEBUG [member: 'jenkins-hbase4.apache.org,39163,1694645979837' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-13 23:01:19,167 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-13 23:01:19,167 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 23:01:19,167 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-13 23:01:19,167 DEBUG [rs(jenkins-hbase4.apache.org,34119,1694645979883)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1694646078327.af595d247bb344516e7417a7dc99465e. 2023-09-13 23:01:19,167 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-13 23:01:19,167 DEBUG [rs(jenkins-hbase4.apache.org,39163,1694645979837)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1694646078327.4488ef83b66fe8f91cb077c19a761bee. 2023-09-13 23:01:19,167 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1694645979883' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-13 23:01:19,168 DEBUG [rs(jenkins-hbase4.apache.org,39163,1694645979837)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1694646078327.4488ef83b66fe8f91cb077c19a761bee. started... 2023-09-13 23:01:19,168 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1694645979883' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-13 23:01:19,167 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,42165,1694645979926' in zk 2023-09-13 23:01:19,167 DEBUG [rs(jenkins-hbase4.apache.org,34119,1694645979883)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1694646078327.af595d247bb344516e7417a7dc99465e. started... 2023-09-13 23:01:19,167 DEBUG [member: 'jenkins-hbase4.apache.org,39163,1694645979837' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-13 23:01:19,168 DEBUG [member: 'jenkins-hbase4.apache.org,39163,1694645979837' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-13 23:01:19,168 INFO [rs(jenkins-hbase4.apache.org,39163,1694645979837)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 4488ef83b66fe8f91cb077c19a761bee 1/1 column families, dataSize=333 B heapSize=976 B 2023-09-13 23:01:19,168 INFO [rs(jenkins-hbase4.apache.org,34119,1694645979883)-snapshot-pool-0] regionserver.HRegion(2745): Flushing af595d247bb344516e7417a7dc99465e 1/1 column families, dataSize=2.93 KB heapSize=6.58 KB 2023-09-13 23:01:19,172 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-13 23:01:19,172 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-13 23:01:19,172 DEBUG [member: 'jenkins-hbase4.apache.org,42165,1694645979926' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-13 23:01:19,194 INFO [rs(jenkins-hbase4.apache.org,39163,1694645979837)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230913a9aa41845e0a41bbb6a2b5eb31e4d8cf to hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230913a9aa41845e0a41bbb6a2b5eb31e4d8cf 2023-09-13 23:01:19,196 INFO [rs(jenkins-hbase4.apache.org,34119,1694645979883)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202309134ca4a4e3f65c4688bd06f921ebc5ec7a to hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b202309134ca4a4e3f65c4688bd06f921ebc5ec7a 2023-09-13 23:01:19,209 INFO [rs(jenkins-hbase4.apache.org,39163,1694645979837)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=333, hasBloomFilter=true, into tmp file hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/default/testtb-testExportFileSystemStateWithSkipTmp/4488ef83b66fe8f91cb077c19a761bee/.tmp/cf/39bea30738ac49758cf7541a5cf920bd 2023-09-13 23:01:19,212 INFO [rs(jenkins-hbase4.apache.org,34119,1694645979883)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=2.9 K, hasBloomFilter=true, into tmp file hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/default/testtb-testExportFileSystemStateWithSkipTmp/af595d247bb344516e7417a7dc99465e/.tmp/cf/3c4f33f636de4c5880fbe8e715e73e75 2023-09-13 23:01:19,215 DEBUG [rs(jenkins-hbase4.apache.org,39163,1694645979837)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/default/testtb-testExportFileSystemStateWithSkipTmp/4488ef83b66fe8f91cb077c19a761bee/.tmp/cf/39bea30738ac49758cf7541a5cf920bd as hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/default/testtb-testExportFileSystemStateWithSkipTmp/4488ef83b66fe8f91cb077c19a761bee/cf/39bea30738ac49758cf7541a5cf920bd 2023-09-13 23:01:19,216 DEBUG [rs(jenkins-hbase4.apache.org,34119,1694645979883)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/default/testtb-testExportFileSystemStateWithSkipTmp/af595d247bb344516e7417a7dc99465e/.tmp/cf/3c4f33f636de4c5880fbe8e715e73e75 as hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/default/testtb-testExportFileSystemStateWithSkipTmp/af595d247bb344516e7417a7dc99465e/cf/3c4f33f636de4c5880fbe8e715e73e75 2023-09-13 23:01:19,220 INFO [rs(jenkins-hbase4.apache.org,39163,1694645979837)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/default/testtb-testExportFileSystemStateWithSkipTmp/4488ef83b66fe8f91cb077c19a761bee/cf/39bea30738ac49758cf7541a5cf920bd, entries=5, sequenceid=6, filesize=5.8 K 2023-09-13 23:01:19,221 INFO [rs(jenkins-hbase4.apache.org,39163,1694645979837)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~333 B/333, heapSize ~960 B/960, currentSize=0 B/0 for 4488ef83b66fe8f91cb077c19a761bee in 53ms, sequenceid=6, compaction requested=false 2023-09-13 23:01:19,221 DEBUG [rs(jenkins-hbase4.apache.org,39163,1694645979837)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithSkipTmp' 2023-09-13 23:01:19,221 INFO [rs(jenkins-hbase4.apache.org,34119,1694645979883)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/default/testtb-testExportFileSystemStateWithSkipTmp/af595d247bb344516e7417a7dc99465e/cf/3c4f33f636de4c5880fbe8e715e73e75, entries=45, sequenceid=6, filesize=13.0 K 2023-09-13 23:01:19,221 DEBUG [rs(jenkins-hbase4.apache.org,39163,1694645979837)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 4488ef83b66fe8f91cb077c19a761bee: 2023-09-13 23:01:19,222 DEBUG [rs(jenkins-hbase4.apache.org,39163,1694645979837)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1694646078327.4488ef83b66fe8f91cb077c19a761bee.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 23:01:19,222 DEBUG [rs(jenkins-hbase4.apache.org,39163,1694645979837)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-13 23:01:19,222 DEBUG [rs(jenkins-hbase4.apache.org,39163,1694645979837)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/default/testtb-testExportFileSystemStateWithSkipTmp/4488ef83b66fe8f91cb077c19a761bee/cf/39bea30738ac49758cf7541a5cf920bd] hfiles 2023-09-13 23:01:19,222 DEBUG [rs(jenkins-hbase4.apache.org,39163,1694645979837)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/default/testtb-testExportFileSystemStateWithSkipTmp/4488ef83b66fe8f91cb077c19a761bee/cf/39bea30738ac49758cf7541a5cf920bd for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 23:01:19,223 INFO [rs(jenkins-hbase4.apache.org,34119,1694645979883)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.93 KB/3003, heapSize ~6.56 KB/6720, currentSize=0 B/0 for af595d247bb344516e7417a7dc99465e in 55ms, sequenceid=6, compaction requested=false 2023-09-13 23:01:19,225 DEBUG [rs(jenkins-hbase4.apache.org,34119,1694645979883)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for af595d247bb344516e7417a7dc99465e: 2023-09-13 23:01:19,225 DEBUG [rs(jenkins-hbase4.apache.org,34119,1694645979883)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1694646078327.af595d247bb344516e7417a7dc99465e.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 23:01:19,225 DEBUG [rs(jenkins-hbase4.apache.org,34119,1694645979883)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-13 23:01:19,225 DEBUG [rs(jenkins-hbase4.apache.org,34119,1694645979883)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/default/testtb-testExportFileSystemStateWithSkipTmp/af595d247bb344516e7417a7dc99465e/cf/3c4f33f636de4c5880fbe8e715e73e75] hfiles 2023-09-13 23:01:19,225 DEBUG [rs(jenkins-hbase4.apache.org,34119,1694645979883)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/default/testtb-testExportFileSystemStateWithSkipTmp/af595d247bb344516e7417a7dc99465e/cf/3c4f33f636de4c5880fbe8e715e73e75 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 23:01:19,231 DEBUG [Listener at jenkins-hbase4.apache.org/37017] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-13 23:01:19,232 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-09-13 23:01:19,232 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-09-13 23:01:19,233 DEBUG [Listener at jenkins-hbase4.apache.org/37017] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-13 23:01:19,237 DEBUG [rs(jenkins-hbase4.apache.org,39163,1694645979837)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1694646078327.4488ef83b66fe8f91cb077c19a761bee. completed. 2023-09-13 23:01:19,237 DEBUG [rs(jenkins-hbase4.apache.org,39163,1694645979837)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1694646078327.4488ef83b66fe8f91cb077c19a761bee. 2023-09-13 23:01:19,238 DEBUG [member: 'jenkins-hbase4.apache.org,39163,1694645979837' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-13 23:01:19,239 DEBUG [member: 'jenkins-hbase4.apache.org,39163,1694645979837' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-13 23:01:19,239 DEBUG [member: 'jenkins-hbase4.apache.org,39163,1694645979837' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 23:01:19,239 DEBUG [member: 'jenkins-hbase4.apache.org,39163,1694645979837' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-13 23:01:19,239 DEBUG [member: 'jenkins-hbase4.apache.org,39163,1694645979837' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,39163,1694645979837' in zk 2023-09-13 23:01:19,241 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 23:01:19,241 DEBUG [member: 'jenkins-hbase4.apache.org,39163,1694645979837' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-13 23:01:19,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 23:01:19,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-13 23:01:19,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-13 23:01:19,241 DEBUG [member: 'jenkins-hbase4.apache.org,39163,1694645979837' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-13 23:01:19,241 DEBUG [member: 'jenkins-hbase4.apache.org,39163,1694645979837' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-13 23:01:19,243 DEBUG [rs(jenkins-hbase4.apache.org,34119,1694645979883)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1694646078327.af595d247bb344516e7417a7dc99465e. completed. 2023-09-13 23:01:19,243 DEBUG [rs(jenkins-hbase4.apache.org,34119,1694645979883)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1694646078327.af595d247bb344516e7417a7dc99465e. 2023-09-13 23:01:19,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-13 23:01:19,243 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1694645979883' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-13 23:01:19,243 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1694645979883' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-13 23:01:19,243 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1694645979883' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34119,1694645979883 2023-09-13 23:01:19,243 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1694645979883' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-13 23:01:19,243 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1694645979883' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,34119,1694645979883' in zk 2023-09-13 23:01:19,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-13 23:01:19,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 23:01:19,245 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34119,1694645979883 2023-09-13 23:01:19,245 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1694645979883' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-13 23:01:19,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34119,1694645979883 2023-09-13 23:01:19,245 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1694645979883' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-13 23:01:19,245 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1694645979883' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-13 23:01:19,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 23:01:19,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 23:01:19,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-13 23:01:19,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 23:01:19,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34119,1694645979883 2023-09-13 23:01:19,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 23:01:19,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 23:01:19,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,39163,1694645979837': 2023-09-13 23:01:19,248 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39163,1694645979837' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-09-13 23:01:19,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34119,1694645979883 2023-09-13 23:01:19,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-13 23:01:19,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-13 23:01:19,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-13 23:01:19,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-13 23:01:19,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 23:01:19,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34119,1694645979883 2023-09-13 23:01:19,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 23:01:19,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 23:01:19,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-13 23:01:19,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 23:01:19,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34119,1694645979883 2023-09-13 23:01:19,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 23:01:19,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 23:01:19,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,34119,1694645979883': 2023-09-13 23:01:19,251 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34119,1694645979883' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-09-13 23:01:19,251 INFO [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-09-13 23:01:19,251 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-13 23:01:19,251 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-13 23:01:19,251 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 23:01:19,251 INFO [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-13 23:01:19,253 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 23:01:19,253 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:34119-0x100a784b9ba0002, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 23:01:19,253 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:39163-0x100a784b9ba0001, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 23:01:19,253 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 23:01:19,253 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:42165-0x100a784b9ba0003, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 23:01:19,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 23:01:19,253 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:42165-0x100a784b9ba0003, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 23:01:19,253 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 23:01:19,253 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:39163-0x100a784b9ba0001, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 23:01:19,253 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:34119-0x100a784b9ba0002, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 23:01:19,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 23:01:19,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-13 23:01:19,253 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 23:01:19,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 23:01:19,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 23:01:19,254 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34119,1694645979883 2023-09-13 23:01:19,253 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 23:01:19,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-13 23:01:19,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 23:01:19,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 23:01:19,254 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 23:01:19,254 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 23:01:19,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 23:01:19,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-13 23:01:19,254 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 23:01:19,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 23:01:19,254 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 23:01:19,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 23:01:19,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 23:01:19,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 23:01:19,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-13 23:01:19,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 23:01:19,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34119,1694645979883 2023-09-13 23:01:19,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 23:01:19,256 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34119,1694645979883 2023-09-13 23:01:19,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 23:01:19,256 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 23:01:19,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-13 23:01:19,257 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 23:01:19,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 23:01:19,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34119,1694645979883 2023-09-13 23:01:19,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 23:01:19,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 23:01:19,261 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:39163-0x100a784b9ba0001, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 23:01:19,261 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:34119-0x100a784b9ba0002, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 23:01:19,261 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 23:01:19,261 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 23:01:19,261 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 23:01:19,261 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:39163-0x100a784b9ba0001, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 23:01:19,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 23:01:19,261 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 23:01:19,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 23:01:19,261 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 23:01:19,261 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34119,1694645979883 2023-09-13 23:01:19,261 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 23:01:19,261 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 23:01:19,261 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 23:01:19,261 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 23:01:19,261 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34119,1694645979883 2023-09-13 23:01:19,261 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 23:01:19,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 23:01:19,263 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:42165-0x100a784b9ba0003, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 23:01:19,263 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:42165-0x100a784b9ba0003, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 23:01:19,263 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 23:01:19,263 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 23:01:19,263 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:34119-0x100a784b9ba0002, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 23:01:19,263 DEBUG [(jenkins-hbase4.apache.org,36621,1694645978553)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-13 23:01:19,263 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 23:01:19,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 23:01:19,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 23:01:19,263 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 23:01:19,264 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-09-13 23:01:19,263 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 23:01:19,264 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 23:01:19,265 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-13 23:01:19,265 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 23:01:19,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 23:01:19,265 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b202309134ca4a4e3f65c4688bd06f921ebc5ec7a, hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230913a9aa41845e0a41bbb6a2b5eb31e4d8cf] mob files 2023-09-13 23:01:19,265 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b202309134ca4a4e3f65c4688bd06f921ebc5ec7a 2023-09-13 23:01:19,265 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230913a9aa41845e0a41bbb6a2b5eb31e4d8cf 2023-09-13 23:01:19,272 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 23:01:19,273 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 23:01:19,288 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 23:01:19,289 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-09-13 23:01:19,289 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 23:01:19,289 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 23:01:19,289 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1694646079130Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1694646079272 (+142 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1694646079272Loading Region manifests for snaptb0-testExportFileSystemStateWithSkipTmp at 1694646079272Writing data manifest for snaptb0-testExportFileSystemStateWithSkipTmp at 1694646079276 (+4 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1694646079282 (+6 ms)Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1694646079289 (+7 ms) 2023-09-13 23:01:19,292 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=113, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-13 23:01:19,293 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=113, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 161 msec 2023-09-13 23:01:19,433 DEBUG [Listener at jenkins-hbase4.apache.org/37017] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-13 23:01:19,434 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-09-13 23:01:19,434 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-13 23:01:19,434 INFO [Listener at jenkins-hbase4.apache.org/37017] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/export-test/export-1694646079434 2023-09-13 23:01:19,434 INFO [Listener at jenkins-hbase4.apache.org/37017] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:36267, tgtDir=hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/export-test/export-1694646079434, rawTgtDir=hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/export-test/export-1694646079434, srcFsUri=hdfs://localhost:36267, srcDir=hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d 2023-09-13 23:01:19,456 DEBUG [Listener at jenkins-hbase4.apache.org/37017] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:36267, inputRoot=hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d 2023-09-13 23:01:19,456 DEBUG [Listener at jenkins-hbase4.apache.org/37017] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1603907786_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/export-test/export-1694646079434, skipTmp=true, initialOutputSnapshotDir=hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/export-test/export-1694646079434/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 23:01:19,456 INFO [Listener at jenkins-hbase4.apache.org/37017] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:36267, inputRoot=hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d, snapshotDir=hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp. 2023-09-13 23:01:19,465 INFO [Listener at jenkins-hbase4.apache.org/37017] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/export-test/export-1694646079434/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 23:01:19,485 DEBUG [Listener at jenkins-hbase4.apache.org/37017] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-13 23:01:19,485 DEBUG [Listener at jenkins-hbase4.apache.org/37017] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-13 23:01:19,485 DEBUG [Listener at jenkins-hbase4.apache.org/37017] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-13 23:01:19,486 DEBUG [Listener at jenkins-hbase4.apache.org/37017] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-13 23:01:20,381 DEBUG [Listener at jenkins-hbase4.apache.org/37017] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/62bf382e-8712-1db5-f7ab-e78a401ad305/hadoop-2302337329975719190.jar 2023-09-13 23:01:20,381 DEBUG [Listener at jenkins-hbase4.apache.org/37017] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-13 23:01:20,382 DEBUG [Listener at jenkins-hbase4.apache.org/37017] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-13 23:01:20,449 DEBUG [Listener at jenkins-hbase4.apache.org/37017] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/62bf382e-8712-1db5-f7ab-e78a401ad305/hadoop-6610838786872750746.jar 2023-09-13 23:01:20,449 DEBUG [Listener at jenkins-hbase4.apache.org/37017] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-13 23:01:20,450 DEBUG [Listener at jenkins-hbase4.apache.org/37017] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-13 23:01:20,450 DEBUG [Listener at jenkins-hbase4.apache.org/37017] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-13 23:01:20,450 DEBUG [Listener at jenkins-hbase4.apache.org/37017] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-13 23:01:20,451 DEBUG [Listener at jenkins-hbase4.apache.org/37017] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-13 23:01:20,451 DEBUG [Listener at jenkins-hbase4.apache.org/37017] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-13 23:01:20,451 DEBUG [Listener at jenkins-hbase4.apache.org/37017] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-13 23:01:20,452 DEBUG [Listener at jenkins-hbase4.apache.org/37017] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-13 23:01:20,452 DEBUG [Listener at jenkins-hbase4.apache.org/37017] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-13 23:01:20,452 DEBUG [Listener at jenkins-hbase4.apache.org/37017] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-13 23:01:20,452 DEBUG [Listener at jenkins-hbase4.apache.org/37017] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-13 23:01:20,453 DEBUG [Listener at jenkins-hbase4.apache.org/37017] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-13 23:01:20,453 DEBUG [Listener at jenkins-hbase4.apache.org/37017] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-13 23:01:20,454 DEBUG [Listener at jenkins-hbase4.apache.org/37017] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-13 23:01:20,454 DEBUG [Listener at jenkins-hbase4.apache.org/37017] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-13 23:01:20,454 DEBUG [Listener at jenkins-hbase4.apache.org/37017] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-13 23:01:20,455 DEBUG [Listener at jenkins-hbase4.apache.org/37017] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-13 23:01:20,455 DEBUG [Listener at jenkins-hbase4.apache.org/37017] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-13 23:01:20,456 DEBUG [Listener at jenkins-hbase4.apache.org/37017] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-13 23:01:20,456 DEBUG [Listener at jenkins-hbase4.apache.org/37017] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-13 23:01:20,456 DEBUG [Listener at jenkins-hbase4.apache.org/37017] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-13 23:01:20,457 DEBUG [Listener at jenkins-hbase4.apache.org/37017] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-13 23:01:20,457 DEBUG [Listener at jenkins-hbase4.apache.org/37017] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-13 23:01:20,781 WARN [Listener at jenkins-hbase4.apache.org/37017] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-13 23:01:20,783 INFO [Listener at jenkins-hbase4.apache.org/37017] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithSkipTmp' hfile list 2023-09-13 23:01:20,785 DEBUG [Listener at jenkins-hbase4.apache.org/37017] snapshot.ExportSnapshot(671): export split=0 size=31.5 K 2023-09-13 23:01:22,120 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-13 23:01:22,120 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-13 23:01:22,122 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694645986290_0006_000001 (auth:SIMPLE) 2023-09-13 23:01:22,565 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694645986290_0007_000001 (auth:SIMPLE) 2023-09-13 23:01:23,611 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-13 23:01:26,154 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694645986290_0007_000001 (auth:SIMPLE) 2023-09-13 23:01:28,357 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694645986290_0007_000001 (auth:SIMPLE) 2023-09-13 23:01:30,784 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694645986290_0007_000001 (auth:SIMPLE) 2023-09-13 23:01:31,933 INFO [Listener at jenkins-hbase4.apache.org/37017] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-13 23:01:31,933 INFO [Listener at jenkins-hbase4.apache.org/37017] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-13 23:01:31,943 INFO [Listener at jenkins-hbase4.apache.org/37017] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 23:01:31,943 INFO [Listener at jenkins-hbase4.apache.org/37017] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-13 23:01:31,943 INFO [Listener at jenkins-hbase4.apache.org/37017] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-13 23:01:31,943 DEBUG [Listener at jenkins-hbase4.apache.org/37017] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-527948888_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 23:01:31,944 DEBUG [Listener at jenkins-hbase4.apache.org/37017] snapshot.TestExportSnapshot(367): hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-09-13 23:01:31,944 DEBUG [Listener at jenkins-hbase4.apache.org/37017] snapshot.TestExportSnapshot(367): hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-09-13 23:01:31,944 DEBUG [Listener at jenkins-hbase4.apache.org/37017] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-527948888_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/export-test/export-1694646079434/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/export-test/export-1694646079434/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 23:01:31,944 DEBUG [Listener at jenkins-hbase4.apache.org/37017] snapshot.TestExportSnapshot(367): hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/export-test/export-1694646079434/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-09-13 23:01:31,944 DEBUG [Listener at jenkins-hbase4.apache.org/37017] snapshot.TestExportSnapshot(367): hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/export-test/export-1694646079434/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-09-13 23:01:31,949 INFO [Listener at jenkins-hbase4.apache.org/37017] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithSkipTmp 2023-09-13 23:01:31,950 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithSkipTmp 2023-09-13 23:01:31,951 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] procedure2.ProcedureExecutor(1028): Stored pid=114, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-13 23:01:31,953 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-09-13 23:01:31,954 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694646091953"}]},"ts":"1694646091953"} 2023-09-13 23:01:31,955 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLING in hbase:meta 2023-09-13 23:01:31,956 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLING 2023-09-13 23:01:31,957 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=4488ef83b66fe8f91cb077c19a761bee, UNASSIGN}, {pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=af595d247bb344516e7417a7dc99465e, UNASSIGN}] 2023-09-13 23:01:31,958 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=4488ef83b66fe8f91cb077c19a761bee, UNASSIGN 2023-09-13 23:01:31,958 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=af595d247bb344516e7417a7dc99465e, UNASSIGN 2023-09-13 23:01:31,959 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=4488ef83b66fe8f91cb077c19a761bee, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 23:01:31,959 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=af595d247bb344516e7417a7dc99465e, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34119,1694645979883 2023-09-13 23:01:31,959 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1694646078327.4488ef83b66fe8f91cb077c19a761bee.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1694646091959"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694646091959"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694646091959"}]},"ts":"1694646091959"} 2023-09-13 23:01:31,959 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1694646078327.af595d247bb344516e7417a7dc99465e.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1694646091959"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694646091959"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694646091959"}]},"ts":"1694646091959"} 2023-09-13 23:01:31,960 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=117, ppid=115, state=RUNNABLE; CloseRegionProcedure 4488ef83b66fe8f91cb077c19a761bee, server=jenkins-hbase4.apache.org,39163,1694645979837}] 2023-09-13 23:01:31,961 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=118, ppid=116, state=RUNNABLE; CloseRegionProcedure af595d247bb344516e7417a7dc99465e, server=jenkins-hbase4.apache.org,34119,1694645979883}] 2023-09-13 23:01:32,054 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-09-13 23:01:32,112 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 4488ef83b66fe8f91cb077c19a761bee 2023-09-13 23:01:32,112 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 4488ef83b66fe8f91cb077c19a761bee, disabling compactions & flushes 2023-09-13 23:01:32,112 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1694646078327.4488ef83b66fe8f91cb077c19a761bee. 2023-09-13 23:01:32,112 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1694646078327.4488ef83b66fe8f91cb077c19a761bee. 2023-09-13 23:01:32,112 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1694646078327.4488ef83b66fe8f91cb077c19a761bee. after waiting 0 ms 2023-09-13 23:01:32,112 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1694646078327.4488ef83b66fe8f91cb077c19a761bee. 2023-09-13 23:01:32,116 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close af595d247bb344516e7417a7dc99465e 2023-09-13 23:01:32,116 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing af595d247bb344516e7417a7dc99465e, disabling compactions & flushes 2023-09-13 23:01:32,116 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1694646078327.af595d247bb344516e7417a7dc99465e. 2023-09-13 23:01:32,116 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1694646078327.af595d247bb344516e7417a7dc99465e. 2023-09-13 23:01:32,116 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1694646078327.af595d247bb344516e7417a7dc99465e. after waiting 0 ms 2023-09-13 23:01:32,116 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1694646078327.af595d247bb344516e7417a7dc99465e. 2023-09-13 23:01:32,125 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/default/testtb-testExportFileSystemStateWithSkipTmp/4488ef83b66fe8f91cb077c19a761bee/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-13 23:01:32,125 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/default/testtb-testExportFileSystemStateWithSkipTmp/af595d247bb344516e7417a7dc99465e/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-13 23:01:32,125 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-13 23:01:32,126 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-13 23:01:32,126 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1694646078327.4488ef83b66fe8f91cb077c19a761bee. 2023-09-13 23:01:32,127 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1694646078327.af595d247bb344516e7417a7dc99465e. 2023-09-13 23:01:32,127 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for af595d247bb344516e7417a7dc99465e: 2023-09-13 23:01:32,127 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 4488ef83b66fe8f91cb077c19a761bee: 2023-09-13 23:01:32,128 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 4488ef83b66fe8f91cb077c19a761bee 2023-09-13 23:01:32,129 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=4488ef83b66fe8f91cb077c19a761bee, regionState=CLOSED 2023-09-13 23:01:32,129 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1694646078327.4488ef83b66fe8f91cb077c19a761bee.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1694646092129"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694646092129"}]},"ts":"1694646092129"} 2023-09-13 23:01:32,129 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed af595d247bb344516e7417a7dc99465e 2023-09-13 23:01:32,130 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=af595d247bb344516e7417a7dc99465e, regionState=CLOSED 2023-09-13 23:01:32,130 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1694646078327.af595d247bb344516e7417a7dc99465e.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1694646092129"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694646092129"}]},"ts":"1694646092129"} 2023-09-13 23:01:32,132 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=117, resume processing ppid=115 2023-09-13 23:01:32,132 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=117, ppid=115, state=SUCCESS; CloseRegionProcedure 4488ef83b66fe8f91cb077c19a761bee, server=jenkins-hbase4.apache.org,39163,1694645979837 in 170 msec 2023-09-13 23:01:32,133 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=118, resume processing ppid=116 2023-09-13 23:01:32,133 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=118, ppid=116, state=SUCCESS; CloseRegionProcedure af595d247bb344516e7417a7dc99465e, server=jenkins-hbase4.apache.org,34119,1694645979883 in 170 msec 2023-09-13 23:01:32,133 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=115, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=4488ef83b66fe8f91cb077c19a761bee, UNASSIGN in 175 msec 2023-09-13 23:01:32,134 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=116, resume processing ppid=114 2023-09-13 23:01:32,134 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=116, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=af595d247bb344516e7417a7dc99465e, UNASSIGN in 176 msec 2023-09-13 23:01:32,135 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694646092135"}]},"ts":"1694646092135"} 2023-09-13 23:01:32,136 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLED in hbase:meta 2023-09-13 23:01:32,137 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLED 2023-09-13 23:01:32,139 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=114, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 188 msec 2023-09-13 23:01:32,255 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-09-13 23:01:32,255 INFO [Listener at jenkins-hbase4.apache.org/37017] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 114 completed 2023-09-13 23:01:32,256 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithSkipTmp 2023-09-13 23:01:32,257 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] procedure2.ProcedureExecutor(1028): Stored pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-13 23:01:32,259 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-13 23:01:32,259 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithSkipTmp 2023-09-13 23:01:32,259 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=119, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-13 23:01:32,261 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39163] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithSkipTmp 2023-09-13 23:01:32,263 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/4488ef83b66fe8f91cb077c19a761bee 2023-09-13 23:01:32,263 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/af595d247bb344516e7417a7dc99465e 2023-09-13 23:01:32,264 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:39163-0x100a784b9ba0001, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-13 23:01:32,264 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:34119-0x100a784b9ba0002, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-13 23:01:32,264 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:42165-0x100a784b9ba0003, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-13 23:01:32,264 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-13 23:01:32,264 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-09-13 23:01:32,264 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-09-13 23:01:32,264 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-09-13 23:01:32,265 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-09-13 23:01:32,265 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/4488ef83b66fe8f91cb077c19a761bee/cf, FileablePath, hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/4488ef83b66fe8f91cb077c19a761bee/recovered.edits] 2023-09-13 23:01:32,265 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:42165-0x100a784b9ba0003, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-13 23:01:32,265 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:39163-0x100a784b9ba0001, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-13 23:01:32,265 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:42165-0x100a784b9ba0003, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-13 23:01:32,265 DEBUG [HFileArchiver-16] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/af595d247bb344516e7417a7dc99465e/cf, FileablePath, hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/af595d247bb344516e7417a7dc99465e/recovered.edits] 2023-09-13 23:01:32,266 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:34119-0x100a784b9ba0002, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-13 23:01:32,266 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:34119-0x100a784b9ba0002, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-13 23:01:32,266 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-13 23:01:32,266 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-13 23:01:32,265 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:39163-0x100a784b9ba0001, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-13 23:01:32,267 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-09-13 23:01:32,269 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/4488ef83b66fe8f91cb077c19a761bee/cf/39bea30738ac49758cf7541a5cf920bd to hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/4488ef83b66fe8f91cb077c19a761bee/cf/39bea30738ac49758cf7541a5cf920bd 2023-09-13 23:01:32,269 DEBUG [HFileArchiver-16] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/af595d247bb344516e7417a7dc99465e/cf/3c4f33f636de4c5880fbe8e715e73e75 to hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/af595d247bb344516e7417a7dc99465e/cf/3c4f33f636de4c5880fbe8e715e73e75 2023-09-13 23:01:32,272 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/4488ef83b66fe8f91cb077c19a761bee/recovered.edits/9.seqid to hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/4488ef83b66fe8f91cb077c19a761bee/recovered.edits/9.seqid 2023-09-13 23:01:32,272 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/4488ef83b66fe8f91cb077c19a761bee 2023-09-13 23:01:32,272 DEBUG [HFileArchiver-16] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/af595d247bb344516e7417a7dc99465e/recovered.edits/9.seqid to hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/af595d247bb344516e7417a7dc99465e/recovered.edits/9.seqid 2023-09-13 23:01:32,273 DEBUG [HFileArchiver-16] backup.HFileArchiver(596): Deleted hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/af595d247bb344516e7417a7dc99465e 2023-09-13 23:01:32,273 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-09-13 23:01:32,273 DEBUG [PEWorker-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-09-13 23:01:32,274 DEBUG [PEWorker-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf] 2023-09-13 23:01:32,277 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b202309134ca4a4e3f65c4688bd06f921ebc5ec7a to hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b202309134ca4a4e3f65c4688bd06f921ebc5ec7a 2023-09-13 23:01:32,278 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230913a9aa41845e0a41bbb6a2b5eb31e4d8cf to hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230913a9aa41845e0a41bbb6a2b5eb31e4d8cf 2023-09-13 23:01:32,279 DEBUG [PEWorker-5] backup.HFileArchiver(596): Deleted hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-09-13 23:01:32,280 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=119, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-13 23:01:32,282 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithSkipTmp from hbase:meta 2023-09-13 23:01:32,284 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithSkipTmp' descriptor. 2023-09-13 23:01:32,285 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=119, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-13 23:01:32,285 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithSkipTmp' from region states. 2023-09-13 23:01:32,285 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1694646078327.4488ef83b66fe8f91cb077c19a761bee.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1694646092285"}]},"ts":"9223372036854775807"} 2023-09-13 23:01:32,285 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1694646078327.af595d247bb344516e7417a7dc99465e.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1694646092285"}]},"ts":"9223372036854775807"} 2023-09-13 23:01:32,286 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-13 23:01:32,286 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 4488ef83b66fe8f91cb077c19a761bee, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1694646078327.4488ef83b66fe8f91cb077c19a761bee.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => af595d247bb344516e7417a7dc99465e, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1694646078327.af595d247bb344516e7417a7dc99465e.', STARTKEY => '1', ENDKEY => ''}] 2023-09-13 23:01:32,286 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithSkipTmp' as deleted. 2023-09-13 23:01:32,286 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1694646092286"}]},"ts":"9223372036854775807"} 2023-09-13 23:01:32,288 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithSkipTmp state from META 2023-09-13 23:01:32,290 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=119, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-13 23:01:32,291 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=119, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 34 msec 2023-09-13 23:01:32,368 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-09-13 23:01:32,368 INFO [Listener at jenkins-hbase4.apache.org/37017] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 119 completed 2023-09-13 23:01:32,375 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithSkipTmp" 2023-09-13 23:01:32,376 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 23:01:32,378 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithSkipTmp" 2023-09-13 23:01:32,380 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36621] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 23:01:32,403 INFO [Listener at jenkins-hbase4.apache.org/37017] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=767 (was 766) Potentially hanging thread: ApplicationMasterLauncher #12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1506713691) connection to jenkins-hbase4.apache.org/172.31.14.131:32961 from appattempt_1694645986290_0007_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1443571944_1 at /127.0.0.1:33436 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x73fd7489-shared-pool-41 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x73fd7489-shared-pool-39 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x73fd7489-shared-pool-40 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-5216 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1443571944_1 at /127.0.0.1:56900 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-527948888_17 at /127.0.0.1:56918 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1506713691) connection to jenkins-hbase4.apache.org/172.31.14.131:46719 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-527948888_17 at /127.0.0.1:33444 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x73fd7489-shared-pool-42 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-527948888_17 at /127.0.0.1:50784 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=911 (was 927), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=122 (was 128), ProcessCount=171 (was 171), AvailableMemoryMB=8357 (was 8431) 2023-09-13 23:01:32,403 WARN [Listener at jenkins-hbase4.apache.org/37017] hbase.ResourceChecker(130): Thread=767 is superior to 500 2023-09-13 23:01:32,403 INFO [Listener at jenkins-hbase4.apache.org/37017] hbase.HBaseTestingUtility(2762): Stopping mini mapreduce cluster... 2023-09-13 23:01:32,413 INFO [Listener at jenkins-hbase4.apache.org/37017] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-09-13 23:01:32,524 WARN [ContainersLauncher #0] nodemanager.DefaultContainerExecutor(305): Exit code from container container_1694645986290_0007_01_000001 is : 143 2023-09-13 23:01:37,692 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-13 23:01:46,537 INFO [Listener at jenkins-hbase4.apache.org/37017] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-09-13 23:02:00,654 ERROR [Thread[Thread-409,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-09-13 23:02:00,654 INFO [Listener at jenkins-hbase4.apache.org/37017] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-09-13 23:02:00,762 WARN [ApplicationMaster Launcher] amlauncher.ApplicationMasterLauncher$LauncherThread(122): org.apache.hadoop.yarn.server.resourcemanager.amlauncher.ApplicationMasterLauncher$LauncherThread interrupted. Returning. 2023-09-13 23:02:00,769 ERROR [SchedulerEventDispatcher:Event Processor] event.EventDispatcher$EventProcessor(61): Returning, interrupted : java.lang.InterruptedException 2023-09-13 23:02:00,770 ERROR [Thread[Thread-419,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-09-13 23:02:00,779 INFO [Listener at jenkins-hbase4.apache.org/37017] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-09-13 23:02:00,883 ERROR [Thread[Thread-384,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-09-13 23:02:00,883 INFO [Listener at jenkins-hbase4.apache.org/37017] hbase.HBaseTestingUtility(2765): Mini mapreduce cluster stopped 2023-09-13 23:02:00,883 INFO [Listener at jenkins-hbase4.apache.org/37017] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-09-13 23:02:00,883 INFO [Listener at jenkins-hbase4.apache.org/37017] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-09-13 23:02:00,883 DEBUG [Listener at jenkins-hbase4.apache.org/37017] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4d32f7c5 to 127.0.0.1:55012 2023-09-13 23:02:00,883 DEBUG [Listener at jenkins-hbase4.apache.org/37017] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-13 23:02:00,884 DEBUG [Listener at jenkins-hbase4.apache.org/37017] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-09-13 23:02:00,884 DEBUG [Listener at jenkins-hbase4.apache.org/37017] util.JVMClusterUtil(257): Found active master hash=575097186, stopped=false 2023-09-13 23:02:00,884 DEBUG [Listener at jenkins-hbase4.apache.org/37017] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-13 23:02:00,884 DEBUG [Listener at jenkins-hbase4.apache.org/37017] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-09-13 23:02:00,884 INFO [Listener at jenkins-hbase4.apache.org/37017] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,36621,1694645978553 2023-09-13 23:02:00,885 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:34119-0x100a784b9ba0002, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-09-13 23:02:00,885 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-09-13 23:02:00,886 INFO [Listener at jenkins-hbase4.apache.org/37017] procedure2.ProcedureExecutor(628): Stopping 2023-09-13 23:02:00,885 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:39163-0x100a784b9ba0001, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-09-13 23:02:00,886 DEBUG [Listener at jenkins-hbase4.apache.org/37017] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x60867b10 to 127.0.0.1:55012 2023-09-13 23:02:00,885 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:42165-0x100a784b9ba0003, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-09-13 23:02:00,886 DEBUG [Listener at jenkins-hbase4.apache.org/37017] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-13 23:02:00,886 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-13 23:02:00,886 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34119-0x100a784b9ba0002, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-13 23:02:00,886 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-13 23:02:00,886 INFO [Listener at jenkins-hbase4.apache.org/37017] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,39163,1694645979837' ***** 2023-09-13 23:02:00,886 DEBUG [Listener at jenkins-hbase4.apache.org/37017] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-13 23:02:00,887 INFO [Listener at jenkins-hbase4.apache.org/37017] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-09-13 23:02:00,887 INFO [Listener at jenkins-hbase4.apache.org/37017] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,34119,1694645979883' ***** 2023-09-13 23:02:00,887 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42165-0x100a784b9ba0003, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-13 23:02:00,887 DEBUG [Listener at jenkins-hbase4.apache.org/37017] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-13 23:02:00,887 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39163-0x100a784b9ba0001, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-13 23:02:00,887 INFO [Listener at jenkins-hbase4.apache.org/37017] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-09-13 23:02:00,887 INFO [RS:0;jenkins-hbase4:39163] regionserver.HeapMemoryManager(220): Stopping 2023-09-13 23:02:00,887 INFO [Listener at jenkins-hbase4.apache.org/37017] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,42165,1694645979926' ***** 2023-09-13 23:02:00,887 INFO [RS:1;jenkins-hbase4:34119] regionserver.HeapMemoryManager(220): Stopping 2023-09-13 23:02:00,887 DEBUG [Listener at jenkins-hbase4.apache.org/37017] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-13 23:02:00,887 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-09-13 23:02:00,887 INFO [Listener at jenkins-hbase4.apache.org/37017] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-09-13 23:02:00,887 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-09-13 23:02:00,887 INFO [RS:1;jenkins-hbase4:34119] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-09-13 23:02:00,887 INFO [RS:0;jenkins-hbase4:39163] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-09-13 23:02:00,888 INFO [RS:1;jenkins-hbase4:34119] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-09-13 23:02:00,887 INFO [RS:2;jenkins-hbase4:42165] regionserver.HeapMemoryManager(220): Stopping 2023-09-13 23:02:00,888 INFO [RS:1;jenkins-hbase4:34119] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,34119,1694645979883 2023-09-13 23:02:00,888 INFO [RS:2;jenkins-hbase4:42165] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-09-13 23:02:00,888 DEBUG [RS:1;jenkins-hbase4:34119] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x12458e08 to 127.0.0.1:55012 2023-09-13 23:02:00,888 INFO [RS:0;jenkins-hbase4:39163] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-09-13 23:02:00,888 DEBUG [RS:1;jenkins-hbase4:34119] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-13 23:02:00,888 INFO [RS:2;jenkins-hbase4:42165] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-09-13 23:02:00,890 INFO [RS:1;jenkins-hbase4:34119] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,34119,1694645979883; all regions closed. 2023-09-13 23:02:00,890 INFO [RS:0;jenkins-hbase4:39163] regionserver.HRegionServer(3305): Received CLOSE for 8cf1f32595287d62a4554a755c1a2190 2023-09-13 23:02:00,890 INFO [RS:2;jenkins-hbase4:42165] regionserver.HRegionServer(3305): Received CLOSE for fc0b72d902cbcbdd7fc3c24accf4ad18 2023-09-13 23:02:00,888 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-09-13 23:02:00,891 INFO [RS:2;jenkins-hbase4:42165] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 23:02:00,891 INFO [RS:0;jenkins-hbase4:39163] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 23:02:00,891 DEBUG [RS:2;jenkins-hbase4:42165] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2175511e to 127.0.0.1:55012 2023-09-13 23:02:00,891 DEBUG [RS:0;jenkins-hbase4:39163] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x04bb76aa to 127.0.0.1:55012 2023-09-13 23:02:00,892 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing fc0b72d902cbcbdd7fc3c24accf4ad18, disabling compactions & flushes 2023-09-13 23:02:00,892 DEBUG [RS:0;jenkins-hbase4:39163] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-13 23:02:00,891 DEBUG [RS:2;jenkins-hbase4:42165] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-13 23:02:00,892 INFO [RS:0;jenkins-hbase4:39163] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-09-13 23:02:00,891 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 8cf1f32595287d62a4554a755c1a2190, disabling compactions & flushes 2023-09-13 23:02:00,893 DEBUG [RS:0;jenkins-hbase4:39163] regionserver.HRegionServer(1478): Online Regions={8cf1f32595287d62a4554a755c1a2190=hbase:acl,,1694645982832.8cf1f32595287d62a4554a755c1a2190.} 2023-09-13 23:02:00,893 INFO [RS:2;jenkins-hbase4:42165] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-09-13 23:02:00,892 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1694645982087.fc0b72d902cbcbdd7fc3c24accf4ad18. 2023-09-13 23:02:00,893 INFO [RS:2;jenkins-hbase4:42165] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-09-13 23:02:00,893 INFO [RS:2;jenkins-hbase4:42165] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-09-13 23:02:00,893 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:acl,,1694645982832.8cf1f32595287d62a4554a755c1a2190. 2023-09-13 23:02:00,893 INFO [RS:2;jenkins-hbase4:42165] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-09-13 23:02:00,893 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1694645982832.8cf1f32595287d62a4554a755c1a2190. 2023-09-13 23:02:00,893 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1694645982087.fc0b72d902cbcbdd7fc3c24accf4ad18. 2023-09-13 23:02:00,893 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1694645982832.8cf1f32595287d62a4554a755c1a2190. after waiting 0 ms 2023-09-13 23:02:00,893 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1694645982087.fc0b72d902cbcbdd7fc3c24accf4ad18. after waiting 0 ms 2023-09-13 23:02:00,893 INFO [RS:2;jenkins-hbase4:42165] regionserver.HRegionServer(1474): Waiting on 2 regions to close 2023-09-13 23:02:00,893 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1694645982087.fc0b72d902cbcbdd7fc3c24accf4ad18. 2023-09-13 23:02:00,893 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1694645982832.8cf1f32595287d62a4554a755c1a2190. 2023-09-13 23:02:00,894 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing fc0b72d902cbcbdd7fc3c24accf4ad18 1/1 column families, dataSize=78 B heapSize=488 B 2023-09-13 23:02:00,894 DEBUG [RS:2;jenkins-hbase4:42165] regionserver.HRegionServer(1478): Online Regions={1588230740=hbase:meta,,1.1588230740, fc0b72d902cbcbdd7fc3c24accf4ad18=hbase:namespace,,1694645982087.fc0b72d902cbcbdd7fc3c24accf4ad18.} 2023-09-13 23:02:00,894 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-09-13 23:02:00,894 DEBUG [RS:0;jenkins-hbase4:39163] regionserver.HRegionServer(1504): Waiting on 8cf1f32595287d62a4554a755c1a2190 2023-09-13 23:02:00,894 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 8cf1f32595287d62a4554a755c1a2190 1/1 column families, dataSize=914 B heapSize=2.17 KB 2023-09-13 23:02:00,894 DEBUG [RS:2;jenkins-hbase4:42165] regionserver.HRegionServer(1504): Waiting on 1588230740, fc0b72d902cbcbdd7fc3c24accf4ad18 2023-09-13 23:02:00,894 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-09-13 23:02:00,895 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-09-13 23:02:00,895 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-09-13 23:02:00,895 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-09-13 23:02:00,895 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=45.93 KB heapSize=71.92 KB 2023-09-13 23:02:00,914 DEBUG [RS:1;jenkins-hbase4:34119] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/oldWALs 2023-09-13 23:02:00,914 INFO [RS:1;jenkins-hbase4:34119] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C34119%2C1694645979883:(num 1694645981478) 2023-09-13 23:02:00,914 DEBUG [RS:1;jenkins-hbase4:34119] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-13 23:02:00,914 INFO [RS:1;jenkins-hbase4:34119] regionserver.LeaseManager(133): Closed leases 2023-09-13 23:02:00,914 INFO [RS:1;jenkins-hbase4:34119] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-09-13 23:02:00,915 INFO [RS:1;jenkins-hbase4:34119] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-09-13 23:02:00,915 INFO [RS:1;jenkins-hbase4:34119] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-09-13 23:02:00,915 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-09-13 23:02:00,915 INFO [RS:1;jenkins-hbase4:34119] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-09-13 23:02:00,918 INFO [RS:1;jenkins-hbase4:34119] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:34119 2023-09-13 23:02:00,924 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=914 B at sequenceid=18 (bloomFilter=false), to=hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/hbase/acl/8cf1f32595287d62a4554a755c1a2190/.tmp/l/0f3af89c3e29479480e3de778abe735d 2023-09-13 23:02:00,924 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=40.45 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/hbase/meta/1588230740/.tmp/info/f76540a1e322464bac07d3e0dfaba50e 2023-09-13 23:02:00,925 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:34119-0x100a784b9ba0002, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,34119,1694645979883 2023-09-13 23:02:00,925 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:34119-0x100a784b9ba0002, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-13 23:02:00,925 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-13 23:02:00,925 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:39163-0x100a784b9ba0001, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,34119,1694645979883 2023-09-13 23:02:00,925 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:39163-0x100a784b9ba0001, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-13 23:02:00,925 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:42165-0x100a784b9ba0003, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,34119,1694645979883 2023-09-13 23:02:00,925 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:42165-0x100a784b9ba0003, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-13 23:02:00,926 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-09-13 23:02:00,926 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,34119,1694645979883] 2023-09-13 23:02:00,927 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,34119,1694645979883; numProcessing=1 2023-09-13 23:02:00,929 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0f3af89c3e29479480e3de778abe735d 2023-09-13 23:02:00,930 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f76540a1e322464bac07d3e0dfaba50e 2023-09-13 23:02:00,930 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,34119,1694645979883 already deleted, retry=false 2023-09-13 23:02:00,930 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,34119,1694645979883 expired; onlineServers=2 2023-09-13 23:02:00,930 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/hbase/acl/8cf1f32595287d62a4554a755c1a2190/.tmp/l/0f3af89c3e29479480e3de778abe735d as hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/hbase/acl/8cf1f32595287d62a4554a755c1a2190/l/0f3af89c3e29479480e3de778abe735d 2023-09-13 23:02:00,934 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0f3af89c3e29479480e3de778abe735d 2023-09-13 23:02:00,934 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/hbase/acl/8cf1f32595287d62a4554a755c1a2190/l/0f3af89c3e29479480e3de778abe735d, entries=7, sequenceid=18, filesize=5.2 K 2023-09-13 23:02:00,935 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~914 B/914, heapSize ~2.16 KB/2208, currentSize=0 B/0 for 8cf1f32595287d62a4554a755c1a2190 in 41ms, sequenceid=18, compaction requested=false 2023-09-13 23:02:00,940 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.50 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/hbase/meta/1588230740/.tmp/rep_barrier/f9ce1c1eb27d47e69d07d5c76bd176e8 2023-09-13 23:02:00,941 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/hbase/acl/8cf1f32595287d62a4554a755c1a2190/recovered.edits/21.seqid, newMaxSeqId=21, maxSeqId=1 2023-09-13 23:02:00,941 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-13 23:02:00,942 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:acl,,1694645982832.8cf1f32595287d62a4554a755c1a2190. 2023-09-13 23:02:00,942 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 8cf1f32595287d62a4554a755c1a2190: 2023-09-13 23:02:00,942 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:acl,,1694645982832.8cf1f32595287d62a4554a755c1a2190. 2023-09-13 23:02:00,944 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f9ce1c1eb27d47e69d07d5c76bd176e8 2023-09-13 23:02:00,952 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.98 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/hbase/meta/1588230740/.tmp/table/872d9f5d4734409bad681d1fedfdc135 2023-09-13 23:02:00,955 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 872d9f5d4734409bad681d1fedfdc135 2023-09-13 23:02:00,956 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/hbase/meta/1588230740/.tmp/info/f76540a1e322464bac07d3e0dfaba50e as hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/hbase/meta/1588230740/info/f76540a1e322464bac07d3e0dfaba50e 2023-09-13 23:02:00,959 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f76540a1e322464bac07d3e0dfaba50e 2023-09-13 23:02:00,960 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/hbase/meta/1588230740/info/f76540a1e322464bac07d3e0dfaba50e, entries=48, sequenceid=131, filesize=10.3 K 2023-09-13 23:02:00,960 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/hbase/meta/1588230740/.tmp/rep_barrier/f9ce1c1eb27d47e69d07d5c76bd176e8 as hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/hbase/meta/1588230740/rep_barrier/f9ce1c1eb27d47e69d07d5c76bd176e8 2023-09-13 23:02:00,963 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f9ce1c1eb27d47e69d07d5c76bd176e8 2023-09-13 23:02:00,964 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/hbase/meta/1588230740/rep_barrier/f9ce1c1eb27d47e69d07d5c76bd176e8, entries=13, sequenceid=131, filesize=6.4 K 2023-09-13 23:02:00,964 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/hbase/meta/1588230740/.tmp/table/872d9f5d4734409bad681d1fedfdc135 as hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/hbase/meta/1588230740/table/872d9f5d4734409bad681d1fedfdc135 2023-09-13 23:02:00,968 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 872d9f5d4734409bad681d1fedfdc135 2023-09-13 23:02:00,968 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/hbase/meta/1588230740/table/872d9f5d4734409bad681d1fedfdc135, entries=24, sequenceid=131, filesize=6.9 K 2023-09-13 23:02:00,969 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~45.93 KB/47028, heapSize ~71.88 KB/73600, currentSize=0 B/0 for 1588230740 in 74ms, sequenceid=131, compaction requested=false 2023-09-13 23:02:00,972 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-09-13 23:02:00,972 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-09-13 23:02:00,978 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/hbase/meta/1588230740/recovered.edits/134.seqid, newMaxSeqId=134, maxSeqId=1 2023-09-13 23:02:00,978 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-13 23:02:00,978 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-09-13 23:02:00,979 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-09-13 23:02:00,979 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-09-13 23:02:00,979 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-09-13 23:02:01,027 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:34119-0x100a784b9ba0002, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-13 23:02:01,027 INFO [RS:1;jenkins-hbase4:34119] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,34119,1694645979883; zookeeper connection closed. 2023-09-13 23:02:01,027 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:34119-0x100a784b9ba0002, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-13 23:02:01,027 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@386c27c6] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@386c27c6 2023-09-13 23:02:01,094 INFO [RS:0;jenkins-hbase4:39163] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,39163,1694645979837; all regions closed. 2023-09-13 23:02:01,095 DEBUG [RS:2;jenkins-hbase4:42165] regionserver.HRegionServer(1504): Waiting on fc0b72d902cbcbdd7fc3c24accf4ad18 2023-09-13 23:02:01,100 DEBUG [RS:0;jenkins-hbase4:39163] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/oldWALs 2023-09-13 23:02:01,100 INFO [RS:0;jenkins-hbase4:39163] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C39163%2C1694645979837:(num 1694645981478) 2023-09-13 23:02:01,100 DEBUG [RS:0;jenkins-hbase4:39163] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-13 23:02:01,100 INFO [RS:0;jenkins-hbase4:39163] regionserver.LeaseManager(133): Closed leases 2023-09-13 23:02:01,100 INFO [RS:0;jenkins-hbase4:39163] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-09-13 23:02:01,101 INFO [RS:0;jenkins-hbase4:39163] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-09-13 23:02:01,101 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-09-13 23:02:01,101 INFO [RS:0;jenkins-hbase4:39163] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-09-13 23:02:01,101 INFO [RS:0;jenkins-hbase4:39163] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-09-13 23:02:01,102 INFO [RS:0;jenkins-hbase4:39163] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:39163 2023-09-13 23:02:01,104 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:42165-0x100a784b9ba0003, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 23:02:01,104 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-13 23:02:01,104 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:39163-0x100a784b9ba0001, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,39163,1694645979837 2023-09-13 23:02:01,105 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,39163,1694645979837] 2023-09-13 23:02:01,105 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,39163,1694645979837; numProcessing=2 2023-09-13 23:02:01,106 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,39163,1694645979837 already deleted, retry=false 2023-09-13 23:02:01,106 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,39163,1694645979837 expired; onlineServers=1 2023-09-13 23:02:01,205 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:39163-0x100a784b9ba0001, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-13 23:02:01,205 INFO [RS:0;jenkins-hbase4:39163] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,39163,1694645979837; zookeeper connection closed. 2023-09-13 23:02:01,205 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:39163-0x100a784b9ba0001, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-13 23:02:01,205 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@7c7d5a0c] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@7c7d5a0c 2023-09-13 23:02:01,295 DEBUG [RS:2;jenkins-hbase4:42165] regionserver.HRegionServer(1504): Waiting on fc0b72d902cbcbdd7fc3c24accf4ad18 2023-09-13 23:02:01,324 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/hbase/namespace/fc0b72d902cbcbdd7fc3c24accf4ad18/.tmp/info/2617e88687de4caa9e82b6de7514ed53 2023-09-13 23:02:01,330 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/hbase/namespace/fc0b72d902cbcbdd7fc3c24accf4ad18/.tmp/info/2617e88687de4caa9e82b6de7514ed53 as hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/hbase/namespace/fc0b72d902cbcbdd7fc3c24accf4ad18/info/2617e88687de4caa9e82b6de7514ed53 2023-09-13 23:02:01,334 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/hbase/namespace/fc0b72d902cbcbdd7fc3c24accf4ad18/info/2617e88687de4caa9e82b6de7514ed53, entries=2, sequenceid=6, filesize=4.8 K 2023-09-13 23:02:01,335 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for fc0b72d902cbcbdd7fc3c24accf4ad18 in 442ms, sequenceid=6, compaction requested=false 2023-09-13 23:02:01,337 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-09-13 23:02:01,338 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-09-13 23:02:01,340 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/data/hbase/namespace/fc0b72d902cbcbdd7fc3c24accf4ad18/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-13 23:02:01,341 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-13 23:02:01,341 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1694645982087.fc0b72d902cbcbdd7fc3c24accf4ad18. 2023-09-13 23:02:01,341 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for fc0b72d902cbcbdd7fc3c24accf4ad18: 2023-09-13 23:02:01,341 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1694645982087.fc0b72d902cbcbdd7fc3c24accf4ad18. 2023-09-13 23:02:01,495 INFO [RS:2;jenkins-hbase4:42165] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,42165,1694645979926; all regions closed. 2023-09-13 23:02:01,500 DEBUG [RS:2;jenkins-hbase4:42165] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/oldWALs 2023-09-13 23:02:01,500 INFO [RS:2;jenkins-hbase4:42165] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C42165%2C1694645979926.meta:.meta(num 1694645981759) 2023-09-13 23:02:01,506 DEBUG [RS:2;jenkins-hbase4:42165] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/oldWALs 2023-09-13 23:02:01,506 INFO [RS:2;jenkins-hbase4:42165] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C42165%2C1694645979926:(num 1694645981478) 2023-09-13 23:02:01,506 DEBUG [RS:2;jenkins-hbase4:42165] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-13 23:02:01,506 INFO [RS:2;jenkins-hbase4:42165] regionserver.LeaseManager(133): Closed leases 2023-09-13 23:02:01,507 INFO [RS:2;jenkins-hbase4:42165] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-09-13 23:02:01,507 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-09-13 23:02:01,508 INFO [RS:2;jenkins-hbase4:42165] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:42165 2023-09-13 23:02:01,513 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:42165-0x100a784b9ba0003, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,42165,1694645979926 2023-09-13 23:02:01,513 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-13 23:02:01,514 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,42165,1694645979926] 2023-09-13 23:02:01,514 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,42165,1694645979926; numProcessing=3 2023-09-13 23:02:01,515 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,42165,1694645979926 already deleted, retry=false 2023-09-13 23:02:01,515 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,42165,1694645979926 expired; onlineServers=0 2023-09-13 23:02:01,515 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,36621,1694645978553' ***** 2023-09-13 23:02:01,515 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-09-13 23:02:01,515 DEBUG [M:0;jenkins-hbase4:36621] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@637a4359, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-09-13 23:02:01,515 INFO [M:0;jenkins-hbase4:36621] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,36621,1694645978553 2023-09-13 23:02:01,515 INFO [M:0;jenkins-hbase4:36621] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,36621,1694645978553; all regions closed. 2023-09-13 23:02:01,515 DEBUG [M:0;jenkins-hbase4:36621] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-13 23:02:01,515 DEBUG [M:0;jenkins-hbase4:36621] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-09-13 23:02:01,515 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-09-13 23:02:01,515 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1694645981136] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1694645981136,5,FailOnTimeoutGroup] 2023-09-13 23:02:01,515 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1694645981136] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1694645981136,5,FailOnTimeoutGroup] 2023-09-13 23:02:01,515 DEBUG [M:0;jenkins-hbase4:36621] cleaner.HFileCleaner(317): Stopping file delete threads 2023-09-13 23:02:01,516 INFO [M:0;jenkins-hbase4:36621] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-09-13 23:02:01,516 INFO [M:0;jenkins-hbase4:36621] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-09-13 23:02:01,516 INFO [M:0;jenkins-hbase4:36621] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-09-13 23:02:01,516 DEBUG [M:0;jenkins-hbase4:36621] master.HMaster(1512): Stopping service threads 2023-09-13 23:02:01,516 INFO [M:0;jenkins-hbase4:36621] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-09-13 23:02:01,516 ERROR [M:0;jenkins-hbase4:36621] procedure2.ProcedureExecutor(652): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-09-13 23:02:01,516 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master Thread[HFileArchiver-14,5,PEWorkerGroup] Thread[HFileArchiver-16,5,PEWorkerGroup] 2023-09-13 23:02:01,516 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-13 23:02:01,517 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-09-13 23:02:01,517 INFO [M:0;jenkins-hbase4:36621] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-09-13 23:02:01,517 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-09-13 23:02:01,517 DEBUG [M:0;jenkins-hbase4:36621] zookeeper.ZKUtil(398): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-09-13 23:02:01,517 WARN [M:0;jenkins-hbase4:36621] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-09-13 23:02:01,517 INFO [M:0;jenkins-hbase4:36621] assignment.AssignmentManager(315): Stopping assignment manager 2023-09-13 23:02:01,518 INFO [M:0;jenkins-hbase4:36621] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-09-13 23:02:01,518 DEBUG [M:0;jenkins-hbase4:36621] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-09-13 23:02:01,518 INFO [M:0;jenkins-hbase4:36621] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-13 23:02:01,518 DEBUG [M:0;jenkins-hbase4:36621] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-13 23:02:01,518 DEBUG [M:0;jenkins-hbase4:36621] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-09-13 23:02:01,518 DEBUG [M:0;jenkins-hbase4:36621] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-13 23:02:01,518 INFO [M:0;jenkins-hbase4:36621] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=375.88 KB heapSize=452.13 KB 2023-09-13 23:02:01,539 INFO [M:0;jenkins-hbase4:36621] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=375.88 KB at sequenceid=899 (bloomFilter=true), to=hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/6bbc7a2749ae40b18d582a1ea613ebc2 2023-09-13 23:02:01,543 INFO [M:0;jenkins-hbase4:36621] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6bbc7a2749ae40b18d582a1ea613ebc2 2023-09-13 23:02:01,544 DEBUG [M:0;jenkins-hbase4:36621] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/6bbc7a2749ae40b18d582a1ea613ebc2 as hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/6bbc7a2749ae40b18d582a1ea613ebc2 2023-09-13 23:02:01,548 INFO [M:0;jenkins-hbase4:36621] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6bbc7a2749ae40b18d582a1ea613ebc2 2023-09-13 23:02:01,548 INFO [M:0;jenkins-hbase4:36621] regionserver.HStore(1080): Added hdfs://localhost:36267/user/jenkins/test-data/6016bda1-2263-7898-2421-9c32205dc66d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/6bbc7a2749ae40b18d582a1ea613ebc2, entries=119, sequenceid=899, filesize=28.7 K 2023-09-13 23:02:01,549 INFO [M:0;jenkins-hbase4:36621] regionserver.HRegion(2948): Finished flush of dataSize ~375.88 KB/384897, heapSize ~452.12 KB/462968, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 31ms, sequenceid=899, compaction requested=false 2023-09-13 23:02:01,551 INFO [M:0;jenkins-hbase4:36621] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-13 23:02:01,551 DEBUG [M:0;jenkins-hbase4:36621] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-09-13 23:02:01,555 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-09-13 23:02:01,555 INFO [M:0;jenkins-hbase4:36621] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-09-13 23:02:01,556 INFO [M:0;jenkins-hbase4:36621] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:36621 2023-09-13 23:02:01,558 DEBUG [M:0;jenkins-hbase4:36621] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,36621,1694645978553 already deleted, retry=false 2023-09-13 23:02:01,614 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:42165-0x100a784b9ba0003, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-13 23:02:01,614 INFO [RS:2;jenkins-hbase4:42165] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,42165,1694645979926; zookeeper connection closed. 2023-09-13 23:02:01,614 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): regionserver:42165-0x100a784b9ba0003, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-13 23:02:01,614 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@2a6cf220] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@2a6cf220 2023-09-13 23:02:01,615 INFO [Listener at jenkins-hbase4.apache.org/37017] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 3 regionserver(s) complete 2023-09-13 23:02:01,714 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-13 23:02:01,714 INFO [M:0;jenkins-hbase4:36621] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,36621,1694645978553; zookeeper connection closed. 2023-09-13 23:02:01,714 DEBUG [Listener at localhost/38917-EventThread] zookeeper.ZKWatcher(600): master:36621-0x100a784b9ba0000, quorum=127.0.0.1:55012, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-13 23:02:01,716 WARN [Listener at jenkins-hbase4.apache.org/37017] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-09-13 23:02:01,719 INFO [Listener at jenkins-hbase4.apache.org/37017] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-09-13 23:02:01,823 WARN [BP-865208008-172.31.14.131-1694645974831 heartbeating to localhost/127.0.0.1:36267] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-09-13 23:02:01,823 WARN [BP-865208008-172.31.14.131-1694645974831 heartbeating to localhost/127.0.0.1:36267] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-865208008-172.31.14.131-1694645974831 (Datanode Uuid 964cd63f-69e0-49d8-bddf-a530be028c35) service to localhost/127.0.0.1:36267 2023-09-13 23:02:01,825 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/62bf382e-8712-1db5-f7ab-e78a401ad305/cluster_9ec0a0d8-f9f9-a794-7992-e14174bce4fb/dfs/data/data5/current/BP-865208008-172.31.14.131-1694645974831] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-13 23:02:01,825 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/62bf382e-8712-1db5-f7ab-e78a401ad305/cluster_9ec0a0d8-f9f9-a794-7992-e14174bce4fb/dfs/data/data6/current/BP-865208008-172.31.14.131-1694645974831] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-13 23:02:01,826 WARN [Listener at jenkins-hbase4.apache.org/37017] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-09-13 23:02:01,828 INFO [Listener at jenkins-hbase4.apache.org/37017] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-09-13 23:02:01,931 WARN [BP-865208008-172.31.14.131-1694645974831 heartbeating to localhost/127.0.0.1:36267] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-09-13 23:02:01,931 WARN [BP-865208008-172.31.14.131-1694645974831 heartbeating to localhost/127.0.0.1:36267] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-865208008-172.31.14.131-1694645974831 (Datanode Uuid 4434ad7b-b2ca-4a21-9f5a-5263525be9be) service to localhost/127.0.0.1:36267 2023-09-13 23:02:01,932 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/62bf382e-8712-1db5-f7ab-e78a401ad305/cluster_9ec0a0d8-f9f9-a794-7992-e14174bce4fb/dfs/data/data3/current/BP-865208008-172.31.14.131-1694645974831] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-13 23:02:01,933 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/62bf382e-8712-1db5-f7ab-e78a401ad305/cluster_9ec0a0d8-f9f9-a794-7992-e14174bce4fb/dfs/data/data4/current/BP-865208008-172.31.14.131-1694645974831] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-13 23:02:01,934 WARN [Listener at jenkins-hbase4.apache.org/37017] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-09-13 23:02:01,936 INFO [Listener at jenkins-hbase4.apache.org/37017] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-09-13 23:02:02,039 WARN [BP-865208008-172.31.14.131-1694645974831 heartbeating to localhost/127.0.0.1:36267] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-09-13 23:02:02,039 WARN [BP-865208008-172.31.14.131-1694645974831 heartbeating to localhost/127.0.0.1:36267] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-865208008-172.31.14.131-1694645974831 (Datanode Uuid ed9c1305-af42-4b97-bb47-2563570d7d7f) service to localhost/127.0.0.1:36267 2023-09-13 23:02:02,039 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/62bf382e-8712-1db5-f7ab-e78a401ad305/cluster_9ec0a0d8-f9f9-a794-7992-e14174bce4fb/dfs/data/data1/current/BP-865208008-172.31.14.131-1694645974831] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-13 23:02:02,040 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/62bf382e-8712-1db5-f7ab-e78a401ad305/cluster_9ec0a0d8-f9f9-a794-7992-e14174bce4fb/dfs/data/data2/current/BP-865208008-172.31.14.131-1694645974831] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-13 23:02:02,061 INFO [Listener at jenkins-hbase4.apache.org/37017] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-09-13 23:02:02,186 INFO [Listener at jenkins-hbase4.apache.org/37017] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-09-13 23:02:02,269 INFO [Listener at jenkins-hbase4.apache.org/37017] hbase.HBaseTestingUtility(1293): Minicluster is down