2023-07-17 12:10:52,603 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestExportSnapshot timeout: 13 mins 2023-07-17 12:10:52,859 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58af5705-0594-af5f-981c-fa1d3b267fab 2023-07-17 12:10:52,859 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobExportSnapshot timeout: 13 mins 2023-07-17 12:10:52,859 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobSecureExportSnapshot timeout: 13 mins 2023-07-17 12:10:52,900 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-07-17 12:10:53,150 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=3, rsPorts=, rsClass=null, numDataNodes=3, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-07-17 12:10:53,151 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58af5705-0594-af5f-981c-fa1d3b267fab/cluster_dbe17dd1-5343-f0e6-c8ea-53484480c8b1, deleteOnExit=true 2023-07-17 12:10:53,151 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-07-17 12:10:53,152 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58af5705-0594-af5f-981c-fa1d3b267fab/test.cache.data in system properties and HBase conf 2023-07-17 12:10:53,153 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58af5705-0594-af5f-981c-fa1d3b267fab/hadoop.tmp.dir in system properties and HBase conf 2023-07-17 12:10:53,153 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58af5705-0594-af5f-981c-fa1d3b267fab/hadoop.log.dir in system properties and HBase conf 2023-07-17 12:10:53,154 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58af5705-0594-af5f-981c-fa1d3b267fab/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-17 12:10:53,154 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58af5705-0594-af5f-981c-fa1d3b267fab/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-17 12:10:53,155 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-17 12:10:53,546 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-07-17 12:10:53,552 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58af5705-0594-af5f-981c-fa1d3b267fab/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-17 12:10:53,553 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58af5705-0594-af5f-981c-fa1d3b267fab/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-17 12:10:53,553 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58af5705-0594-af5f-981c-fa1d3b267fab/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-17 12:10:53,554 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58af5705-0594-af5f-981c-fa1d3b267fab/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-17 12:10:53,554 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58af5705-0594-af5f-981c-fa1d3b267fab/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-17 12:10:53,555 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58af5705-0594-af5f-981c-fa1d3b267fab/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-17 12:10:53,555 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58af5705-0594-af5f-981c-fa1d3b267fab/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-17 12:10:53,555 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58af5705-0594-af5f-981c-fa1d3b267fab/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-17 12:10:53,556 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58af5705-0594-af5f-981c-fa1d3b267fab/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-17 12:10:53,556 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58af5705-0594-af5f-981c-fa1d3b267fab/nfs.dump.dir in system properties and HBase conf 2023-07-17 12:10:53,557 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58af5705-0594-af5f-981c-fa1d3b267fab/java.io.tmpdir in system properties and HBase conf 2023-07-17 12:10:53,557 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58af5705-0594-af5f-981c-fa1d3b267fab/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-17 12:10:53,558 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58af5705-0594-af5f-981c-fa1d3b267fab/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-17 12:10:53,558 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58af5705-0594-af5f-981c-fa1d3b267fab/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-07-17 12:10:54,210 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-17 12:10:54,214 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-17 12:10:54,512 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-07-17 12:10:54,713 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-07-17 12:10:54,735 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-17 12:10:54,779 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-07-17 12:10:54,811 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58af5705-0594-af5f-981c-fa1d3b267fab/java.io.tmpdir/Jetty_localhost_45873_hdfs____.atiy5f/webapp 2023-07-17 12:10:54,971 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:45873 2023-07-17 12:10:55,012 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-17 12:10:55,012 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-17 12:10:55,488 WARN [Listener at localhost/46215] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-17 12:10:55,579 WARN [Listener at localhost/46215] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-17 12:10:55,603 WARN [Listener at localhost/46215] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-17 12:10:55,610 INFO [Listener at localhost/46215] log.Slf4jLog(67): jetty-6.1.26 2023-07-17 12:10:55,619 INFO [Listener at localhost/46215] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58af5705-0594-af5f-981c-fa1d3b267fab/java.io.tmpdir/Jetty_localhost_45855_datanode____xa68m6/webapp 2023-07-17 12:10:55,741 INFO [Listener at localhost/46215] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:45855 2023-07-17 12:10:56,235 WARN [Listener at localhost/43997] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-17 12:10:56,275 WARN [Listener at localhost/43997] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-17 12:10:56,282 WARN [Listener at localhost/43997] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-17 12:10:56,285 INFO [Listener at localhost/43997] log.Slf4jLog(67): jetty-6.1.26 2023-07-17 12:10:56,293 INFO [Listener at localhost/43997] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58af5705-0594-af5f-981c-fa1d3b267fab/java.io.tmpdir/Jetty_localhost_33991_datanode____.wcfrag/webapp 2023-07-17 12:10:56,429 INFO [Listener at localhost/43997] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:33991 2023-07-17 12:10:56,444 WARN [Listener at localhost/34511] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-17 12:10:56,511 WARN [Listener at localhost/34511] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-17 12:10:56,527 WARN [Listener at localhost/34511] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-17 12:10:56,529 INFO [Listener at localhost/34511] log.Slf4jLog(67): jetty-6.1.26 2023-07-17 12:10:56,540 INFO [Listener at localhost/34511] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58af5705-0594-af5f-981c-fa1d3b267fab/java.io.tmpdir/Jetty_localhost_35723_datanode____kr8yrh/webapp 2023-07-17 12:10:56,704 INFO [Listener at localhost/34511] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:35723 2023-07-17 12:10:56,723 WARN [Listener at localhost/44083] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-17 12:10:56,985 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xfcb38107b1b4ccd3: Processing first storage report for DS-7e6b2104-ee4c-40ef-bfe6-d5f8ff15b245 from datanode 29e2ec77-bce9-47bd-90c1-a35f8cbadef3 2023-07-17 12:10:56,987 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xfcb38107b1b4ccd3: from storage DS-7e6b2104-ee4c-40ef-bfe6-d5f8ff15b245 node DatanodeRegistration(127.0.0.1:43297, datanodeUuid=29e2ec77-bce9-47bd-90c1-a35f8cbadef3, infoPort=42181, infoSecurePort=0, ipcPort=44083, storageInfo=lv=-57;cid=testClusterID;nsid=705586001;c=1689595854283), blocks: 0, hasStaleStorage: true, processing time: 2 msecs, invalidatedBlocks: 0 2023-07-17 12:10:56,987 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xd217e4839fe1c860: Processing first storage report for DS-70b7bc44-5b5e-4204-8e22-f0a00e411686 from datanode d5207fdc-f249-451d-bf35-df0d5e2c2b7d 2023-07-17 12:10:56,987 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xd217e4839fe1c860: from storage DS-70b7bc44-5b5e-4204-8e22-f0a00e411686 node DatanodeRegistration(127.0.0.1:43171, datanodeUuid=d5207fdc-f249-451d-bf35-df0d5e2c2b7d, infoPort=34583, infoSecurePort=0, ipcPort=43997, storageInfo=lv=-57;cid=testClusterID;nsid=705586001;c=1689595854283), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-17 12:10:56,987 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xed048184358f6a3b: Processing first storage report for DS-ea9fbb89-0ec4-40ed-aa76-05f274399e65 from datanode 0b3c9637-1daf-471d-b2bd-b82b7cf75d3b 2023-07-17 12:10:56,987 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xed048184358f6a3b: from storage DS-ea9fbb89-0ec4-40ed-aa76-05f274399e65 node DatanodeRegistration(127.0.0.1:44977, datanodeUuid=0b3c9637-1daf-471d-b2bd-b82b7cf75d3b, infoPort=35275, infoSecurePort=0, ipcPort=34511, storageInfo=lv=-57;cid=testClusterID;nsid=705586001;c=1689595854283), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-17 12:10:56,987 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xfcb38107b1b4ccd3: Processing first storage report for DS-f3317e43-da6f-44fa-a177-22a82063ad5b from datanode 29e2ec77-bce9-47bd-90c1-a35f8cbadef3 2023-07-17 12:10:56,987 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xfcb38107b1b4ccd3: from storage DS-f3317e43-da6f-44fa-a177-22a82063ad5b node DatanodeRegistration(127.0.0.1:43297, datanodeUuid=29e2ec77-bce9-47bd-90c1-a35f8cbadef3, infoPort=42181, infoSecurePort=0, ipcPort=44083, storageInfo=lv=-57;cid=testClusterID;nsid=705586001;c=1689595854283), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-17 12:10:56,988 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xd217e4839fe1c860: Processing first storage report for DS-4e6c7084-3113-4fa2-b58c-5ed67d5eb98b from datanode d5207fdc-f249-451d-bf35-df0d5e2c2b7d 2023-07-17 12:10:56,988 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xd217e4839fe1c860: from storage DS-4e6c7084-3113-4fa2-b58c-5ed67d5eb98b node DatanodeRegistration(127.0.0.1:43171, datanodeUuid=d5207fdc-f249-451d-bf35-df0d5e2c2b7d, infoPort=34583, infoSecurePort=0, ipcPort=43997, storageInfo=lv=-57;cid=testClusterID;nsid=705586001;c=1689595854283), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-17 12:10:56,988 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xed048184358f6a3b: Processing first storage report for DS-17c8bc45-404e-4a3a-a3be-a3adcfeb3279 from datanode 0b3c9637-1daf-471d-b2bd-b82b7cf75d3b 2023-07-17 12:10:56,988 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xed048184358f6a3b: from storage DS-17c8bc45-404e-4a3a-a3be-a3adcfeb3279 node DatanodeRegistration(127.0.0.1:44977, datanodeUuid=0b3c9637-1daf-471d-b2bd-b82b7cf75d3b, infoPort=35275, infoSecurePort=0, ipcPort=34511, storageInfo=lv=-57;cid=testClusterID;nsid=705586001;c=1689595854283), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-17 12:10:57,232 DEBUG [Listener at localhost/44083] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58af5705-0594-af5f-981c-fa1d3b267fab 2023-07-17 12:10:57,339 INFO [Listener at localhost/44083] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58af5705-0594-af5f-981c-fa1d3b267fab/cluster_dbe17dd1-5343-f0e6-c8ea-53484480c8b1/zookeeper_0, clientPort=55622, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58af5705-0594-af5f-981c-fa1d3b267fab/cluster_dbe17dd1-5343-f0e6-c8ea-53484480c8b1/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58af5705-0594-af5f-981c-fa1d3b267fab/cluster_dbe17dd1-5343-f0e6-c8ea-53484480c8b1/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-07-17 12:10:57,358 INFO [Listener at localhost/44083] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=55622 2023-07-17 12:10:57,369 INFO [Listener at localhost/44083] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-17 12:10:57,371 INFO [Listener at localhost/44083] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-17 12:10:58,075 INFO [Listener at localhost/44083] util.FSUtils(471): Created version file at hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b with version=8 2023-07-17 12:10:58,075 INFO [Listener at localhost/44083] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/hbase-staging 2023-07-17 12:10:58,452 INFO [Listener at localhost/44083] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-07-17 12:10:59,086 INFO [Listener at localhost/44083] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-07-17 12:10:59,135 INFO [Listener at localhost/44083] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-17 12:10:59,135 INFO [Listener at localhost/44083] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-17 12:10:59,136 INFO [Listener at localhost/44083] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-17 12:10:59,136 INFO [Listener at localhost/44083] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-17 12:10:59,136 INFO [Listener at localhost/44083] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-17 12:10:59,329 INFO [Listener at localhost/44083] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-07-17 12:10:59,416 DEBUG [Listener at localhost/44083] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-07-17 12:10:59,524 INFO [Listener at localhost/44083] ipc.NettyRpcServer(120): Bind to /172.31.14.131:42013 2023-07-17 12:10:59,538 INFO [Listener at localhost/44083] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-17 12:10:59,540 INFO [Listener at localhost/44083] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-17 12:10:59,565 INFO [Listener at localhost/44083] zookeeper.RecoverableZooKeeper(93): Process identifier=master:42013 connecting to ZooKeeper ensemble=127.0.0.1:55622 2023-07-17 12:10:59,622 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:420130x0, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-17 12:10:59,626 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:42013-0x10173314c9f0000 connected 2023-07-17 12:10:59,674 DEBUG [Listener at localhost/44083] zookeeper.ZKUtil(164): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-17 12:10:59,675 DEBUG [Listener at localhost/44083] zookeeper.ZKUtil(164): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-17 12:10:59,688 DEBUG [Listener at localhost/44083] zookeeper.ZKUtil(164): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-17 12:10:59,698 DEBUG [Listener at localhost/44083] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=42013 2023-07-17 12:10:59,698 DEBUG [Listener at localhost/44083] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=42013 2023-07-17 12:10:59,699 DEBUG [Listener at localhost/44083] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=42013 2023-07-17 12:10:59,705 DEBUG [Listener at localhost/44083] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=42013 2023-07-17 12:10:59,705 DEBUG [Listener at localhost/44083] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=42013 2023-07-17 12:10:59,713 INFO [Listener at localhost/44083] master.HMaster(444): hbase.rootdir=hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b, hbase.cluster.distributed=false 2023-07-17 12:10:59,789 INFO [Listener at localhost/44083] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-17 12:10:59,789 INFO [Listener at localhost/44083] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-17 12:10:59,789 INFO [Listener at localhost/44083] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-17 12:10:59,790 INFO [Listener at localhost/44083] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-17 12:10:59,790 INFO [Listener at localhost/44083] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-17 12:10:59,790 INFO [Listener at localhost/44083] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-17 12:10:59,796 INFO [Listener at localhost/44083] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-17 12:10:59,800 INFO [Listener at localhost/44083] ipc.NettyRpcServer(120): Bind to /172.31.14.131:39491 2023-07-17 12:10:59,803 INFO [Listener at localhost/44083] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-17 12:10:59,811 INFO [Listener at localhost/44083] mob.MobFileCache(124): MobFileCache disabled 2023-07-17 12:10:59,813 INFO [Listener at localhost/44083] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-17 12:10:59,815 INFO [Listener at localhost/44083] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-17 12:10:59,818 INFO [Listener at localhost/44083] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:39491 connecting to ZooKeeper ensemble=127.0.0.1:55622 2023-07-17 12:10:59,823 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:394910x0, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-17 12:10:59,825 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:39491-0x10173314c9f0001 connected 2023-07-17 12:10:59,825 DEBUG [Listener at localhost/44083] zookeeper.ZKUtil(164): regionserver:39491-0x10173314c9f0001, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-17 12:10:59,826 DEBUG [Listener at localhost/44083] zookeeper.ZKUtil(164): regionserver:39491-0x10173314c9f0001, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-17 12:10:59,828 DEBUG [Listener at localhost/44083] zookeeper.ZKUtil(164): regionserver:39491-0x10173314c9f0001, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-17 12:10:59,834 DEBUG [Listener at localhost/44083] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=39491 2023-07-17 12:10:59,834 DEBUG [Listener at localhost/44083] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=39491 2023-07-17 12:10:59,836 DEBUG [Listener at localhost/44083] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=39491 2023-07-17 12:10:59,837 DEBUG [Listener at localhost/44083] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=39491 2023-07-17 12:10:59,838 DEBUG [Listener at localhost/44083] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=39491 2023-07-17 12:10:59,855 INFO [Listener at localhost/44083] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-17 12:10:59,855 INFO [Listener at localhost/44083] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-17 12:10:59,856 INFO [Listener at localhost/44083] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-17 12:10:59,856 INFO [Listener at localhost/44083] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-17 12:10:59,856 INFO [Listener at localhost/44083] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-17 12:10:59,857 INFO [Listener at localhost/44083] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-17 12:10:59,857 INFO [Listener at localhost/44083] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-17 12:10:59,863 INFO [Listener at localhost/44083] ipc.NettyRpcServer(120): Bind to /172.31.14.131:33685 2023-07-17 12:10:59,863 INFO [Listener at localhost/44083] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-17 12:10:59,868 INFO [Listener at localhost/44083] mob.MobFileCache(124): MobFileCache disabled 2023-07-17 12:10:59,870 INFO [Listener at localhost/44083] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-17 12:10:59,873 INFO [Listener at localhost/44083] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-17 12:10:59,876 INFO [Listener at localhost/44083] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:33685 connecting to ZooKeeper ensemble=127.0.0.1:55622 2023-07-17 12:10:59,883 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:336850x0, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-17 12:10:59,885 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:33685-0x10173314c9f0002 connected 2023-07-17 12:10:59,885 DEBUG [Listener at localhost/44083] zookeeper.ZKUtil(164): regionserver:33685-0x10173314c9f0002, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-17 12:10:59,886 DEBUG [Listener at localhost/44083] zookeeper.ZKUtil(164): regionserver:33685-0x10173314c9f0002, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-17 12:10:59,886 DEBUG [Listener at localhost/44083] zookeeper.ZKUtil(164): regionserver:33685-0x10173314c9f0002, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-17 12:10:59,890 DEBUG [Listener at localhost/44083] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=33685 2023-07-17 12:10:59,890 DEBUG [Listener at localhost/44083] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=33685 2023-07-17 12:10:59,891 DEBUG [Listener at localhost/44083] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=33685 2023-07-17 12:10:59,893 DEBUG [Listener at localhost/44083] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=33685 2023-07-17 12:10:59,894 DEBUG [Listener at localhost/44083] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=33685 2023-07-17 12:10:59,907 INFO [Listener at localhost/44083] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-17 12:10:59,908 INFO [Listener at localhost/44083] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-17 12:10:59,908 INFO [Listener at localhost/44083] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-17 12:10:59,908 INFO [Listener at localhost/44083] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-17 12:10:59,909 INFO [Listener at localhost/44083] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-17 12:10:59,909 INFO [Listener at localhost/44083] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-17 12:10:59,909 INFO [Listener at localhost/44083] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-17 12:10:59,914 INFO [Listener at localhost/44083] ipc.NettyRpcServer(120): Bind to /172.31.14.131:42615 2023-07-17 12:10:59,915 INFO [Listener at localhost/44083] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-17 12:10:59,919 INFO [Listener at localhost/44083] mob.MobFileCache(124): MobFileCache disabled 2023-07-17 12:10:59,920 INFO [Listener at localhost/44083] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-17 12:10:59,921 INFO [Listener at localhost/44083] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-17 12:10:59,922 INFO [Listener at localhost/44083] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:42615 connecting to ZooKeeper ensemble=127.0.0.1:55622 2023-07-17 12:10:59,927 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:426150x0, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-17 12:10:59,928 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:42615-0x10173314c9f0003 connected 2023-07-17 12:10:59,928 DEBUG [Listener at localhost/44083] zookeeper.ZKUtil(164): regionserver:42615-0x10173314c9f0003, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-17 12:10:59,929 DEBUG [Listener at localhost/44083] zookeeper.ZKUtil(164): regionserver:42615-0x10173314c9f0003, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-17 12:10:59,930 DEBUG [Listener at localhost/44083] zookeeper.ZKUtil(164): regionserver:42615-0x10173314c9f0003, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-17 12:10:59,934 DEBUG [Listener at localhost/44083] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=42615 2023-07-17 12:10:59,942 DEBUG [Listener at localhost/44083] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=42615 2023-07-17 12:10:59,943 DEBUG [Listener at localhost/44083] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=42615 2023-07-17 12:10:59,944 DEBUG [Listener at localhost/44083] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=42615 2023-07-17 12:10:59,944 DEBUG [Listener at localhost/44083] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=42615 2023-07-17 12:10:59,947 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,42013,1689595858265 2023-07-17 12:10:59,957 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-17 12:10:59,962 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,42013,1689595858265 2023-07-17 12:10:59,988 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-17 12:10:59,989 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:42615-0x10173314c9f0003, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-17 12:10:59,989 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:39491-0x10173314c9f0001, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-17 12:10:59,989 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-17 12:10:59,988 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:33685-0x10173314c9f0002, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-17 12:10:59,991 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-17 12:10:59,992 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-17 12:10:59,993 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,42013,1689595858265 from backup master directory 2023-07-17 12:10:59,998 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,42013,1689595858265 2023-07-17 12:10:59,998 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-17 12:10:59,999 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-17 12:10:59,999 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,42013,1689595858265 2023-07-17 12:11:00,003 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-07-17 12:11:00,010 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-07-17 12:11:00,142 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/hbase.id with ID: 6073e786-68f7-4c4f-9125-e530bcb2ce3f 2023-07-17 12:11:00,207 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-17 12:11:00,226 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-17 12:11:00,316 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x49de9804 to 127.0.0.1:55622 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-17 12:11:00,358 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@69266e5c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-17 12:11:00,389 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-17 12:11:00,391 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-07-17 12:11:00,411 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-07-17 12:11:00,411 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-07-17 12:11:00,413 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-17 12:11:00,418 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-17 12:11:00,419 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-17 12:11:00,466 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/MasterData/data/master/store-tmp 2023-07-17 12:11:00,531 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 12:11:00,531 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-17 12:11:00,532 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-17 12:11:00,532 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-17 12:11:00,532 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-17 12:11:00,532 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-17 12:11:00,532 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-17 12:11:00,532 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-17 12:11:00,537 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/MasterData/WALs/jenkins-hbase4.apache.org,42013,1689595858265 2023-07-17 12:11:00,564 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C42013%2C1689595858265, suffix=, logDir=hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/MasterData/WALs/jenkins-hbase4.apache.org,42013,1689595858265, archiveDir=hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/MasterData/oldWALs, maxLogs=10 2023-07-17 12:11:00,648 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43171,DS-70b7bc44-5b5e-4204-8e22-f0a00e411686,DISK] 2023-07-17 12:11:00,648 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43297,DS-7e6b2104-ee4c-40ef-bfe6-d5f8ff15b245,DISK] 2023-07-17 12:11:00,648 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44977,DS-ea9fbb89-0ec4-40ed-aa76-05f274399e65,DISK] 2023-07-17 12:11:00,657 DEBUG [RS-EventLoopGroup-5-1] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-17 12:11:00,734 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/MasterData/WALs/jenkins-hbase4.apache.org,42013,1689595858265/jenkins-hbase4.apache.org%2C42013%2C1689595858265.1689595860574 2023-07-17 12:11:00,739 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:43297,DS-7e6b2104-ee4c-40ef-bfe6-d5f8ff15b245,DISK], DatanodeInfoWithStorage[127.0.0.1:44977,DS-ea9fbb89-0ec4-40ed-aa76-05f274399e65,DISK], DatanodeInfoWithStorage[127.0.0.1:43171,DS-70b7bc44-5b5e-4204-8e22-f0a00e411686,DISK]] 2023-07-17 12:11:00,740 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-07-17 12:11:00,740 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 12:11:00,745 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-07-17 12:11:00,747 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-07-17 12:11:00,826 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-07-17 12:11:00,835 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-07-17 12:11:00,880 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-07-17 12:11:00,896 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-17 12:11:00,903 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-17 12:11:00,906 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-17 12:11:00,926 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-07-17 12:11:00,932 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-17 12:11:00,933 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67342873, jitterRate=0.003487005829811096}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-17 12:11:00,933 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-17 12:11:00,935 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-07-17 12:11:00,966 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-07-17 12:11:00,966 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-07-17 12:11:00,970 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-07-17 12:11:00,973 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 1 msec 2023-07-17 12:11:01,026 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 53 msec 2023-07-17 12:11:01,027 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-07-17 12:11:01,069 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-07-17 12:11:01,076 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-07-17 12:11:01,108 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-07-17 12:11:01,116 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-07-17 12:11:01,117 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-07-17 12:11:01,127 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-07-17 12:11:01,133 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-07-17 12:11:01,136 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-17 12:11:01,139 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-07-17 12:11:01,140 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-07-17 12:11:01,159 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-07-17 12:11:01,165 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:33685-0x10173314c9f0002, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-17 12:11:01,166 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-17 12:11:01,166 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:39491-0x10173314c9f0001, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-17 12:11:01,166 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:42615-0x10173314c9f0003, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-17 12:11:01,166 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-17 12:11:01,174 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,42013,1689595858265, sessionid=0x10173314c9f0000, setting cluster-up flag (Was=false) 2023-07-17 12:11:01,197 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-17 12:11:01,206 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-07-17 12:11:01,208 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,42013,1689595858265 2023-07-17 12:11:01,215 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-17 12:11:01,223 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-07-17 12:11:01,225 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,42013,1689595858265 2023-07-17 12:11:01,229 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.hbase-snapshot/.tmp 2023-07-17 12:11:01,253 INFO [RS:0;jenkins-hbase4:39491] regionserver.HRegionServer(951): ClusterId : 6073e786-68f7-4c4f-9125-e530bcb2ce3f 2023-07-17 12:11:01,267 INFO [RS:1;jenkins-hbase4:33685] regionserver.HRegionServer(951): ClusterId : 6073e786-68f7-4c4f-9125-e530bcb2ce3f 2023-07-17 12:11:01,271 DEBUG [RS:0;jenkins-hbase4:39491] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-17 12:11:01,271 DEBUG [RS:1;jenkins-hbase4:33685] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-17 12:11:01,273 INFO [RS:2;jenkins-hbase4:42615] regionserver.HRegionServer(951): ClusterId : 6073e786-68f7-4c4f-9125-e530bcb2ce3f 2023-07-17 12:11:01,274 DEBUG [RS:2;jenkins-hbase4:42615] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-17 12:11:01,283 DEBUG [RS:1;jenkins-hbase4:33685] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-17 12:11:01,283 DEBUG [RS:2;jenkins-hbase4:42615] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-17 12:11:01,284 DEBUG [RS:1;jenkins-hbase4:33685] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-17 12:11:01,284 DEBUG [RS:2;jenkins-hbase4:42615] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-17 12:11:01,289 DEBUG [RS:2;jenkins-hbase4:42615] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-17 12:11:01,295 DEBUG [RS:2;jenkins-hbase4:42615] zookeeper.ReadOnlyZKClient(139): Connect 0x369d3ad4 to 127.0.0.1:55622 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-17 12:11:01,300 DEBUG [RS:0;jenkins-hbase4:39491] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-17 12:11:01,300 DEBUG [RS:0;jenkins-hbase4:39491] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-17 12:11:01,306 DEBUG [RS:0;jenkins-hbase4:39491] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-17 12:11:01,323 DEBUG [RS:1;jenkins-hbase4:33685] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-17 12:11:01,324 DEBUG [RS:1;jenkins-hbase4:33685] zookeeper.ReadOnlyZKClient(139): Connect 0x409d28e9 to 127.0.0.1:55622 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-17 12:11:01,334 DEBUG [RS:0;jenkins-hbase4:39491] zookeeper.ReadOnlyZKClient(139): Connect 0x711ee0b2 to 127.0.0.1:55622 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-17 12:11:01,356 DEBUG [RS:2;jenkins-hbase4:42615] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@207e9478, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-17 12:11:01,370 DEBUG [RS:2;jenkins-hbase4:42615] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4e2c3785, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-17 12:11:01,378 DEBUG [RS:1;jenkins-hbase4:33685] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@59fae9e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-17 12:11:01,379 DEBUG [RS:1;jenkins-hbase4:33685] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@65065c3f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-17 12:11:01,411 DEBUG [RS:0;jenkins-hbase4:39491] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@397047d0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-17 12:11:01,411 DEBUG [RS:0;jenkins-hbase4:39491] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@100801be, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-17 12:11:01,413 DEBUG [RS:2;jenkins-hbase4:42615] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:2;jenkins-hbase4:42615 2023-07-17 12:11:01,419 INFO [RS:2;jenkins-hbase4:42615] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-17 12:11:01,419 INFO [RS:2;jenkins-hbase4:42615] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-17 12:11:01,421 DEBUG [RS:1;jenkins-hbase4:33685] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:33685 2023-07-17 12:11:01,422 INFO [RS:1;jenkins-hbase4:33685] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-17 12:11:01,423 INFO [RS:1;jenkins-hbase4:33685] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-17 12:11:01,430 DEBUG [RS:0;jenkins-hbase4:39491] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:39491 2023-07-17 12:11:01,430 INFO [RS:0;jenkins-hbase4:39491] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-17 12:11:01,430 INFO [RS:0;jenkins-hbase4:39491] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-17 12:11:01,467 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2930): Registered master coprocessor service: service=AccessControlService 2023-07-17 12:11:01,467 DEBUG [RS:1;jenkins-hbase4:33685] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-17 12:11:01,467 DEBUG [RS:0;jenkins-hbase4:39491] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-17 12:11:01,467 DEBUG [RS:2;jenkins-hbase4:42615] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-17 12:11:01,471 INFO [RS:2;jenkins-hbase4:42615] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-17 12:11:01,471 DEBUG [RS:2;jenkins-hbase4:42615] regionserver.HRegionServer(1022): About to register with Master. 2023-07-17 12:11:01,469 INFO [RS:1;jenkins-hbase4:33685] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-17 12:11:01,474 DEBUG [RS:1;jenkins-hbase4:33685] regionserver.HRegionServer(1022): About to register with Master. 2023-07-17 12:11:01,470 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-17 12:11:01,469 INFO [RS:0;jenkins-hbase4:39491] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-17 12:11:01,475 DEBUG [RS:0;jenkins-hbase4:39491] regionserver.HRegionServer(1022): About to register with Master. 2023-07-17 12:11:01,475 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver loaded, priority=536870912. 2023-07-17 12:11:01,476 INFO [RS:0;jenkins-hbase4:39491] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,42013,1689595858265 with isa=jenkins-hbase4.apache.org/172.31.14.131:39491, startcode=1689595859788 2023-07-17 12:11:01,476 INFO [RS:2;jenkins-hbase4:42615] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,42013,1689595858265 with isa=jenkins-hbase4.apache.org/172.31.14.131:42615, startcode=1689595859906 2023-07-17 12:11:01,486 INFO [RS:1;jenkins-hbase4:33685] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,42013,1689595858265 with isa=jenkins-hbase4.apache.org/172.31.14.131:33685, startcode=1689595859854 2023-07-17 12:11:01,508 DEBUG [RS:0;jenkins-hbase4:39491] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-17 12:11:01,508 DEBUG [RS:2;jenkins-hbase4:42615] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-17 12:11:01,508 DEBUG [RS:1;jenkins-hbase4:33685] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-17 12:11:01,585 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52097, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-07-17 12:11:01,585 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41023, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-07-17 12:11:01,585 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37921, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-07-17 12:11:01,596 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=42013] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-17 12:11:01,597 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-07-17 12:11:01,605 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=42013] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-17 12:11:01,609 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=42013] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-17 12:11:01,611 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-17 12:11:01,611 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-17 12:11:01,611 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-17 12:11:01,611 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-17 12:11:01,611 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-07-17 12:11:01,611 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-17 12:11:01,612 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-17 12:11:01,612 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-17 12:11:01,614 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1689595891614 2023-07-17 12:11:01,617 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-07-17 12:11:01,625 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-07-17 12:11:01,625 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-07-17 12:11:01,632 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-07-17 12:11:01,632 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-17 12:11:01,635 DEBUG [RS:2;jenkins-hbase4:42615] regionserver.HRegionServer(2830): Master is not running yet 2023-07-17 12:11:01,635 DEBUG [RS:1;jenkins-hbase4:33685] regionserver.HRegionServer(2830): Master is not running yet 2023-07-17 12:11:01,639 DEBUG [RS:0;jenkins-hbase4:39491] regionserver.HRegionServer(2830): Master is not running yet 2023-07-17 12:11:01,639 WARN [RS:0;jenkins-hbase4:39491] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-17 12:11:01,635 WARN [RS:2;jenkins-hbase4:42615] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-17 12:11:01,639 WARN [RS:1;jenkins-hbase4:33685] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-17 12:11:01,640 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-07-17 12:11:01,641 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-07-17 12:11:01,641 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-07-17 12:11:01,641 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-07-17 12:11:01,642 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-17 12:11:01,644 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-07-17 12:11:01,646 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-07-17 12:11:01,646 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-07-17 12:11:01,649 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-07-17 12:11:01,650 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-07-17 12:11:01,651 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689595861651,5,FailOnTimeoutGroup] 2023-07-17 12:11:01,652 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689595861652,5,FailOnTimeoutGroup] 2023-07-17 12:11:01,652 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-17 12:11:01,652 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-07-17 12:11:01,654 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-07-17 12:11:01,654 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-07-17 12:11:01,694 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-17 12:11:01,695 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-17 12:11:01,696 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b 2023-07-17 12:11:01,740 INFO [RS:0;jenkins-hbase4:39491] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,42013,1689595858265 with isa=jenkins-hbase4.apache.org/172.31.14.131:39491, startcode=1689595859788 2023-07-17 12:11:01,741 INFO [RS:2;jenkins-hbase4:42615] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,42013,1689595858265 with isa=jenkins-hbase4.apache.org/172.31.14.131:42615, startcode=1689595859906 2023-07-17 12:11:01,741 INFO [RS:1;jenkins-hbase4:33685] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,42013,1689595858265 with isa=jenkins-hbase4.apache.org/172.31.14.131:33685, startcode=1689595859854 2023-07-17 12:11:01,755 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=42013] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:11:01,762 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=42013] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:11:01,762 DEBUG [RS:0;jenkins-hbase4:39491] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b 2023-07-17 12:11:01,762 DEBUG [RS:0;jenkins-hbase4:39491] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:46215 2023-07-17 12:11:01,763 DEBUG [RS:0;jenkins-hbase4:39491] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-17 12:11:01,764 DEBUG [RS:2;jenkins-hbase4:42615] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b 2023-07-17 12:11:01,764 DEBUG [RS:2;jenkins-hbase4:42615] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:46215 2023-07-17 12:11:01,764 DEBUG [RS:2;jenkins-hbase4:42615] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-17 12:11:01,766 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=42013] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:11:01,770 DEBUG [RS:1;jenkins-hbase4:33685] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b 2023-07-17 12:11:01,770 DEBUG [RS:1;jenkins-hbase4:33685] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:46215 2023-07-17 12:11:01,770 DEBUG [RS:1;jenkins-hbase4:33685] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-17 12:11:01,777 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-17 12:11:01,781 DEBUG [RS:1;jenkins-hbase4:33685] zookeeper.ZKUtil(162): regionserver:33685-0x10173314c9f0002, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:11:01,781 WARN [RS:1;jenkins-hbase4:33685] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-17 12:11:01,783 INFO [RS:1;jenkins-hbase4:33685] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-17 12:11:01,783 DEBUG [RS:1;jenkins-hbase4:33685] regionserver.HRegionServer(1948): logDir=hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/WALs/jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:11:01,784 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,39491,1689595859788] 2023-07-17 12:11:01,784 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,42615,1689595859906] 2023-07-17 12:11:01,784 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,33685,1689595859854] 2023-07-17 12:11:01,784 DEBUG [RS:0;jenkins-hbase4:39491] zookeeper.ZKUtil(162): regionserver:39491-0x10173314c9f0001, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:11:01,784 DEBUG [RS:2;jenkins-hbase4:42615] zookeeper.ZKUtil(162): regionserver:42615-0x10173314c9f0003, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:11:01,785 WARN [RS:0;jenkins-hbase4:39491] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-17 12:11:01,785 WARN [RS:2;jenkins-hbase4:42615] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-17 12:11:01,790 INFO [RS:0;jenkins-hbase4:39491] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-17 12:11:01,791 DEBUG [RS:0;jenkins-hbase4:39491] regionserver.HRegionServer(1948): logDir=hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/WALs/jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:11:01,790 INFO [RS:2;jenkins-hbase4:42615] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-17 12:11:01,792 DEBUG [RS:2;jenkins-hbase4:42615] regionserver.HRegionServer(1948): logDir=hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/WALs/jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:11:01,793 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 12:11:01,803 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-17 12:11:01,808 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/hbase/meta/1588230740/info 2023-07-17 12:11:01,809 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-17 12:11:01,811 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-17 12:11:01,812 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-17 12:11:01,812 DEBUG [RS:2;jenkins-hbase4:42615] zookeeper.ZKUtil(162): regionserver:42615-0x10173314c9f0003, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:11:01,813 DEBUG [RS:2;jenkins-hbase4:42615] zookeeper.ZKUtil(162): regionserver:42615-0x10173314c9f0003, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:11:01,813 DEBUG [RS:0;jenkins-hbase4:39491] zookeeper.ZKUtil(162): regionserver:39491-0x10173314c9f0001, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:11:01,814 DEBUG [RS:2;jenkins-hbase4:42615] zookeeper.ZKUtil(162): regionserver:42615-0x10173314c9f0003, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:11:01,815 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/hbase/meta/1588230740/rep_barrier 2023-07-17 12:11:01,816 DEBUG [RS:0;jenkins-hbase4:39491] zookeeper.ZKUtil(162): regionserver:39491-0x10173314c9f0001, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:11:01,816 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-17 12:11:01,816 DEBUG [RS:1;jenkins-hbase4:33685] zookeeper.ZKUtil(162): regionserver:33685-0x10173314c9f0002, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:11:01,817 DEBUG [RS:1;jenkins-hbase4:33685] zookeeper.ZKUtil(162): regionserver:33685-0x10173314c9f0002, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:11:01,817 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-17 12:11:01,818 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-17 12:11:01,818 DEBUG [RS:1;jenkins-hbase4:33685] zookeeper.ZKUtil(162): regionserver:33685-0x10173314c9f0002, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:11:01,818 DEBUG [RS:0;jenkins-hbase4:39491] zookeeper.ZKUtil(162): regionserver:39491-0x10173314c9f0001, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:11:01,820 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/hbase/meta/1588230740/table 2023-07-17 12:11:01,821 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-17 12:11:01,822 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-17 12:11:01,824 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/hbase/meta/1588230740 2023-07-17 12:11:01,825 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/hbase/meta/1588230740 2023-07-17 12:11:01,830 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-17 12:11:01,831 DEBUG [RS:1;jenkins-hbase4:33685] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-17 12:11:01,833 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-17 12:11:01,832 DEBUG [RS:0;jenkins-hbase4:39491] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-17 12:11:01,832 DEBUG [RS:2;jenkins-hbase4:42615] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-17 12:11:01,851 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-17 12:11:01,852 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71659496, jitterRate=0.06780970096588135}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-17 12:11:01,853 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-17 12:11:01,853 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-17 12:11:01,853 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-17 12:11:01,853 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-17 12:11:01,853 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-17 12:11:01,853 INFO [RS:1;jenkins-hbase4:33685] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-17 12:11:01,853 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-17 12:11:01,853 INFO [RS:0;jenkins-hbase4:39491] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-17 12:11:01,854 INFO [RS:2;jenkins-hbase4:42615] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-17 12:11:01,873 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-17 12:11:01,873 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-17 12:11:01,886 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-07-17 12:11:01,886 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-07-17 12:11:01,895 INFO [RS:1;jenkins-hbase4:33685] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-17 12:11:01,900 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-07-17 12:11:01,902 INFO [RS:1;jenkins-hbase4:33685] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-17 12:11:01,902 INFO [RS:1;jenkins-hbase4:33685] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-17 12:11:01,910 INFO [RS:1;jenkins-hbase4:33685] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-17 12:11:01,901 INFO [RS:2;jenkins-hbase4:42615] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-17 12:11:01,907 INFO [RS:0;jenkins-hbase4:39491] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-17 12:11:01,915 INFO [RS:2;jenkins-hbase4:42615] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-17 12:11:01,925 INFO [RS:2;jenkins-hbase4:42615] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-17 12:11:01,933 INFO [RS:2;jenkins-hbase4:42615] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-17 12:11:01,937 INFO [RS:0;jenkins-hbase4:39491] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-17 12:11:01,937 INFO [RS:0;jenkins-hbase4:39491] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-17 12:11:01,942 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-07-17 12:11:01,945 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-07-17 12:11:01,946 INFO [RS:0;jenkins-hbase4:39491] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-17 12:11:01,951 INFO [RS:1;jenkins-hbase4:33685] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-17 12:11:01,951 INFO [RS:2;jenkins-hbase4:42615] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-17 12:11:01,951 DEBUG [RS:2;jenkins-hbase4:42615] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-17 12:11:01,952 INFO [RS:0;jenkins-hbase4:39491] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-17 12:11:01,951 DEBUG [RS:1;jenkins-hbase4:33685] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-17 12:11:01,953 DEBUG [RS:0;jenkins-hbase4:39491] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-17 12:11:01,952 DEBUG [RS:2;jenkins-hbase4:42615] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-17 12:11:01,953 DEBUG [RS:0;jenkins-hbase4:39491] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-17 12:11:01,953 DEBUG [RS:0;jenkins-hbase4:39491] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-17 12:11:01,953 DEBUG [RS:2;jenkins-hbase4:42615] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-17 12:11:01,953 DEBUG [RS:0;jenkins-hbase4:39491] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-17 12:11:01,953 DEBUG [RS:2;jenkins-hbase4:42615] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-17 12:11:01,953 DEBUG [RS:0;jenkins-hbase4:39491] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-17 12:11:01,953 DEBUG [RS:2;jenkins-hbase4:42615] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-17 12:11:01,953 DEBUG [RS:0;jenkins-hbase4:39491] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-17 12:11:01,954 DEBUG [RS:2;jenkins-hbase4:42615] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-17 12:11:01,954 DEBUG [RS:0;jenkins-hbase4:39491] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-17 12:11:01,954 DEBUG [RS:2;jenkins-hbase4:42615] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-17 12:11:01,954 DEBUG [RS:0;jenkins-hbase4:39491] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-17 12:11:01,954 DEBUG [RS:2;jenkins-hbase4:42615] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-17 12:11:01,954 DEBUG [RS:0;jenkins-hbase4:39491] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-17 12:11:01,954 DEBUG [RS:2;jenkins-hbase4:42615] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-17 12:11:01,954 DEBUG [RS:2;jenkins-hbase4:42615] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-17 12:11:01,956 DEBUG [RS:0;jenkins-hbase4:39491] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-17 12:11:01,956 DEBUG [RS:1;jenkins-hbase4:33685] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-17 12:11:01,956 DEBUG [RS:1;jenkins-hbase4:33685] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-17 12:11:01,956 DEBUG [RS:1;jenkins-hbase4:33685] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-17 12:11:01,956 DEBUG [RS:1;jenkins-hbase4:33685] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-17 12:11:01,957 DEBUG [RS:1;jenkins-hbase4:33685] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-17 12:11:01,957 DEBUG [RS:1;jenkins-hbase4:33685] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-17 12:11:01,957 DEBUG [RS:1;jenkins-hbase4:33685] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-17 12:11:01,957 DEBUG [RS:1;jenkins-hbase4:33685] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-17 12:11:01,957 DEBUG [RS:1;jenkins-hbase4:33685] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-17 12:11:01,971 INFO [RS:1;jenkins-hbase4:33685] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-17 12:11:01,972 INFO [RS:1;jenkins-hbase4:33685] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-17 12:11:01,972 INFO [RS:1;jenkins-hbase4:33685] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-17 12:11:01,990 INFO [RS:2;jenkins-hbase4:42615] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-17 12:11:01,991 INFO [RS:2;jenkins-hbase4:42615] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-17 12:11:01,991 INFO [RS:2;jenkins-hbase4:42615] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-17 12:11:02,027 INFO [RS:2;jenkins-hbase4:42615] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-17 12:11:02,030 INFO [RS:2;jenkins-hbase4:42615] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42615,1689595859906-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-17 12:11:02,034 INFO [RS:0;jenkins-hbase4:39491] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-17 12:11:02,034 INFO [RS:0;jenkins-hbase4:39491] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-17 12:11:02,034 INFO [RS:0;jenkins-hbase4:39491] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-17 12:11:02,036 INFO [RS:1;jenkins-hbase4:33685] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-17 12:11:02,041 INFO [RS:1;jenkins-hbase4:33685] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,33685,1689595859854-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-17 12:11:02,061 INFO [RS:0;jenkins-hbase4:39491] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-17 12:11:02,061 INFO [RS:0;jenkins-hbase4:39491] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39491,1689595859788-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-17 12:11:02,068 INFO [RS:2;jenkins-hbase4:42615] regionserver.Replication(203): jenkins-hbase4.apache.org,42615,1689595859906 started 2023-07-17 12:11:02,068 INFO [RS:2;jenkins-hbase4:42615] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,42615,1689595859906, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:42615, sessionid=0x10173314c9f0003 2023-07-17 12:11:02,070 INFO [RS:1;jenkins-hbase4:33685] regionserver.Replication(203): jenkins-hbase4.apache.org,33685,1689595859854 started 2023-07-17 12:11:02,070 INFO [RS:1;jenkins-hbase4:33685] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,33685,1689595859854, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:33685, sessionid=0x10173314c9f0002 2023-07-17 12:11:02,070 DEBUG [RS:2;jenkins-hbase4:42615] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-17 12:11:02,070 DEBUG [RS:2;jenkins-hbase4:42615] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:11:02,070 DEBUG [RS:2;jenkins-hbase4:42615] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,42615,1689595859906' 2023-07-17 12:11:02,070 DEBUG [RS:2;jenkins-hbase4:42615] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-17 12:11:02,071 DEBUG [RS:1;jenkins-hbase4:33685] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-17 12:11:02,071 DEBUG [RS:1;jenkins-hbase4:33685] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:11:02,073 DEBUG [RS:1;jenkins-hbase4:33685] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,33685,1689595859854' 2023-07-17 12:11:02,074 DEBUG [RS:1;jenkins-hbase4:33685] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-17 12:11:02,075 DEBUG [RS:1;jenkins-hbase4:33685] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-17 12:11:02,076 DEBUG [RS:2;jenkins-hbase4:42615] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-17 12:11:02,077 DEBUG [RS:1;jenkins-hbase4:33685] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-17 12:11:02,077 DEBUG [RS:1;jenkins-hbase4:33685] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-17 12:11:02,077 DEBUG [RS:2;jenkins-hbase4:42615] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-17 12:11:02,077 DEBUG [RS:1;jenkins-hbase4:33685] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:11:02,077 DEBUG [RS:2;jenkins-hbase4:42615] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-17 12:11:02,077 DEBUG [RS:1;jenkins-hbase4:33685] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,33685,1689595859854' 2023-07-17 12:11:02,078 DEBUG [RS:1;jenkins-hbase4:33685] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 12:11:02,077 DEBUG [RS:2;jenkins-hbase4:42615] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:11:02,078 DEBUG [RS:2;jenkins-hbase4:42615] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,42615,1689595859906' 2023-07-17 12:11:02,078 DEBUG [RS:2;jenkins-hbase4:42615] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 12:11:02,080 DEBUG [RS:1;jenkins-hbase4:33685] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 12:11:02,080 DEBUG [RS:2;jenkins-hbase4:42615] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 12:11:02,081 DEBUG [RS:2;jenkins-hbase4:42615] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-17 12:11:02,081 DEBUG [RS:1;jenkins-hbase4:33685] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-17 12:11:02,081 INFO [RS:2;jenkins-hbase4:42615] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-17 12:11:02,081 INFO [RS:1;jenkins-hbase4:33685] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-17 12:11:02,081 INFO [RS:2;jenkins-hbase4:42615] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-17 12:11:02,081 INFO [RS:1;jenkins-hbase4:33685] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-17 12:11:02,086 INFO [RS:0;jenkins-hbase4:39491] regionserver.Replication(203): jenkins-hbase4.apache.org,39491,1689595859788 started 2023-07-17 12:11:02,087 INFO [RS:0;jenkins-hbase4:39491] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,39491,1689595859788, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:39491, sessionid=0x10173314c9f0001 2023-07-17 12:11:02,087 DEBUG [RS:0;jenkins-hbase4:39491] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-17 12:11:02,087 DEBUG [RS:0;jenkins-hbase4:39491] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:11:02,087 DEBUG [RS:0;jenkins-hbase4:39491] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,39491,1689595859788' 2023-07-17 12:11:02,087 DEBUG [RS:0;jenkins-hbase4:39491] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-17 12:11:02,087 DEBUG [RS:0;jenkins-hbase4:39491] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-17 12:11:02,088 DEBUG [RS:0;jenkins-hbase4:39491] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-17 12:11:02,088 DEBUG [RS:0;jenkins-hbase4:39491] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-17 12:11:02,088 DEBUG [RS:0;jenkins-hbase4:39491] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:11:02,088 DEBUG [RS:0;jenkins-hbase4:39491] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,39491,1689595859788' 2023-07-17 12:11:02,088 DEBUG [RS:0;jenkins-hbase4:39491] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 12:11:02,089 DEBUG [RS:0;jenkins-hbase4:39491] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 12:11:02,089 DEBUG [RS:0;jenkins-hbase4:39491] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-17 12:11:02,089 INFO [RS:0;jenkins-hbase4:39491] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-17 12:11:02,089 INFO [RS:0;jenkins-hbase4:39491] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-17 12:11:02,099 DEBUG [jenkins-hbase4:42013] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=3, allServersCount=3 2023-07-17 12:11:02,104 DEBUG [jenkins-hbase4:42013] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-17 12:11:02,110 DEBUG [jenkins-hbase4:42013] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-17 12:11:02,110 DEBUG [jenkins-hbase4:42013] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-17 12:11:02,110 DEBUG [jenkins-hbase4:42013] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-17 12:11:02,110 DEBUG [jenkins-hbase4:42013] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-17 12:11:02,113 INFO [PEWorker-4] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,33685,1689595859854, state=OPENING 2023-07-17 12:11:02,123 DEBUG [PEWorker-4] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-07-17 12:11:02,125 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-17 12:11:02,126 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-17 12:11:02,131 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,33685,1689595859854}] 2023-07-17 12:11:02,197 INFO [RS:0;jenkins-hbase4:39491] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C39491%2C1689595859788, suffix=, logDir=hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/WALs/jenkins-hbase4.apache.org,39491,1689595859788, archiveDir=hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/oldWALs, maxLogs=32 2023-07-17 12:11:02,198 INFO [RS:2;jenkins-hbase4:42615] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C42615%2C1689595859906, suffix=, logDir=hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/WALs/jenkins-hbase4.apache.org,42615,1689595859906, archiveDir=hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/oldWALs, maxLogs=32 2023-07-17 12:11:02,211 INFO [RS:1;jenkins-hbase4:33685] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C33685%2C1689595859854, suffix=, logDir=hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/WALs/jenkins-hbase4.apache.org,33685,1689595859854, archiveDir=hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/oldWALs, maxLogs=32 2023-07-17 12:11:02,239 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43171,DS-70b7bc44-5b5e-4204-8e22-f0a00e411686,DISK] 2023-07-17 12:11:02,240 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43297,DS-7e6b2104-ee4c-40ef-bfe6-d5f8ff15b245,DISK] 2023-07-17 12:11:02,240 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44977,DS-ea9fbb89-0ec4-40ed-aa76-05f274399e65,DISK] 2023-07-17 12:11:02,269 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44977,DS-ea9fbb89-0ec4-40ed-aa76-05f274399e65,DISK] 2023-07-17 12:11:02,269 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43171,DS-70b7bc44-5b5e-4204-8e22-f0a00e411686,DISK] 2023-07-17 12:11:02,270 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43297,DS-7e6b2104-ee4c-40ef-bfe6-d5f8ff15b245,DISK] 2023-07-17 12:11:02,291 INFO [RS:2;jenkins-hbase4:42615] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/WALs/jenkins-hbase4.apache.org,42615,1689595859906/jenkins-hbase4.apache.org%2C42615%2C1689595859906.1689595862204 2023-07-17 12:11:02,291 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43171,DS-70b7bc44-5b5e-4204-8e22-f0a00e411686,DISK] 2023-07-17 12:11:02,292 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44977,DS-ea9fbb89-0ec4-40ed-aa76-05f274399e65,DISK] 2023-07-17 12:11:02,292 DEBUG [RS:2;jenkins-hbase4:42615] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:43297,DS-7e6b2104-ee4c-40ef-bfe6-d5f8ff15b245,DISK], DatanodeInfoWithStorage[127.0.0.1:43171,DS-70b7bc44-5b5e-4204-8e22-f0a00e411686,DISK], DatanodeInfoWithStorage[127.0.0.1:44977,DS-ea9fbb89-0ec4-40ed-aa76-05f274399e65,DISK]] 2023-07-17 12:11:02,292 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43297,DS-7e6b2104-ee4c-40ef-bfe6-d5f8ff15b245,DISK] 2023-07-17 12:11:02,307 INFO [RS:1;jenkins-hbase4:33685] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/WALs/jenkins-hbase4.apache.org,33685,1689595859854/jenkins-hbase4.apache.org%2C33685%2C1689595859854.1689595862212 2023-07-17 12:11:02,308 DEBUG [RS:1;jenkins-hbase4:33685] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:43171,DS-70b7bc44-5b5e-4204-8e22-f0a00e411686,DISK], DatanodeInfoWithStorage[127.0.0.1:43297,DS-7e6b2104-ee4c-40ef-bfe6-d5f8ff15b245,DISK], DatanodeInfoWithStorage[127.0.0.1:44977,DS-ea9fbb89-0ec4-40ed-aa76-05f274399e65,DISK]] 2023-07-17 12:11:02,311 INFO [RS:0;jenkins-hbase4:39491] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/WALs/jenkins-hbase4.apache.org,39491,1689595859788/jenkins-hbase4.apache.org%2C39491%2C1689595859788.1689595862205 2023-07-17 12:11:02,314 DEBUG [RS:0;jenkins-hbase4:39491] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:44977,DS-ea9fbb89-0ec4-40ed-aa76-05f274399e65,DISK], DatanodeInfoWithStorage[127.0.0.1:43171,DS-70b7bc44-5b5e-4204-8e22-f0a00e411686,DISK], DatanodeInfoWithStorage[127.0.0.1:43297,DS-7e6b2104-ee4c-40ef-bfe6-d5f8ff15b245,DISK]] 2023-07-17 12:11:02,351 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:11:02,353 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-17 12:11:02,358 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52888, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-17 12:11:02,376 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-07-17 12:11:02,377 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-17 12:11:02,382 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C33685%2C1689595859854.meta, suffix=.meta, logDir=hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/WALs/jenkins-hbase4.apache.org,33685,1689595859854, archiveDir=hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/oldWALs, maxLogs=32 2023-07-17 12:11:02,405 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43171,DS-70b7bc44-5b5e-4204-8e22-f0a00e411686,DISK] 2023-07-17 12:11:02,412 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44977,DS-ea9fbb89-0ec4-40ed-aa76-05f274399e65,DISK] 2023-07-17 12:11:02,412 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43297,DS-7e6b2104-ee4c-40ef-bfe6-d5f8ff15b245,DISK] 2023-07-17 12:11:02,429 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/WALs/jenkins-hbase4.apache.org,33685,1689595859854/jenkins-hbase4.apache.org%2C33685%2C1689595859854.meta.1689595862383.meta 2023-07-17 12:11:02,431 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:43171,DS-70b7bc44-5b5e-4204-8e22-f0a00e411686,DISK], DatanodeInfoWithStorage[127.0.0.1:44977,DS-ea9fbb89-0ec4-40ed-aa76-05f274399e65,DISK], DatanodeInfoWithStorage[127.0.0.1:43297,DS-7e6b2104-ee4c-40ef-bfe6-d5f8ff15b245,DISK]] 2023-07-17 12:11:02,431 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-07-17 12:11:02,433 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=AccessControlService 2023-07-17 12:11:02,434 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-17 12:11:02,436 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-07-17 12:11:02,438 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-07-17 12:11:02,440 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-07-17 12:11:02,454 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-07-17 12:11:02,454 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 12:11:02,454 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-07-17 12:11:02,455 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-07-17 12:11:02,458 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-17 12:11:02,460 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/hbase/meta/1588230740/info 2023-07-17 12:11:02,461 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/hbase/meta/1588230740/info 2023-07-17 12:11:02,461 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-17 12:11:02,462 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-17 12:11:02,463 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-17 12:11:02,464 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/hbase/meta/1588230740/rep_barrier 2023-07-17 12:11:02,464 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/hbase/meta/1588230740/rep_barrier 2023-07-17 12:11:02,465 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-17 12:11:02,466 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-17 12:11:02,467 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-17 12:11:02,469 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/hbase/meta/1588230740/table 2023-07-17 12:11:02,469 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/hbase/meta/1588230740/table 2023-07-17 12:11:02,469 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-17 12:11:02,470 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-17 12:11:02,476 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/hbase/meta/1588230740 2023-07-17 12:11:02,480 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/hbase/meta/1588230740 2023-07-17 12:11:02,487 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-17 12:11:02,490 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-17 12:11:02,492 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61203993, jitterRate=-0.0879894345998764}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-17 12:11:02,496 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-17 12:11:02,509 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1689595862342 2023-07-17 12:11:02,528 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-07-17 12:11:02,529 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-07-17 12:11:02,529 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,33685,1689595859854, state=OPEN 2023-07-17 12:11:02,532 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-07-17 12:11:02,532 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-17 12:11:02,553 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-07-17 12:11:02,553 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,33685,1689595859854 in 401 msec 2023-07-17 12:11:02,570 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-07-17 12:11:02,570 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 664 msec 2023-07-17 12:11:02,580 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 1.0810 sec 2023-07-17 12:11:02,580 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1689595862580, completionTime=-1 2023-07-17 12:11:02,580 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=3; waited=0ms, expected min=3 server(s), max=3 server(s), master is running 2023-07-17 12:11:02,580 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-07-17 12:11:02,698 DEBUG [hconnection-0x1abcf153-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 12:11:02,702 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52894, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 12:11:02,731 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=3 2023-07-17 12:11:02,731 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1689595922731 2023-07-17 12:11:02,731 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1689595982731 2023-07-17 12:11:02,731 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 150 msec 2023-07-17 12:11:02,760 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42013,1689595858265-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-17 12:11:02,761 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42013,1689595858265-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-17 12:11:02,761 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42013,1689595858265-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-17 12:11:02,763 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:42013, period=300000, unit=MILLISECONDS is enabled. 2023-07-17 12:11:02,763 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-07-17 12:11:02,772 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-07-17 12:11:02,785 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-07-17 12:11:02,787 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-17 12:11:02,801 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-07-17 12:11:02,805 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-07-17 12:11:02,808 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-17 12:11:02,839 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.tmp/data/hbase/namespace/af4fd60aa1dd6d835445a6209c26cbfd 2023-07-17 12:11:02,841 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.tmp/data/hbase/namespace/af4fd60aa1dd6d835445a6209c26cbfd empty. 2023-07-17 12:11:02,842 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.tmp/data/hbase/namespace/af4fd60aa1dd6d835445a6209c26cbfd 2023-07-17 12:11:02,843 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-07-17 12:11:02,904 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-07-17 12:11:02,906 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => af4fd60aa1dd6d835445a6209c26cbfd, NAME => 'hbase:namespace,,1689595862786.af4fd60aa1dd6d835445a6209c26cbfd.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.tmp 2023-07-17 12:11:02,934 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689595862786.af4fd60aa1dd6d835445a6209c26cbfd.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 12:11:02,934 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing af4fd60aa1dd6d835445a6209c26cbfd, disabling compactions & flushes 2023-07-17 12:11:02,934 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689595862786.af4fd60aa1dd6d835445a6209c26cbfd. 2023-07-17 12:11:02,934 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689595862786.af4fd60aa1dd6d835445a6209c26cbfd. 2023-07-17 12:11:02,934 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689595862786.af4fd60aa1dd6d835445a6209c26cbfd. after waiting 0 ms 2023-07-17 12:11:02,934 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689595862786.af4fd60aa1dd6d835445a6209c26cbfd. 2023-07-17 12:11:02,934 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689595862786.af4fd60aa1dd6d835445a6209c26cbfd. 2023-07-17 12:11:02,934 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for af4fd60aa1dd6d835445a6209c26cbfd: 2023-07-17 12:11:02,941 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-07-17 12:11:02,958 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1689595862786.af4fd60aa1dd6d835445a6209c26cbfd.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689595862945"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689595862945"}]},"ts":"1689595862945"} 2023-07-17 12:11:02,988 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-17 12:11:02,990 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-17 12:11:02,994 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689595862990"}]},"ts":"1689595862990"} 2023-07-17 12:11:02,999 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-07-17 12:11:03,003 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-17 12:11:03,005 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-17 12:11:03,006 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-17 12:11:03,006 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-17 12:11:03,006 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-17 12:11:03,009 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=af4fd60aa1dd6d835445a6209c26cbfd, ASSIGN}] 2023-07-17 12:11:03,014 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=af4fd60aa1dd6d835445a6209c26cbfd, ASSIGN 2023-07-17 12:11:03,016 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=af4fd60aa1dd6d835445a6209c26cbfd, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39491,1689595859788; forceNewPlan=false, retain=false 2023-07-17 12:11:03,169 INFO [jenkins-hbase4:42013] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-17 12:11:03,172 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=af4fd60aa1dd6d835445a6209c26cbfd, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:11:03,173 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1689595862786.af4fd60aa1dd6d835445a6209c26cbfd.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689595863170"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689595863170"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689595863170"}]},"ts":"1689595863170"} 2023-07-17 12:11:03,180 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure af4fd60aa1dd6d835445a6209c26cbfd, server=jenkins-hbase4.apache.org,39491,1689595859788}] 2023-07-17 12:11:03,342 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:11:03,342 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-17 12:11:03,346 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42838, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-17 12:11:03,357 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1689595862786.af4fd60aa1dd6d835445a6209c26cbfd. 2023-07-17 12:11:03,358 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => af4fd60aa1dd6d835445a6209c26cbfd, NAME => 'hbase:namespace,,1689595862786.af4fd60aa1dd6d835445a6209c26cbfd.', STARTKEY => '', ENDKEY => ''} 2023-07-17 12:11:03,358 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:namespace,,1689595862786.af4fd60aa1dd6d835445a6209c26cbfd. service=AccessControlService 2023-07-17 12:11:03,359 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-17 12:11:03,360 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace af4fd60aa1dd6d835445a6209c26cbfd 2023-07-17 12:11:03,360 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689595862786.af4fd60aa1dd6d835445a6209c26cbfd.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 12:11:03,360 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for af4fd60aa1dd6d835445a6209c26cbfd 2023-07-17 12:11:03,360 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for af4fd60aa1dd6d835445a6209c26cbfd 2023-07-17 12:11:03,363 INFO [StoreOpener-af4fd60aa1dd6d835445a6209c26cbfd-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region af4fd60aa1dd6d835445a6209c26cbfd 2023-07-17 12:11:03,365 DEBUG [StoreOpener-af4fd60aa1dd6d835445a6209c26cbfd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/hbase/namespace/af4fd60aa1dd6d835445a6209c26cbfd/info 2023-07-17 12:11:03,365 DEBUG [StoreOpener-af4fd60aa1dd6d835445a6209c26cbfd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/hbase/namespace/af4fd60aa1dd6d835445a6209c26cbfd/info 2023-07-17 12:11:03,366 INFO [StoreOpener-af4fd60aa1dd6d835445a6209c26cbfd-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region af4fd60aa1dd6d835445a6209c26cbfd columnFamilyName info 2023-07-17 12:11:03,367 INFO [StoreOpener-af4fd60aa1dd6d835445a6209c26cbfd-1] regionserver.HStore(310): Store=af4fd60aa1dd6d835445a6209c26cbfd/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-17 12:11:03,369 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/hbase/namespace/af4fd60aa1dd6d835445a6209c26cbfd 2023-07-17 12:11:03,372 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/hbase/namespace/af4fd60aa1dd6d835445a6209c26cbfd 2023-07-17 12:11:03,377 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for af4fd60aa1dd6d835445a6209c26cbfd 2023-07-17 12:11:03,385 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/hbase/namespace/af4fd60aa1dd6d835445a6209c26cbfd/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-17 12:11:03,386 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened af4fd60aa1dd6d835445a6209c26cbfd; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67258582, jitterRate=0.0022309720516204834}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-17 12:11:03,386 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for af4fd60aa1dd6d835445a6209c26cbfd: 2023-07-17 12:11:03,389 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1689595862786.af4fd60aa1dd6d835445a6209c26cbfd., pid=6, masterSystemTime=1689595863342 2023-07-17 12:11:03,394 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1689595862786.af4fd60aa1dd6d835445a6209c26cbfd. 2023-07-17 12:11:03,395 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1689595862786.af4fd60aa1dd6d835445a6209c26cbfd. 2023-07-17 12:11:03,397 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=af4fd60aa1dd6d835445a6209c26cbfd, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:11:03,397 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1689595862786.af4fd60aa1dd6d835445a6209c26cbfd.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689595863396"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689595863396"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689595863396"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689595863396"}]},"ts":"1689595863396"} 2023-07-17 12:11:03,409 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-07-17 12:11:03,409 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure af4fd60aa1dd6d835445a6209c26cbfd, server=jenkins-hbase4.apache.org,39491,1689595859788 in 224 msec 2023-07-17 12:11:03,414 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-07-17 12:11:03,416 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=af4fd60aa1dd6d835445a6209c26cbfd, ASSIGN in 400 msec 2023-07-17 12:11:03,417 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-17 12:11:03,418 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689595863417"}]},"ts":"1689595863417"} 2023-07-17 12:11:03,420 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-07-17 12:11:03,425 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-07-17 12:11:03,429 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 637 msec 2023-07-17 12:11:03,504 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-07-17 12:11:03,506 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-07-17 12:11:03,506 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-17 12:11:03,531 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 12:11:03,540 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42840, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 12:11:03,559 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-07-17 12:11:03,581 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-17 12:11:03,590 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 40 msec 2023-07-17 12:11:03,606 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-07-17 12:11:03,628 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-17 12:11:03,636 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 32 msec 2023-07-17 12:11:03,645 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-07-17 12:11:03,648 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-07-17 12:11:03,648 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 3.649sec 2023-07-17 12:11:03,653 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-07-17 12:11:03,655 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-07-17 12:11:03,656 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-07-17 12:11:03,657 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42013,1689595858265-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-07-17 12:11:03,658 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42013,1689595858265-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-07-17 12:11:03,681 DEBUG [Listener at localhost/44083] zookeeper.ReadOnlyZKClient(139): Connect 0x33afdcd8 to 127.0.0.1:55622 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-17 12:11:03,691 DEBUG [Listener at localhost/44083] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@116d792b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-17 12:11:03,696 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster$4(2112): Client=null/null create 'hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-17 12:11:03,700 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:acl 2023-07-17 12:11:03,704 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_PRE_OPERATION 2023-07-17 12:11:03,707 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-17 12:11:03,711 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(700): Client=null/null procedure request for creating table: namespace: "hbase" qualifier: "acl" procId is: 9 2023-07-17 12:11:03,711 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.tmp/data/hbase/acl/81856128cd0e8d95ff069a63b0ef1b04 2023-07-17 12:11:03,712 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.tmp/data/hbase/acl/81856128cd0e8d95ff069a63b0ef1b04 empty. 2023-07-17 12:11:03,719 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.tmp/data/hbase/acl/81856128cd0e8d95ff069a63b0ef1b04 2023-07-17 12:11:03,719 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived hbase:acl regions 2023-07-17 12:11:03,725 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-17 12:11:03,725 DEBUG [hconnection-0x14eacf93-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 12:11:03,747 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52902, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 12:11:03,750 INFO [Listener at localhost/44083] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,42013,1689595858265 2023-07-17 12:11:03,750 INFO [Listener at localhost/44083] hbase.HBaseTestingUtility(2699): Starting mini mapreduce cluster... 2023-07-17 12:11:03,751 INFO [Listener at localhost/44083] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58af5705-0594-af5f-981c-fa1d3b267fab/test.cache.data in system properties and HBase conf 2023-07-17 12:11:03,751 INFO [Listener at localhost/44083] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58af5705-0594-af5f-981c-fa1d3b267fab/hadoop.tmp.dir in system properties and HBase conf 2023-07-17 12:11:03,751 INFO [Listener at localhost/44083] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58af5705-0594-af5f-981c-fa1d3b267fab/hadoop.log.dir in system properties and HBase conf 2023-07-17 12:11:03,751 INFO [Listener at localhost/44083] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58af5705-0594-af5f-981c-fa1d3b267fab/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-17 12:11:03,751 INFO [Listener at localhost/44083] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58af5705-0594-af5f-981c-fa1d3b267fab/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-17 12:11:03,751 INFO [Listener at localhost/44083] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-17 12:11:03,751 INFO [Listener at localhost/44083] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58af5705-0594-af5f-981c-fa1d3b267fab/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-17 12:11:03,751 INFO [Listener at localhost/44083] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58af5705-0594-af5f-981c-fa1d3b267fab/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-17 12:11:03,751 INFO [Listener at localhost/44083] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58af5705-0594-af5f-981c-fa1d3b267fab/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-17 12:11:03,752 INFO [Listener at localhost/44083] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58af5705-0594-af5f-981c-fa1d3b267fab/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-17 12:11:03,752 INFO [Listener at localhost/44083] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58af5705-0594-af5f-981c-fa1d3b267fab/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-17 12:11:03,752 INFO [Listener at localhost/44083] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58af5705-0594-af5f-981c-fa1d3b267fab/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-17 12:11:03,752 INFO [Listener at localhost/44083] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58af5705-0594-af5f-981c-fa1d3b267fab/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-17 12:11:03,752 INFO [Listener at localhost/44083] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58af5705-0594-af5f-981c-fa1d3b267fab/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-17 12:11:03,752 INFO [Listener at localhost/44083] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58af5705-0594-af5f-981c-fa1d3b267fab/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-17 12:11:03,752 INFO [Listener at localhost/44083] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58af5705-0594-af5f-981c-fa1d3b267fab/nfs.dump.dir in system properties and HBase conf 2023-07-17 12:11:03,752 INFO [Listener at localhost/44083] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58af5705-0594-af5f-981c-fa1d3b267fab/java.io.tmpdir in system properties and HBase conf 2023-07-17 12:11:03,752 INFO [Listener at localhost/44083] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58af5705-0594-af5f-981c-fa1d3b267fab/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-17 12:11:03,752 INFO [Listener at localhost/44083] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58af5705-0594-af5f-981c-fa1d3b267fab/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-17 12:11:03,752 INFO [Listener at localhost/44083] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58af5705-0594-af5f-981c-fa1d3b267fab/fs.s3a.committer.staging.tmp.path in system properties and HBase conf 2023-07-17 12:11:03,755 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.tmp/data/hbase/acl/.tabledesc/.tableinfo.0000000001 2023-07-17 12:11:03,757 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(7675): creating {ENCODED => 81856128cd0e8d95ff069a63b0ef1b04, NAME => 'hbase:acl,,1689595863681.81856128cd0e8d95ff069a63b0ef1b04.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.tmp 2023-07-17 12:11:03,831 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-17 12:11:03,831 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(866): Instantiated hbase:acl,,1689595863681.81856128cd0e8d95ff069a63b0ef1b04.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 12:11:03,832 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1604): Closing 81856128cd0e8d95ff069a63b0ef1b04, disabling compactions & flushes 2023-07-17 12:11:03,832 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1626): Closing region hbase:acl,,1689595863681.81856128cd0e8d95ff069a63b0ef1b04. 2023-07-17 12:11:03,832 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1689595863681.81856128cd0e8d95ff069a63b0ef1b04. 2023-07-17 12:11:03,832 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1689595863681.81856128cd0e8d95ff069a63b0ef1b04. after waiting 0 ms 2023-07-17 12:11:03,832 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1689595863681.81856128cd0e8d95ff069a63b0ef1b04. 2023-07-17 12:11:03,832 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1838): Closed hbase:acl,,1689595863681.81856128cd0e8d95ff069a63b0ef1b04. 2023-07-17 12:11:03,832 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1558): Region close journal for 81856128cd0e8d95ff069a63b0ef1b04: 2023-07-17 12:11:03,839 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ADD_TO_META 2023-07-17 12:11:03,840 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:acl,,1689595863681.81856128cd0e8d95ff069a63b0ef1b04.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689595863840"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689595863840"}]},"ts":"1689595863840"} 2023-07-17 12:11:03,845 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-17 12:11:03,850 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-17 12:11:03,851 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689595863850"}]},"ts":"1689595863850"} 2023-07-17 12:11:03,854 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLING in hbase:meta 2023-07-17 12:11:03,860 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-17 12:11:03,862 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-17 12:11:03,862 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-17 12:11:03,863 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-17 12:11:03,863 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-17 12:11:03,864 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=81856128cd0e8d95ff069a63b0ef1b04, ASSIGN}] 2023-07-17 12:11:03,874 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=81856128cd0e8d95ff069a63b0ef1b04, ASSIGN 2023-07-17 12:11:03,876 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:acl, region=81856128cd0e8d95ff069a63b0ef1b04, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39491,1689595859788; forceNewPlan=false, retain=false 2023-07-17 12:11:04,026 INFO [jenkins-hbase4:42013] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-17 12:11:04,027 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=81856128cd0e8d95ff069a63b0ef1b04, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:11:04,027 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:acl,,1689595863681.81856128cd0e8d95ff069a63b0ef1b04.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689595864027"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689595864027"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689595864027"}]},"ts":"1689595864027"} 2023-07-17 12:11:04,031 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure 81856128cd0e8d95ff069a63b0ef1b04, server=jenkins-hbase4.apache.org,39491,1689595859788}] 2023-07-17 12:11:04,032 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-17 12:11:04,192 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:acl,,1689595863681.81856128cd0e8d95ff069a63b0ef1b04. 2023-07-17 12:11:04,192 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 81856128cd0e8d95ff069a63b0ef1b04, NAME => 'hbase:acl,,1689595863681.81856128cd0e8d95ff069a63b0ef1b04.', STARTKEY => '', ENDKEY => ''} 2023-07-17 12:11:04,193 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:acl,,1689595863681.81856128cd0e8d95ff069a63b0ef1b04. service=AccessControlService 2023-07-17 12:11:04,193 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-17 12:11:04,193 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table acl 81856128cd0e8d95ff069a63b0ef1b04 2023-07-17 12:11:04,193 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:acl,,1689595863681.81856128cd0e8d95ff069a63b0ef1b04.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 12:11:04,193 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 81856128cd0e8d95ff069a63b0ef1b04 2023-07-17 12:11:04,193 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 81856128cd0e8d95ff069a63b0ef1b04 2023-07-17 12:11:04,196 INFO [StoreOpener-81856128cd0e8d95ff069a63b0ef1b04-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family l of region 81856128cd0e8d95ff069a63b0ef1b04 2023-07-17 12:11:04,198 DEBUG [StoreOpener-81856128cd0e8d95ff069a63b0ef1b04-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/hbase/acl/81856128cd0e8d95ff069a63b0ef1b04/l 2023-07-17 12:11:04,198 DEBUG [StoreOpener-81856128cd0e8d95ff069a63b0ef1b04-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/hbase/acl/81856128cd0e8d95ff069a63b0ef1b04/l 2023-07-17 12:11:04,199 INFO [StoreOpener-81856128cd0e8d95ff069a63b0ef1b04-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 81856128cd0e8d95ff069a63b0ef1b04 columnFamilyName l 2023-07-17 12:11:04,200 INFO [StoreOpener-81856128cd0e8d95ff069a63b0ef1b04-1] regionserver.HStore(310): Store=81856128cd0e8d95ff069a63b0ef1b04/l, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-17 12:11:04,207 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/hbase/acl/81856128cd0e8d95ff069a63b0ef1b04 2023-07-17 12:11:04,209 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/hbase/acl/81856128cd0e8d95ff069a63b0ef1b04 2023-07-17 12:11:04,215 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 81856128cd0e8d95ff069a63b0ef1b04 2023-07-17 12:11:04,220 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/hbase/acl/81856128cd0e8d95ff069a63b0ef1b04/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-17 12:11:04,221 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 81856128cd0e8d95ff069a63b0ef1b04; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67906277, jitterRate=0.011882379651069641}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-17 12:11:04,221 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 81856128cd0e8d95ff069a63b0ef1b04: 2023-07-17 12:11:04,223 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:acl,,1689595863681.81856128cd0e8d95ff069a63b0ef1b04., pid=11, masterSystemTime=1689595864186 2023-07-17 12:11:04,231 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:acl,,1689595863681.81856128cd0e8d95ff069a63b0ef1b04. 2023-07-17 12:11:04,232 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:acl,,1689595863681.81856128cd0e8d95ff069a63b0ef1b04. 2023-07-17 12:11:04,233 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=81856128cd0e8d95ff069a63b0ef1b04, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:11:04,234 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:acl,,1689595863681.81856128cd0e8d95ff069a63b0ef1b04.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689595864233"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689595864233"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689595864233"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689595864233"}]},"ts":"1689595864233"} 2023-07-17 12:11:04,241 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-07-17 12:11:04,242 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure 81856128cd0e8d95ff069a63b0ef1b04, server=jenkins-hbase4.apache.org,39491,1689595859788 in 206 msec 2023-07-17 12:11:04,245 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=10, resume processing ppid=9 2023-07-17 12:11:04,246 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=hbase:acl, region=81856128cd0e8d95ff069a63b0ef1b04, ASSIGN in 377 msec 2023-07-17 12:11:04,248 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-17 12:11:04,248 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689595864248"}]},"ts":"1689595864248"} 2023-07-17 12:11:04,251 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLED in hbase:meta 2023-07-17 12:11:04,255 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_POST_OPERATION 2023-07-17 12:11:04,260 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=9, state=SUCCESS; CreateTableProcedure table=hbase:acl in 559 msec 2023-07-17 12:11:04,332 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-17 12:11:04,332 INFO [master/jenkins-hbase4:0:becomeActiveMaster] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: hbase:acl, procId: 9 completed 2023-07-17 12:11:04,343 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-07-17 12:11:05,062 WARN [Thread-383] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-17 12:11:05,389 INFO [Thread-383] log.Slf4jLog(67): jetty-6.1.26 2023-07-17 12:11:05,395 INFO [Thread-383] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/jobhistory to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58af5705-0594-af5f-981c-fa1d3b267fab/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_44991_jobhistory____.48ji86/webapp 2023-07-17 12:11:05,559 INFO [Thread-383] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices as a root resource class 2023-07-17 12:11:05,560 INFO [Thread-383] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver as a provider class 2023-07-17 12:11:05,560 INFO [Thread-383] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-17 12:11:05,562 INFO [Thread-383] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-17 12:11:05,639 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-17 12:11:05,927 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-17 12:11:06,327 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices to GuiceManagedComponentProvider with the scope "PerRequest" 2023-07-17 12:11:06,374 INFO [Thread-383] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:44991 2023-07-17 12:11:06,566 WARN [Listener at jenkins-hbase4.apache.org/45711] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-17 12:11:07,043 WARN [Listener at jenkins-hbase4.apache.org/45711] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-17 12:11:07,044 INFO [Listener at jenkins-hbase4.apache.org/45711] log.Slf4jLog(67): jetty-6.1.26 2023-07-17 12:11:07,053 INFO [Listener at jenkins-hbase4.apache.org/45711] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/cluster to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58af5705-0594-af5f-981c-fa1d3b267fab/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_41619_cluster____r01kn7/webapp 2023-07-17 12:11:07,136 INFO [Listener at jenkins-hbase4.apache.org/45711] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver as a provider class 2023-07-17 12:11:07,136 INFO [Listener at jenkins-hbase4.apache.org/45711] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices as a root resource class 2023-07-17 12:11:07,136 INFO [Listener at jenkins-hbase4.apache.org/45711] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-17 12:11:07,137 INFO [Listener at jenkins-hbase4.apache.org/45711] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-17 12:11:07,149 INFO [Listener at jenkins-hbase4.apache.org/45711] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-17 12:11:07,520 INFO [Listener at jenkins-hbase4.apache.org/45711] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-17 12:11:07,768 INFO [Listener at jenkins-hbase4.apache.org/45711] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-17 12:11:07,777 INFO [Listener at jenkins-hbase4.apache.org/45711] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:41619 2023-07-17 12:11:08,150 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-17 12:11:08,316 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-07-17 12:11:08,318 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-07-17 12:11:08,319 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:acl' 2023-07-17 12:11:08,448 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-17 12:11:08,449 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionServerObservers 2023-07-17 12:11:08,449 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-17 12:11:08,449 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase MasterObservers 2023-07-17 12:11:08,449 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-17 12:11:08,449 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver Metrics about HBase MasterObservers 2023-07-17 12:11:08,450 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-17 12:11:08,450 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionObservers 2023-07-17 12:11:08,450 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-17 12:11:08,450 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-07-17 12:11:08,603 WARN [Listener at jenkins-hbase4.apache.org/37415] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-17 12:11:08,629 WARN [Listener at jenkins-hbase4.apache.org/37415] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-17 12:11:08,630 INFO [Listener at jenkins-hbase4.apache.org/37415] log.Slf4jLog(67): jetty-6.1.26 2023-07-17 12:11:08,637 INFO [Listener at jenkins-hbase4.apache.org/37415] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58af5705-0594-af5f-981c-fa1d3b267fab/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_34345_node____lprx9t/webapp 2023-07-17 12:11:08,699 INFO [Listener at jenkins-hbase4.apache.org/37415] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-07-17 12:11:08,700 INFO [Listener at jenkins-hbase4.apache.org/37415] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-17 12:11:08,700 INFO [Listener at jenkins-hbase4.apache.org/37415] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-07-17 12:11:08,700 INFO [Listener at jenkins-hbase4.apache.org/37415] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-17 12:11:08,711 INFO [Listener at jenkins-hbase4.apache.org/37415] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-17 12:11:08,731 INFO [Listener at jenkins-hbase4.apache.org/37415] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-17 12:11:08,811 INFO [Listener at jenkins-hbase4.apache.org/37415] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-17 12:11:08,820 INFO [Listener at jenkins-hbase4.apache.org/37415] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:34345 2023-07-17 12:11:09,007 WARN [Listener at jenkins-hbase4.apache.org/44127] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-17 12:11:09,014 WARN [Listener at jenkins-hbase4.apache.org/44127] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-17 12:11:09,014 INFO [Listener at jenkins-hbase4.apache.org/44127] log.Slf4jLog(67): jetty-6.1.26 2023-07-17 12:11:09,021 INFO [Listener at jenkins-hbase4.apache.org/44127] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58af5705-0594-af5f-981c-fa1d3b267fab/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_45043_node____pvim6k/webapp 2023-07-17 12:11:09,080 INFO [Listener at jenkins-hbase4.apache.org/44127] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-07-17 12:11:09,081 INFO [Listener at jenkins-hbase4.apache.org/44127] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-17 12:11:09,081 INFO [Listener at jenkins-hbase4.apache.org/44127] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-07-17 12:11:09,081 INFO [Listener at jenkins-hbase4.apache.org/44127] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-17 12:11:09,088 INFO [Listener at jenkins-hbase4.apache.org/44127] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-17 12:11:09,104 INFO [Listener at jenkins-hbase4.apache.org/44127] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-17 12:11:09,189 INFO [Listener at jenkins-hbase4.apache.org/44127] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-17 12:11:09,196 INFO [Listener at jenkins-hbase4.apache.org/44127] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:45043 2023-07-17 12:11:09,226 INFO [Listener at jenkins-hbase4.apache.org/44127] hbase.HBaseTestingUtility(2726): Mini mapreduce cluster started 2023-07-17 12:11:09,228 INFO [Listener at jenkins-hbase4.apache.org/44127] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2023-07-17 12:11:09,311 INFO [Listener at jenkins-hbase4.apache.org/44127] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=704, OpenFileDescriptor=913, MaxFileDescriptor=60000, SystemLoadAverage=403, ProcessCount=174, AvailableMemoryMB=4913 2023-07-17 12:11:09,311 WARN [Listener at jenkins-hbase4.apache.org/44127] hbase.ResourceChecker(130): Thread=704 is superior to 500 2023-07-17 12:11:09,327 DEBUG [Listener at jenkins-hbase4.apache.org/44127] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-17 12:11:09,335 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39624, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-07-17 12:11:09,343 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42013] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-17 12:11:09,349 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42013] procedure2.ProcedureExecutor(1029): Stored pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportWithTargetName 2023-07-17 12:11:09,352 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_PRE_OPERATION 2023-07-17 12:11:09,353 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42013] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportWithTargetName" procId is: 12 2023-07-17 12:11:09,355 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42013] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-17 12:11:09,358 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-17 12:11:09,363 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.tmp/data/default/testtb-testExportWithTargetName/5db0803f609624bbe92bd4b0a80c58bd 2023-07-17 12:11:09,364 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.tmp/data/default/testtb-testExportWithTargetName/9b743b0f32a0fb2da34db5cb35625561 2023-07-17 12:11:09,365 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.tmp/data/default/testtb-testExportWithTargetName/9b743b0f32a0fb2da34db5cb35625561 empty. 2023-07-17 12:11:09,366 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.tmp/data/default/testtb-testExportWithTargetName/5db0803f609624bbe92bd4b0a80c58bd empty. 2023-07-17 12:11:09,367 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.tmp/data/default/testtb-testExportWithTargetName/9b743b0f32a0fb2da34db5cb35625561 2023-07-17 12:11:09,369 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.tmp/data/default/testtb-testExportWithTargetName/5db0803f609624bbe92bd4b0a80c58bd 2023-07-17 12:11:09,370 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-07-17 12:11:09,405 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.tmp/data/default/testtb-testExportWithTargetName/.tabledesc/.tableinfo.0000000001 2023-07-17 12:11:09,407 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(7675): creating {ENCODED => 5db0803f609624bbe92bd4b0a80c58bd, NAME => 'testtb-testExportWithTargetName,,1689595869343.5db0803f609624bbe92bd4b0a80c58bd.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.tmp 2023-07-17 12:11:09,407 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(7675): creating {ENCODED => 9b743b0f32a0fb2da34db5cb35625561, NAME => 'testtb-testExportWithTargetName,1,1689595869343.9b743b0f32a0fb2da34db5cb35625561.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.tmp 2023-07-17 12:11:09,440 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1689595869343.9b743b0f32a0fb2da34db5cb35625561.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 12:11:09,441 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1604): Closing 9b743b0f32a0fb2da34db5cb35625561, disabling compactions & flushes 2023-07-17 12:11:09,441 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1689595869343.9b743b0f32a0fb2da34db5cb35625561. 2023-07-17 12:11:09,441 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1689595869343.9b743b0f32a0fb2da34db5cb35625561. 2023-07-17 12:11:09,441 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1689595869343.9b743b0f32a0fb2da34db5cb35625561. after waiting 0 ms 2023-07-17 12:11:09,441 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1689595869343.9b743b0f32a0fb2da34db5cb35625561. 2023-07-17 12:11:09,441 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1689595869343.9b743b0f32a0fb2da34db5cb35625561. 2023-07-17 12:11:09,441 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1558): Region close journal for 9b743b0f32a0fb2da34db5cb35625561: 2023-07-17 12:11:09,441 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1689595869343.5db0803f609624bbe92bd4b0a80c58bd.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 12:11:09,442 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1604): Closing 5db0803f609624bbe92bd4b0a80c58bd, disabling compactions & flushes 2023-07-17 12:11:09,442 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1689595869343.5db0803f609624bbe92bd4b0a80c58bd. 2023-07-17 12:11:09,442 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1689595869343.5db0803f609624bbe92bd4b0a80c58bd. 2023-07-17 12:11:09,442 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1689595869343.5db0803f609624bbe92bd4b0a80c58bd. after waiting 0 ms 2023-07-17 12:11:09,442 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1689595869343.5db0803f609624bbe92bd4b0a80c58bd. 2023-07-17 12:11:09,442 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1689595869343.5db0803f609624bbe92bd4b0a80c58bd. 2023-07-17 12:11:09,442 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1558): Region close journal for 5db0803f609624bbe92bd4b0a80c58bd: 2023-07-17 12:11:09,453 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ADD_TO_META 2023-07-17 12:11:09,454 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1689595869343.9b743b0f32a0fb2da34db5cb35625561.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689595869454"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689595869454"}]},"ts":"1689595869454"} 2023-07-17 12:11:09,455 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1689595869343.5db0803f609624bbe92bd4b0a80c58bd.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689595869454"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689595869454"}]},"ts":"1689595869454"} 2023-07-17 12:11:09,457 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42013] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-17 12:11:09,510 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-17 12:11:09,511 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-17 12:11:09,512 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689595869512"}]},"ts":"1689595869512"} 2023-07-17 12:11:09,514 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLING in hbase:meta 2023-07-17 12:11:09,519 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-17 12:11:09,521 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-17 12:11:09,521 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-17 12:11:09,521 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-17 12:11:09,521 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-17 12:11:09,522 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=5db0803f609624bbe92bd4b0a80c58bd, ASSIGN}, {pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=9b743b0f32a0fb2da34db5cb35625561, ASSIGN}] 2023-07-17 12:11:09,525 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=9b743b0f32a0fb2da34db5cb35625561, ASSIGN 2023-07-17 12:11:09,525 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=5db0803f609624bbe92bd4b0a80c58bd, ASSIGN 2023-07-17 12:11:09,526 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=5db0803f609624bbe92bd4b0a80c58bd, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39491,1689595859788; forceNewPlan=false, retain=false 2023-07-17 12:11:09,526 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=9b743b0f32a0fb2da34db5cb35625561, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33685,1689595859854; forceNewPlan=false, retain=false 2023-07-17 12:11:09,659 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42013] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-17 12:11:09,676 INFO [jenkins-hbase4:42013] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-17 12:11:09,678 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=9b743b0f32a0fb2da34db5cb35625561, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:11:09,678 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=5db0803f609624bbe92bd4b0a80c58bd, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:11:09,679 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1689595869343.9b743b0f32a0fb2da34db5cb35625561.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689595869678"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689595869678"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689595869678"}]},"ts":"1689595869678"} 2023-07-17 12:11:09,679 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1689595869343.5db0803f609624bbe92bd4b0a80c58bd.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689595869678"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689595869678"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689595869678"}]},"ts":"1689595869678"} 2023-07-17 12:11:09,681 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=15, ppid=14, state=RUNNABLE; OpenRegionProcedure 9b743b0f32a0fb2da34db5cb35625561, server=jenkins-hbase4.apache.org,33685,1689595859854}] 2023-07-17 12:11:09,683 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=13, state=RUNNABLE; OpenRegionProcedure 5db0803f609624bbe92bd4b0a80c58bd, server=jenkins-hbase4.apache.org,39491,1689595859788}] 2023-07-17 12:11:09,851 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,1,1689595869343.9b743b0f32a0fb2da34db5cb35625561. 2023-07-17 12:11:09,851 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 9b743b0f32a0fb2da34db5cb35625561, NAME => 'testtb-testExportWithTargetName,1,1689595869343.9b743b0f32a0fb2da34db5cb35625561.', STARTKEY => '1', ENDKEY => ''} 2023-07-17 12:11:09,852 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,1,1689595869343.9b743b0f32a0fb2da34db5cb35625561. service=AccessControlService 2023-07-17 12:11:09,852 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-17 12:11:09,852 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName 9b743b0f32a0fb2da34db5cb35625561 2023-07-17 12:11:09,852 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1689595869343.9b743b0f32a0fb2da34db5cb35625561.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 12:11:09,852 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 9b743b0f32a0fb2da34db5cb35625561 2023-07-17 12:11:09,853 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 9b743b0f32a0fb2da34db5cb35625561 2023-07-17 12:11:09,859 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,,1689595869343.5db0803f609624bbe92bd4b0a80c58bd. 2023-07-17 12:11:09,859 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 5db0803f609624bbe92bd4b0a80c58bd, NAME => 'testtb-testExportWithTargetName,,1689595869343.5db0803f609624bbe92bd4b0a80c58bd.', STARTKEY => '', ENDKEY => '1'} 2023-07-17 12:11:09,860 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,,1689595869343.5db0803f609624bbe92bd4b0a80c58bd. service=AccessControlService 2023-07-17 12:11:09,860 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-17 12:11:09,860 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName 5db0803f609624bbe92bd4b0a80c58bd 2023-07-17 12:11:09,860 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1689595869343.5db0803f609624bbe92bd4b0a80c58bd.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 12:11:09,860 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 5db0803f609624bbe92bd4b0a80c58bd 2023-07-17 12:11:09,860 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 5db0803f609624bbe92bd4b0a80c58bd 2023-07-17 12:11:09,862 INFO [StoreOpener-9b743b0f32a0fb2da34db5cb35625561-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 9b743b0f32a0fb2da34db5cb35625561 2023-07-17 12:11:09,862 INFO [StoreOpener-5db0803f609624bbe92bd4b0a80c58bd-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 5db0803f609624bbe92bd4b0a80c58bd 2023-07-17 12:11:09,865 DEBUG [StoreOpener-5db0803f609624bbe92bd4b0a80c58bd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/default/testtb-testExportWithTargetName/5db0803f609624bbe92bd4b0a80c58bd/cf 2023-07-17 12:11:09,865 DEBUG [StoreOpener-5db0803f609624bbe92bd4b0a80c58bd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/default/testtb-testExportWithTargetName/5db0803f609624bbe92bd4b0a80c58bd/cf 2023-07-17 12:11:09,865 DEBUG [StoreOpener-9b743b0f32a0fb2da34db5cb35625561-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/default/testtb-testExportWithTargetName/9b743b0f32a0fb2da34db5cb35625561/cf 2023-07-17 12:11:09,866 DEBUG [StoreOpener-9b743b0f32a0fb2da34db5cb35625561-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/default/testtb-testExportWithTargetName/9b743b0f32a0fb2da34db5cb35625561/cf 2023-07-17 12:11:09,870 INFO [StoreOpener-9b743b0f32a0fb2da34db5cb35625561-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9b743b0f32a0fb2da34db5cb35625561 columnFamilyName cf 2023-07-17 12:11:09,870 INFO [StoreOpener-5db0803f609624bbe92bd4b0a80c58bd-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5db0803f609624bbe92bd4b0a80c58bd columnFamilyName cf 2023-07-17 12:11:09,874 INFO [StoreOpener-5db0803f609624bbe92bd4b0a80c58bd-1] regionserver.HStore(310): Store=5db0803f609624bbe92bd4b0a80c58bd/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-17 12:11:09,875 INFO [StoreOpener-9b743b0f32a0fb2da34db5cb35625561-1] regionserver.HStore(310): Store=9b743b0f32a0fb2da34db5cb35625561/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-17 12:11:09,878 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/default/testtb-testExportWithTargetName/5db0803f609624bbe92bd4b0a80c58bd 2023-07-17 12:11:09,879 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/default/testtb-testExportWithTargetName/5db0803f609624bbe92bd4b0a80c58bd 2023-07-17 12:11:09,880 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/default/testtb-testExportWithTargetName/9b743b0f32a0fb2da34db5cb35625561 2023-07-17 12:11:09,880 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/default/testtb-testExportWithTargetName/9b743b0f32a0fb2da34db5cb35625561 2023-07-17 12:11:09,885 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 9b743b0f32a0fb2da34db5cb35625561 2023-07-17 12:11:09,887 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 5db0803f609624bbe92bd4b0a80c58bd 2023-07-17 12:11:09,894 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/default/testtb-testExportWithTargetName/9b743b0f32a0fb2da34db5cb35625561/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-17 12:11:09,895 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 9b743b0f32a0fb2da34db5cb35625561; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65496564, jitterRate=-0.024025142192840576}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-17 12:11:09,895 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 9b743b0f32a0fb2da34db5cb35625561: 2023-07-17 12:11:09,896 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/default/testtb-testExportWithTargetName/5db0803f609624bbe92bd4b0a80c58bd/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-17 12:11:09,897 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,1,1689595869343.9b743b0f32a0fb2da34db5cb35625561., pid=15, masterSystemTime=1689595869834 2023-07-17 12:11:09,897 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 5db0803f609624bbe92bd4b0a80c58bd; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70487008, jitterRate=0.0503382682800293}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-17 12:11:09,897 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 5db0803f609624bbe92bd4b0a80c58bd: 2023-07-17 12:11:09,898 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,,1689595869343.5db0803f609624bbe92bd4b0a80c58bd., pid=16, masterSystemTime=1689595869835 2023-07-17 12:11:09,899 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,1,1689595869343.9b743b0f32a0fb2da34db5cb35625561. 2023-07-17 12:11:09,899 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,1,1689595869343.9b743b0f32a0fb2da34db5cb35625561. 2023-07-17 12:11:09,900 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=9b743b0f32a0fb2da34db5cb35625561, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:11:09,900 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,1,1689595869343.9b743b0f32a0fb2da34db5cb35625561.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689595869900"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689595869900"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689595869900"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689595869900"}]},"ts":"1689595869900"} 2023-07-17 12:11:09,901 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,,1689595869343.5db0803f609624bbe92bd4b0a80c58bd. 2023-07-17 12:11:09,901 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,,1689595869343.5db0803f609624bbe92bd4b0a80c58bd. 2023-07-17 12:11:09,902 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=5db0803f609624bbe92bd4b0a80c58bd, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:11:09,903 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,,1689595869343.5db0803f609624bbe92bd4b0a80c58bd.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689595869902"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689595869902"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689595869902"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689595869902"}]},"ts":"1689595869902"} 2023-07-17 12:11:09,908 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=15, resume processing ppid=14 2023-07-17 12:11:09,908 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=14, state=SUCCESS; OpenRegionProcedure 9b743b0f32a0fb2da34db5cb35625561, server=jenkins-hbase4.apache.org,33685,1689595859854 in 224 msec 2023-07-17 12:11:09,911 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=13 2023-07-17 12:11:09,915 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=13, state=SUCCESS; OpenRegionProcedure 5db0803f609624bbe92bd4b0a80c58bd, server=jenkins-hbase4.apache.org,39491,1689595859788 in 224 msec 2023-07-17 12:11:09,915 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=9b743b0f32a0fb2da34db5cb35625561, ASSIGN in 386 msec 2023-07-17 12:11:09,919 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=13, resume processing ppid=12 2023-07-17 12:11:09,919 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=5db0803f609624bbe92bd4b0a80c58bd, ASSIGN in 393 msec 2023-07-17 12:11:09,920 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-17 12:11:09,920 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689595869920"}]},"ts":"1689595869920"} 2023-07-17 12:11:09,922 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLED in hbase:meta 2023-07-17 12:11:09,925 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_POST_OPERATION 2023-07-17 12:11:09,931 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportWithTargetName jenkins: RWXCA 2023-07-17 12:11:09,941 DEBUG [hconnection-0x7d25120b-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 12:11:09,944 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52912, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=ClientService 2023-07-17 12:11:09,954 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39491] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-17 12:11:09,961 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42013] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-17 12:11:09,987 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:33685-0x10173314c9f0002, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-17 12:11:09,987 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-17 12:11:09,987 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:39491-0x10173314c9f0001, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-17 12:11:09,987 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:42615-0x10173314c9f0003, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-17 12:11:09,987 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-17 12:11:09,996 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:33685-0x10173314c9f0002, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-17 12:11:09,996 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-17 12:11:09,996 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:42615-0x10173314c9f0003, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-17 12:11:09,996 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:39491-0x10173314c9f0001, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-17 12:11:09,997 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-17 12:11:09,997 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-17 12:11:09,997 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-17 12:11:10,000 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=12, state=SUCCESS; CreateTableProcedure table=testtb-testExportWithTargetName in 652 msec 2023-07-17 12:11:10,463 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42013] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-17 12:11:10,463 INFO [Listener at jenkins-hbase4.apache.org/44127] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportWithTargetName, procId: 12 completed 2023-07-17 12:11:10,468 DEBUG [Listener at jenkins-hbase4.apache.org/44127] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-07-17 12:11:10,469 DEBUG [Listener at jenkins-hbase4.apache.org/44127] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1689595869343.5db0803f609624bbe92bd4b0a80c58bd. 2023-07-17 12:11:10,472 INFO [Listener at jenkins-hbase4.apache.org/44127] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-17 12:11:10,500 DEBUG [hconnection-0x14eacf93-shared-pool-4] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 12:11:10,503 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34716, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 12:11:10,526 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42013] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-17 12:11:10,527 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42013] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689595870527 (current time:1689595870527). 2023-07-17 12:11:10,527 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42013] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-17 12:11:10,527 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42013] zookeeper.ReadOnlyZKClient(139): Connect 0x7c3b1208 to 127.0.0.1:55622 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-17 12:11:10,535 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42013] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1168eb98, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-17 12:11:10,536 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42013] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 12:11:10,540 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44302, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 12:11:10,542 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42013] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7c3b1208 to 127.0.0.1:55622 2023-07-17 12:11:10,542 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42013] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 12:11:10,543 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42013] zookeeper.ReadOnlyZKClient(139): Connect 0x4a1e407c to 127.0.0.1:55622 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-17 12:11:10,551 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42013] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@64b0bd2a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-17 12:11:10,553 DEBUG [hconnection-0xcf28e57-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 12:11:10,555 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44312, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 12:11:10,560 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42013] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 12:11:10,562 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34722, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 12:11:10,564 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42013] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4a1e407c to 127.0.0.1:55622 2023-07-17 12:11:10,564 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42013] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 12:11:10,564 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42013] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-17 12:11:10,589 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42013] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-17 12:11:10,590 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42013] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-17 12:11:10,616 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42013] procedure2.ProcedureExecutor(1029): Stored pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-17 12:11:10,618 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-17 12:11:10,621 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=17, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1689596470621 2023-07-17 12:11:10,622 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42013] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-17 12:11:10,623 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-07-17 12:11:10,626 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=17, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-17 12:11:10,630 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-17 12:11:10,631 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=17, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 19 msec 2023-07-17 12:11:10,632 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-17 12:11:10,633 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1689596470633 2023-07-17 12:11:10,636 DEBUG [Listener at jenkins-hbase4.apache.org/44127] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-17 12:11:10,636 DEBUG [Listener at jenkins-hbase4.apache.org/44127] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-17 12:11:10,676 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportWithTargetName 2023-07-17 12:11:10,677 INFO [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportWithTargetName' 2023-07-17 12:11:10,677 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 12:11:10,679 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' 2023-07-17 12:11:10,679 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-07-17 12:11:10,680 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-17 12:11:10,680 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-17 12:11:10,685 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:33685-0x10173314c9f0002, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 12:11:10,685 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:42615-0x10173314c9f0003, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 12:11:10,685 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:39491-0x10173314c9f0001, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 12:11:10,685 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 12:11:10,685 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 12:11:10,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 12:11:10,685 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:11:10,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 12:11:10,685 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 12:11:10,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 12:11:10,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-17 12:11:10,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-17 12:11:10,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-17 12:11:10,686 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:11:10,686 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:11:10,686 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39491-0x10173314c9f0001, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-17 12:11:10,686 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33685-0x10173314c9f0002, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-17 12:11:10,687 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:11:10,687 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-17 12:11:10,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-17 12:11:10,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-17 12:11:10,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-17 12:11:10,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-17 12:11:10,689 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-17 12:11:10,689 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-17 12:11:10,689 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42615-0x10173314c9f0003, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-17 12:11:10,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-17 12:11:10,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-17 12:11:10,690 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-17 12:11:10,692 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-17 12:11:10,692 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-17 12:11:10,692 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-17 12:11:10,692 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-17 12:11:10,692 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 12:11:10,692 DEBUG [member: 'jenkins-hbase4.apache.org,33685,1689595859854' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-17 12:11:10,692 DEBUG [member: 'jenkins-hbase4.apache.org,39491,1689595859788' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-17 12:11:10,693 DEBUG [member: 'jenkins-hbase4.apache.org,39491,1689595859788' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 12:11:10,693 DEBUG [member: 'jenkins-hbase4.apache.org,33685,1689595859854' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 12:11:10,695 DEBUG [member: 'jenkins-hbase4.apache.org,39491,1689595859788' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-17 12:11:10,696 DEBUG [member: 'jenkins-hbase4.apache.org,33685,1689595859854' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-17 12:11:10,696 DEBUG [member: 'jenkins-hbase4.apache.org,39491,1689595859788' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-17 12:11:10,694 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-17 12:11:10,696 DEBUG [member: 'jenkins-hbase4.apache.org,39491,1689595859788' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39491,1689595859788' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-17 12:11:10,696 DEBUG [member: 'jenkins-hbase4.apache.org,33685,1689595859854' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-17 12:11:10,696 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-17 12:11:10,696 DEBUG [member: 'jenkins-hbase4.apache.org,33685,1689595859854' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33685,1689595859854' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-17 12:11:10,696 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42615,1689595859906' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-17 12:11:10,699 DEBUG [member: 'jenkins-hbase4.apache.org,39491,1689595859788' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-17 12:11:10,699 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:11:10,699 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:11:10,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:11:10,699 DEBUG [member: 'jenkins-hbase4.apache.org,33685,1689595859854' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-17 12:11:10,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 12:11:10,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 12:11:10,699 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-17 12:11:10,700 DEBUG [member: 'jenkins-hbase4.apache.org,39491,1689595859788' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39491-0x10173314c9f0001, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-17 12:11:10,700 DEBUG [member: 'jenkins-hbase4.apache.org,33685,1689595859854' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33685-0x10173314c9f0002, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-17 12:11:10,700 DEBUG [member: 'jenkins-hbase4.apache.org,33685,1689595859854' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 12:11:10,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 12:11:10,700 DEBUG [member: 'jenkins-hbase4.apache.org,39491,1689595859788' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 12:11:10,700 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42615-0x10173314c9f0003, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-17 12:11:10,700 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 12:11:10,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 12:11:10,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-17 12:11:10,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:11:10,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:11:10,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:11:10,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 12:11:10,704 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39491,1689595859788' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-07-17 12:11:10,704 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4b665638[Count = 1] remaining members to acquire global barrier 2023-07-17 12:11:10,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:11:10,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 12:11:10,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 12:11:10,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 12:11:10,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 12:11:10,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-17 12:11:10,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:11:10,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:11:10,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:11:10,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 12:11:10,712 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33685,1689595859854' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-07-17 12:11:10,712 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4b665638[Count = 0] remaining members to acquire global barrier 2023-07-17 12:11:10,712 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-07-17 12:11:10,712 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-17 12:11:10,716 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:33685-0x10173314c9f0002, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-17 12:11:10,716 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:39491-0x10173314c9f0001, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-17 12:11:10,716 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-17 12:11:10,716 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-17 12:11:10,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-17 12:11:10,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-17 12:11:10,716 DEBUG [member: 'jenkins-hbase4.apache.org,33685,1689595859854' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-17 12:11:10,716 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:11:10,717 DEBUG [member: 'jenkins-hbase4.apache.org,39491,1689595859788' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-17 12:11:10,717 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:11:10,717 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-17 12:11:10,719 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:42615-0x10173314c9f0003, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-17 12:11:10,719 DEBUG [member: 'jenkins-hbase4.apache.org,39491,1689595859788' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-17 12:11:10,719 DEBUG [member: 'jenkins-hbase4.apache.org,33685,1689595859854' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-17 12:11:10,719 DEBUG [rs(jenkins-hbase4.apache.org,39491,1689595859788)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1689595869343.5db0803f609624bbe92bd4b0a80c58bd. 2023-07-17 12:11:10,719 DEBUG [member: 'jenkins-hbase4.apache.org,39491,1689595859788' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-17 12:11:10,719 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-17 12:11:10,719 DEBUG [rs(jenkins-hbase4.apache.org,33685,1689595859854)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1689595869343.9b743b0f32a0fb2da34db5cb35625561. 2023-07-17 12:11:10,719 DEBUG [member: 'jenkins-hbase4.apache.org,33685,1689595859854' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-17 12:11:10,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-17 12:11:10,720 DEBUG [rs(jenkins-hbase4.apache.org,33685,1689595859854)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1689595869343.9b743b0f32a0fb2da34db5cb35625561. started... 2023-07-17 12:11:10,720 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-17 12:11:10,720 DEBUG [rs(jenkins-hbase4.apache.org,39491,1689595859788)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1689595869343.5db0803f609624bbe92bd4b0a80c58bd. started... 2023-07-17 12:11:10,720 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-17 12:11:10,720 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,42615,1689595859906' in zk 2023-07-17 12:11:10,723 DEBUG [rs(jenkins-hbase4.apache.org,39491,1689595859788)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 5db0803f609624bbe92bd4b0a80c58bd: 2023-07-17 12:11:10,723 DEBUG [rs(jenkins-hbase4.apache.org,33685,1689595859854)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 9b743b0f32a0fb2da34db5cb35625561: 2023-07-17 12:11:10,725 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-17 12:11:10,725 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 12:11:10,725 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-17 12:11:10,728 DEBUG [rs(jenkins-hbase4.apache.org,39491,1689595859788)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1689595869343.5db0803f609624bbe92bd4b0a80c58bd.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-17 12:11:10,729 DEBUG [rs(jenkins-hbase4.apache.org,33685,1689595859854)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1689595869343.9b743b0f32a0fb2da34db5cb35625561.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-17 12:11:10,737 DEBUG [Listener at jenkins-hbase4.apache.org/44127] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 12:11:10,738 DEBUG [rs(jenkins-hbase4.apache.org,39491,1689595859788)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-17 12:11:10,738 DEBUG [rs(jenkins-hbase4.apache.org,33685,1689595859854)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-17 12:11:10,740 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42013] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-17 12:11:10,742 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42013] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-17 12:11:10,743 DEBUG [Listener at jenkins-hbase4.apache.org/44127] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-17 12:11:10,745 DEBUG [rs(jenkins-hbase4.apache.org,39491,1689595859788)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-17 12:11:10,745 DEBUG [rs(jenkins-hbase4.apache.org,33685,1689595859854)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-17 12:11:10,809 DEBUG [rs(jenkins-hbase4.apache.org,39491,1689595859788)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1689595869343.5db0803f609624bbe92bd4b0a80c58bd. completed. 2023-07-17 12:11:10,809 DEBUG [rs(jenkins-hbase4.apache.org,33685,1689595859854)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1689595869343.9b743b0f32a0fb2da34db5cb35625561. completed. 2023-07-17 12:11:10,809 DEBUG [rs(jenkins-hbase4.apache.org,39491,1689595859788)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1689595869343.5db0803f609624bbe92bd4b0a80c58bd. 2023-07-17 12:11:10,809 DEBUG [rs(jenkins-hbase4.apache.org,33685,1689595859854)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1689595869343.9b743b0f32a0fb2da34db5cb35625561. 2023-07-17 12:11:10,809 DEBUG [member: 'jenkins-hbase4.apache.org,33685,1689595859854' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-17 12:11:10,809 DEBUG [member: 'jenkins-hbase4.apache.org,33685,1689595859854' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-17 12:11:10,809 DEBUG [member: 'jenkins-hbase4.apache.org,33685,1689595859854' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:11:10,810 DEBUG [member: 'jenkins-hbase4.apache.org,33685,1689595859854' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-17 12:11:10,810 DEBUG [member: 'jenkins-hbase4.apache.org,33685,1689595859854' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,33685,1689595859854' in zk 2023-07-17 12:11:10,810 DEBUG [member: 'jenkins-hbase4.apache.org,39491,1689595859788' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-17 12:11:10,810 DEBUG [member: 'jenkins-hbase4.apache.org,39491,1689595859788' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-17 12:11:10,810 DEBUG [member: 'jenkins-hbase4.apache.org,39491,1689595859788' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:11:10,810 DEBUG [member: 'jenkins-hbase4.apache.org,39491,1689595859788' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-17 12:11:10,810 DEBUG [member: 'jenkins-hbase4.apache.org,39491,1689595859788' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,39491,1689595859788' in zk 2023-07-17 12:11:10,814 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:11:10,814 DEBUG [member: 'jenkins-hbase4.apache.org,39491,1689595859788' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-17 12:11:10,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:11:10,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 12:11:10,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 12:11:10,814 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:11:10,814 DEBUG [member: 'jenkins-hbase4.apache.org,33685,1689595859854' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-17 12:11:10,814 DEBUG [member: 'jenkins-hbase4.apache.org,33685,1689595859854' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 12:11:10,814 DEBUG [member: 'jenkins-hbase4.apache.org,33685,1689595859854' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-17 12:11:10,814 DEBUG [member: 'jenkins-hbase4.apache.org,39491,1689595859788' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 12:11:10,816 DEBUG [member: 'jenkins-hbase4.apache.org,39491,1689595859788' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-17 12:11:10,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 12:11:10,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 12:11:10,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-17 12:11:10,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:11:10,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:11:10,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:11:10,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 12:11:10,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-17 12:11:10,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:11:10,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:11:10,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:11:10,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,33685,1689595859854': 2023-07-17 12:11:10,825 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33685,1689595859854' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-07-17 12:11:10,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:11:10,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 12:11:10,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 12:11:10,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 12:11:10,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 12:11:10,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-17 12:11:10,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:11:10,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:11:10,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:11:10,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 12:11:10,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-17 12:11:10,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:11:10,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:11:10,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:11:10,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,39491,1689595859788': 2023-07-17 12:11:10,830 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39491,1689595859788' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-07-17 12:11:10,830 INFO [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportWithTargetName' execution completed 2023-07-17 12:11:10,830 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-17 12:11:10,830 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-17 12:11:10,830 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportWithTargetName 2023-07-17 12:11:10,830 INFO [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-17 12:11:10,834 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-17 12:11:10,834 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:39491-0x10173314c9f0001, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-17 12:11:10,834 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:39491-0x10173314c9f0001, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 12:11:10,834 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:42615-0x10173314c9f0003, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-17 12:11:10,834 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:33685-0x10173314c9f0002, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-17 12:11:10,834 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:33685-0x10173314c9f0002, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 12:11:10,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-17 12:11:10,835 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-17 12:11:10,834 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-17 12:11:10,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-17 12:11:10,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-17 12:11:10,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 12:11:10,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 12:11:10,834 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-17 12:11:10,835 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 12:11:10,835 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:11:10,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 12:11:10,834 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:42615-0x10173314c9f0003, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 12:11:10,836 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:11:10,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 12:11:10,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-17 12:11:10,836 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 12:11:10,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 12:11:10,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-17 12:11:10,836 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:11:10,837 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 12:11:10,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 12:11:10,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-17 12:11:10,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-17 12:11:10,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-17 12:11:10,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 12:11:10,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-17 12:11:10,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:11:10,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:11:10,841 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:11:10,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:11:10,841 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:11:10,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 12:11:10,842 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:11:10,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-17 12:11:10,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:11:10,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:11:10,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:11:10,862 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:11:10,862 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:42615-0x10173314c9f0003, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 12:11:10,862 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-17 12:11:10,862 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:33685-0x10173314c9f0002, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 12:11:10,862 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 12:11:10,862 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:39491-0x10173314c9f0001, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 12:11:10,862 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:11:10,862 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 12:11:10,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 12:11:10,862 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 12:11:10,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 12:11:10,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 12:11:10,862 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:11:10,863 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:39491-0x10173314c9f0001, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 12:11:10,863 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:42615-0x10173314c9f0003, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 12:11:10,863 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:33685-0x10173314c9f0002, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 12:11:10,863 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-17 12:11:10,863 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 12:11:10,863 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 12:11:10,863 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportWithTargetName 2023-07-17 12:11:10,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 12:11:10,864 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-07-17 12:11:10,863 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 12:11:10,864 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 12:11:10,864 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-17 12:11:10,863 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:11:10,864 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-17 12:11:10,864 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-17 12:11:10,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 12:11:10,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 12:11:10,864 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:11:10,865 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:11:10,865 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-17 12:11:10,865 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-17 12:11:10,865 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-17 12:11:10,887 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportWithTargetName 2023-07-17 12:11:10,891 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-17 12:11:10,943 DEBUG [Listener at jenkins-hbase4.apache.org/44127] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 12:11:10,945 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42013] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-17 12:11:10,945 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42013] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-17 12:11:10,945 DEBUG [Listener at jenkins-hbase4.apache.org/44127] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-17 12:11:10,954 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName to hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.hbase-snapshot/emptySnaptb0-testExportWithTargetName 2023-07-17 12:11:11,022 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-07-17 12:11:11,022 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-17 12:11:11,023 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-17 12:11:11,023 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1689595870623Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1689595870887 (+264 ms)Consolidate snapshot: emptySnaptb0-testExportWithTargetName at 1689595870887Loading Region manifests for emptySnaptb0-testExportWithTargetName at 1689595870888 (+1 ms)Writing data manifest for emptySnaptb0-testExportWithTargetName at 1689595870903 (+15 ms)Verifying snapshot: emptySnaptb0-testExportWithTargetName at 1689595870941 (+38 ms)Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1689595871022 (+81 ms) 2023-07-17 12:11:11,026 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-17 12:11:11,028 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 399 msec 2023-07-17 12:11:11,245 DEBUG [Listener at jenkins-hbase4.apache.org/44127] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 12:11:11,249 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42013] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-17 12:11:11,249 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42013] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-17 12:11:11,266 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39491] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,,1689595869343.5db0803f609624bbe92bd4b0a80c58bd. with WAL disabled. Data may be lost in the event of a crash. 2023-07-17 12:11:11,271 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33685] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,1,1689595869343.9b743b0f32a0fb2da34db5cb35625561. with WAL disabled. Data may be lost in the event of a crash. 2023-07-17 12:11:11,278 DEBUG [Listener at jenkins-hbase4.apache.org/44127] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-07-17 12:11:11,278 DEBUG [Listener at jenkins-hbase4.apache.org/44127] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1689595869343.5db0803f609624bbe92bd4b0a80c58bd. 2023-07-17 12:11:11,278 INFO [Listener at jenkins-hbase4.apache.org/44127] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-17 12:11:11,297 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42013] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-17 12:11:11,297 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42013] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689595871297 (current time:1689595871297). 2023-07-17 12:11:11,297 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42013] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-17 12:11:11,297 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42013] zookeeper.ReadOnlyZKClient(139): Connect 0x16571ef8 to 127.0.0.1:55622 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-17 12:11:11,306 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42013] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5fdc50ab, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-17 12:11:11,307 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42013] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 12:11:11,311 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44324, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 12:11:11,313 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42013] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x16571ef8 to 127.0.0.1:55622 2023-07-17 12:11:11,313 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42013] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 12:11:11,314 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42013] zookeeper.ReadOnlyZKClient(139): Connect 0x1d939bb0 to 127.0.0.1:55622 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-17 12:11:11,326 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42013] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@339de624, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-17 12:11:11,329 DEBUG [hconnection-0xef9a1f4-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 12:11:11,332 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44328, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 12:11:11,337 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42013] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 12:11:11,340 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34724, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 12:11:11,341 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42013] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1d939bb0 to 127.0.0.1:55622 2023-07-17 12:11:11,342 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42013] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 12:11:11,342 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42013] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-17 12:11:11,343 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42013] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-17 12:11:11,344 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42013] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-17 12:11:11,347 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42013] procedure2.ProcedureExecutor(1029): Stored pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-17 12:11:11,355 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-17 12:11:11,356 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=19, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1689596471356 2023-07-17 12:11:11,356 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42013] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-17 12:11:11,356 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-07-17 12:11:11,359 DEBUG [Listener at jenkins-hbase4.apache.org/44127] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-17 12:11:11,359 DEBUG [Listener at jenkins-hbase4.apache.org/44127] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-17 12:11:11,359 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-17 12:11:11,361 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=19, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-17 12:11:11,363 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=19, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 15 msec 2023-07-17 12:11:11,364 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-17 12:11:11,365 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=20, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1689596471365 2023-07-17 12:11:11,401 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportWithTargetName 2023-07-17 12:11:11,401 INFO [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportWithTargetName' 2023-07-17 12:11:11,401 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 12:11:11,403 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportWithTargetName' starting 'acquire' 2023-07-17 12:11:11,403 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-07-17 12:11:11,447 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-17 12:11:11,447 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-17 12:11:11,449 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:33685-0x10173314c9f0002, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 12:11:11,449 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:39491-0x10173314c9f0001, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 12:11:11,449 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 12:11:11,449 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 12:11:11,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 12:11:11,449 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:42615-0x10173314c9f0003, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 12:11:11,449 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:11:11,449 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 12:11:11,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 12:11:11,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 12:11:11,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-17 12:11:11,450 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:11:11,450 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:11:11,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-17 12:11:11,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-17 12:11:11,450 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:11:11,450 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39491-0x10173314c9f0001, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-17 12:11:11,450 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42615-0x10173314c9f0003, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-17 12:11:11,450 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-17 12:11:11,450 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33685-0x10173314c9f0002, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-17 12:11:11,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-17 12:11:11,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-17 12:11:11,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-17 12:11:11,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-17 12:11:11,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-17 12:11:11,451 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-17 12:11:11,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-17 12:11:11,451 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-17 12:11:11,451 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-17 12:11:11,451 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-17 12:11:11,451 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-17 12:11:11,452 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 12:11:11,451 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-17 12:11:11,453 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-17 12:11:11,453 DEBUG [member: 'jenkins-hbase4.apache.org,39491,1689595859788' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-17 12:11:11,453 DEBUG [member: 'jenkins-hbase4.apache.org,39491,1689595859788' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 12:11:11,453 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-17 12:11:11,454 DEBUG [member: 'jenkins-hbase4.apache.org,39491,1689595859788' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-17 12:11:11,454 DEBUG [member: 'jenkins-hbase4.apache.org,39491,1689595859788' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-17 12:11:11,454 DEBUG [member: 'jenkins-hbase4.apache.org,39491,1689595859788' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39491,1689595859788' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-17 12:11:11,452 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-17 12:11:11,454 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42615,1689595859906' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-17 12:11:11,454 DEBUG [member: 'jenkins-hbase4.apache.org,33685,1689595859854' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-17 12:11:11,455 DEBUG [member: 'jenkins-hbase4.apache.org,33685,1689595859854' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 12:11:11,456 DEBUG [member: 'jenkins-hbase4.apache.org,33685,1689595859854' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-17 12:11:11,456 DEBUG [member: 'jenkins-hbase4.apache.org,33685,1689595859854' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-17 12:11:11,456 DEBUG [member: 'jenkins-hbase4.apache.org,33685,1689595859854' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33685,1689595859854' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-17 12:11:11,459 DEBUG [Listener at jenkins-hbase4.apache.org/44127] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 12:11:11,460 DEBUG [member: 'jenkins-hbase4.apache.org,39491,1689595859788' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-17 12:11:11,460 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-17 12:11:11,460 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:11:11,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:11:11,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 12:11:11,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 12:11:11,461 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42013] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-17 12:11:11,461 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42013] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-17 12:11:11,461 DEBUG [member: 'jenkins-hbase4.apache.org,33685,1689595859854' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-17 12:11:11,461 DEBUG [Listener at jenkins-hbase4.apache.org/44127] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-17 12:11:11,461 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:11:11,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 12:11:11,461 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42615-0x10173314c9f0003, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-17 12:11:11,461 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 12:11:11,461 DEBUG [member: 'jenkins-hbase4.apache.org,33685,1689595859854' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33685-0x10173314c9f0002, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-17 12:11:11,461 DEBUG [member: 'jenkins-hbase4.apache.org,33685,1689595859854' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 12:11:11,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 12:11:11,462 DEBUG [member: 'jenkins-hbase4.apache.org,39491,1689595859788' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39491-0x10173314c9f0001, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-17 12:11:11,462 DEBUG [member: 'jenkins-hbase4.apache.org,39491,1689595859788' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 12:11:11,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-17 12:11:11,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:11:11,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:11:11,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:11:11,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 12:11:11,464 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39491,1689595859788' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-07-17 12:11:11,465 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3b11d0f6[Count = 1] remaining members to acquire global barrier 2023-07-17 12:11:11,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:11:11,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 12:11:11,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 12:11:11,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 12:11:11,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 12:11:11,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-17 12:11:11,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:11:11,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:11:11,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:11:11,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 12:11:11,467 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33685,1689595859854' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-07-17 12:11:11,467 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3b11d0f6[Count = 0] remaining members to acquire global barrier 2023-07-17 12:11:11,467 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-07-17 12:11:11,468 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-17 12:11:11,472 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:39491-0x10173314c9f0001, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-17 12:11:11,472 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:42615-0x10173314c9f0003, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-17 12:11:11,472 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-17 12:11:11,472 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-17 12:11:11,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-17 12:11:11,472 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:33685-0x10173314c9f0002, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-17 12:11:11,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-17 12:11:11,472 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-17 12:11:11,472 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:11:11,472 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-17 12:11:11,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-17 12:11:11,472 DEBUG [member: 'jenkins-hbase4.apache.org,39491,1689595859788' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-17 12:11:11,473 DEBUG [member: 'jenkins-hbase4.apache.org,33685,1689595859854' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-17 12:11:11,472 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-17 12:11:11,473 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,42615,1689595859906' in zk 2023-07-17 12:11:11,473 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:11:11,473 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-17 12:11:11,474 DEBUG [member: 'jenkins-hbase4.apache.org,39491,1689595859788' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-17 12:11:11,474 DEBUG [member: 'jenkins-hbase4.apache.org,39491,1689595859788' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-17 12:11:11,474 DEBUG [rs(jenkins-hbase4.apache.org,39491,1689595859788)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1689595869343.5db0803f609624bbe92bd4b0a80c58bd. 2023-07-17 12:11:11,474 DEBUG [member: 'jenkins-hbase4.apache.org,33685,1689595859854' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-17 12:11:11,474 DEBUG [rs(jenkins-hbase4.apache.org,39491,1689595859788)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1689595869343.5db0803f609624bbe92bd4b0a80c58bd. started... 2023-07-17 12:11:11,474 DEBUG [member: 'jenkins-hbase4.apache.org,33685,1689595859854' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-17 12:11:11,474 DEBUG [rs(jenkins-hbase4.apache.org,33685,1689595859854)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1689595869343.9b743b0f32a0fb2da34db5cb35625561. 2023-07-17 12:11:11,474 DEBUG [rs(jenkins-hbase4.apache.org,33685,1689595859854)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1689595869343.9b743b0f32a0fb2da34db5cb35625561. started... 2023-07-17 12:11:11,474 INFO [rs(jenkins-hbase4.apache.org,39491,1689595859788)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 5db0803f609624bbe92bd4b0a80c58bd 1/1 column families, dataSize=266 B heapSize=832 B 2023-07-17 12:11:11,475 INFO [rs(jenkins-hbase4.apache.org,33685,1689595859854)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 9b743b0f32a0fb2da34db5cb35625561 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-07-17 12:11:11,477 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-17 12:11:11,477 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 12:11:11,477 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-17 12:11:11,643 INFO [rs(jenkins-hbase4.apache.org,33685,1689595859854)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202307173bbba833f9f14b75bcdb8c8de1d72e09 to hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b202307173bbba833f9f14b75bcdb8c8de1d72e09 2023-07-17 12:11:11,643 INFO [rs(jenkins-hbase4.apache.org,39491,1689595859788)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230717aa474b3ee7224df398470eba5e2ab0dd to hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230717aa474b3ee7224df398470eba5e2ab0dd 2023-07-17 12:11:11,661 DEBUG [Listener at jenkins-hbase4.apache.org/44127] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 12:11:11,664 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42013] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-17 12:11:11,673 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42013] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-17 12:11:11,674 DEBUG [Listener at jenkins-hbase4.apache.org/44127] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-17 12:11:11,703 INFO [rs(jenkins-hbase4.apache.org,33685,1689595859854)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.0 K, hasBloomFilter=true, into tmp file hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/default/testtb-testExportWithTargetName/9b743b0f32a0fb2da34db5cb35625561/.tmp/cf/dcb35c47078c427db851fe9db2a5fa07 2023-07-17 12:11:11,716 INFO [rs(jenkins-hbase4.apache.org,39491,1689595859788)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=266, hasBloomFilter=true, into tmp file hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/default/testtb-testExportWithTargetName/5db0803f609624bbe92bd4b0a80c58bd/.tmp/cf/55545261169743a69680571b6abb51cb 2023-07-17 12:11:11,716 DEBUG [rs(jenkins-hbase4.apache.org,33685,1689595859854)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/default/testtb-testExportWithTargetName/9b743b0f32a0fb2da34db5cb35625561/.tmp/cf/dcb35c47078c427db851fe9db2a5fa07 as hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/default/testtb-testExportWithTargetName/9b743b0f32a0fb2da34db5cb35625561/cf/dcb35c47078c427db851fe9db2a5fa07 2023-07-17 12:11:11,725 INFO [rs(jenkins-hbase4.apache.org,33685,1689595859854)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/default/testtb-testExportWithTargetName/9b743b0f32a0fb2da34db5cb35625561/cf/dcb35c47078c427db851fe9db2a5fa07, entries=46, sequenceid=6, filesize=12.6 K 2023-07-17 12:11:11,727 DEBUG [rs(jenkins-hbase4.apache.org,39491,1689595859788)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/default/testtb-testExportWithTargetName/5db0803f609624bbe92bd4b0a80c58bd/.tmp/cf/55545261169743a69680571b6abb51cb as hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/default/testtb-testExportWithTargetName/5db0803f609624bbe92bd4b0a80c58bd/cf/55545261169743a69680571b6abb51cb 2023-07-17 12:11:11,729 INFO [rs(jenkins-hbase4.apache.org,33685,1689595859854)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for 9b743b0f32a0fb2da34db5cb35625561 in 255ms, sequenceid=6, compaction requested=false 2023-07-17 12:11:11,729 DEBUG [rs(jenkins-hbase4.apache.org,33685,1689595859854)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-07-17 12:11:11,731 DEBUG [rs(jenkins-hbase4.apache.org,33685,1689595859854)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 9b743b0f32a0fb2da34db5cb35625561: 2023-07-17 12:11:11,731 DEBUG [rs(jenkins-hbase4.apache.org,33685,1689595859854)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1689595869343.9b743b0f32a0fb2da34db5cb35625561.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-17 12:11:11,732 DEBUG [rs(jenkins-hbase4.apache.org,33685,1689595859854)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-17 12:11:11,732 DEBUG [rs(jenkins-hbase4.apache.org,33685,1689595859854)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/default/testtb-testExportWithTargetName/9b743b0f32a0fb2da34db5cb35625561/cf/dcb35c47078c427db851fe9db2a5fa07] hfiles 2023-07-17 12:11:11,732 DEBUG [rs(jenkins-hbase4.apache.org,33685,1689595859854)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/default/testtb-testExportWithTargetName/9b743b0f32a0fb2da34db5cb35625561/cf/dcb35c47078c427db851fe9db2a5fa07 for snapshot=snaptb0-testExportWithTargetName 2023-07-17 12:11:11,736 INFO [rs(jenkins-hbase4.apache.org,39491,1689595859788)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/default/testtb-testExportWithTargetName/5db0803f609624bbe92bd4b0a80c58bd/cf/55545261169743a69680571b6abb51cb, entries=4, sequenceid=6, filesize=5.6 K 2023-07-17 12:11:11,740 INFO [rs(jenkins-hbase4.apache.org,39491,1689595859788)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for 5db0803f609624bbe92bd4b0a80c58bd in 266ms, sequenceid=6, compaction requested=false 2023-07-17 12:11:11,741 DEBUG [rs(jenkins-hbase4.apache.org,39491,1689595859788)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 5db0803f609624bbe92bd4b0a80c58bd: 2023-07-17 12:11:11,741 DEBUG [rs(jenkins-hbase4.apache.org,39491,1689595859788)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1689595869343.5db0803f609624bbe92bd4b0a80c58bd.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-17 12:11:11,741 DEBUG [rs(jenkins-hbase4.apache.org,39491,1689595859788)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-17 12:11:11,741 DEBUG [rs(jenkins-hbase4.apache.org,39491,1689595859788)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/default/testtb-testExportWithTargetName/5db0803f609624bbe92bd4b0a80c58bd/cf/55545261169743a69680571b6abb51cb] hfiles 2023-07-17 12:11:11,741 DEBUG [rs(jenkins-hbase4.apache.org,39491,1689595859788)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/default/testtb-testExportWithTargetName/5db0803f609624bbe92bd4b0a80c58bd/cf/55545261169743a69680571b6abb51cb for snapshot=snaptb0-testExportWithTargetName 2023-07-17 12:11:11,762 DEBUG [rs(jenkins-hbase4.apache.org,33685,1689595859854)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1689595869343.9b743b0f32a0fb2da34db5cb35625561. completed. 2023-07-17 12:11:11,762 DEBUG [rs(jenkins-hbase4.apache.org,33685,1689595859854)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1689595869343.9b743b0f32a0fb2da34db5cb35625561. 2023-07-17 12:11:11,762 DEBUG [member: 'jenkins-hbase4.apache.org,33685,1689595859854' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-17 12:11:11,762 DEBUG [member: 'jenkins-hbase4.apache.org,33685,1689595859854' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-17 12:11:11,762 DEBUG [member: 'jenkins-hbase4.apache.org,33685,1689595859854' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:11:11,762 DEBUG [member: 'jenkins-hbase4.apache.org,33685,1689595859854' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-17 12:11:11,762 DEBUG [member: 'jenkins-hbase4.apache.org,33685,1689595859854' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,33685,1689595859854' in zk 2023-07-17 12:11:11,764 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:11:11,764 DEBUG [member: 'jenkins-hbase4.apache.org,33685,1689595859854' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-17 12:11:11,764 DEBUG [rs(jenkins-hbase4.apache.org,39491,1689595859788)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1689595869343.5db0803f609624bbe92bd4b0a80c58bd. completed. 2023-07-17 12:11:11,764 DEBUG [member: 'jenkins-hbase4.apache.org,33685,1689595859854' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 12:11:11,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:11:11,764 DEBUG [member: 'jenkins-hbase4.apache.org,33685,1689595859854' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-17 12:11:11,764 DEBUG [rs(jenkins-hbase4.apache.org,39491,1689595859788)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1689595869343.5db0803f609624bbe92bd4b0a80c58bd. 2023-07-17 12:11:11,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 12:11:11,765 DEBUG [member: 'jenkins-hbase4.apache.org,39491,1689595859788' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-17 12:11:11,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 12:11:11,766 DEBUG [member: 'jenkins-hbase4.apache.org,39491,1689595859788' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-17 12:11:11,766 DEBUG [member: 'jenkins-hbase4.apache.org,39491,1689595859788' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:11:11,766 DEBUG [member: 'jenkins-hbase4.apache.org,39491,1689595859788' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-17 12:11:11,766 DEBUG [member: 'jenkins-hbase4.apache.org,39491,1689595859788' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,39491,1689595859788' in zk 2023-07-17 12:11:11,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 12:11:11,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 12:11:11,768 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:11:11,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-17 12:11:11,768 DEBUG [member: 'jenkins-hbase4.apache.org,39491,1689595859788' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-17 12:11:11,768 DEBUG [member: 'jenkins-hbase4.apache.org,39491,1689595859788' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 12:11:11,768 DEBUG [member: 'jenkins-hbase4.apache.org,39491,1689595859788' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-17 12:11:11,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:11:11,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:11:11,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:11:11,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 12:11:11,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-17 12:11:11,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:11:11,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:11:11,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:11:11,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,33685,1689595859854': 2023-07-17 12:11:11,772 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33685,1689595859854' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-07-17 12:11:11,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:11:11,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 12:11:11,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 12:11:11,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 12:11:11,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 12:11:11,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-17 12:11:11,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:11:11,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:11:11,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:11:11,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 12:11:11,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-17 12:11:11,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:11:11,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:11:11,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:11:11,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,39491,1689595859788': 2023-07-17 12:11:11,776 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39491,1689595859788' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-07-17 12:11:11,776 INFO [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportWithTargetName' execution completed 2023-07-17 12:11:11,776 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-17 12:11:11,776 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-17 12:11:11,776 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportWithTargetName 2023-07-17 12:11:11,777 INFO [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-17 12:11:11,779 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:39491-0x10173314c9f0001, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-17 12:11:11,779 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:33685-0x10173314c9f0002, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-17 12:11:11,779 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-17 12:11:11,779 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-17 12:11:11,779 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:42615-0x10173314c9f0003, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-17 12:11:11,779 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:42615-0x10173314c9f0003, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 12:11:11,779 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-17 12:11:11,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-17 12:11:11,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-17 12:11:11,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 12:11:11,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-17 12:11:11,779 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:33685-0x10173314c9f0002, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 12:11:11,779 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:39491-0x10173314c9f0001, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 12:11:11,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 12:11:11,780 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 12:11:11,780 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 12:11:11,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 12:11:11,780 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:11:11,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 12:11:11,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 12:11:11,783 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-17 12:11:11,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-17 12:11:11,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-17 12:11:11,784 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:11:11,784 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 12:11:11,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-17 12:11:11,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-17 12:11:11,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 12:11:11,785 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:11:11,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 12:11:11,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-17 12:11:11,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-17 12:11:11,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:11:11,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:11:11,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:11:11,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 12:11:11,787 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:11:11,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-17 12:11:11,788 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:11:11,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:11:11,788 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:11:11,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:11:11,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:11:11,800 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:11:11,801 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:42615-0x10173314c9f0003, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 12:11:11,801 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-17 12:11:11,801 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 12:11:11,801 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:33685-0x10173314c9f0002, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 12:11:11,801 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 12:11:11,801 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:33685-0x10173314c9f0002, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 12:11:11,801 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:39491-0x10173314c9f0001, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 12:11:11,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 12:11:11,802 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:39491-0x10173314c9f0001, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 12:11:11,801 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:11:11,801 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:42615-0x10173314c9f0003, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 12:11:11,802 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:11:11,802 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 12:11:11,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 12:11:11,801 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 12:11:11,801 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportWithTargetName 2023-07-17 12:11:11,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 12:11:11,802 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-07-17 12:11:11,802 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-17 12:11:11,802 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 12:11:11,802 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-17 12:11:11,802 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 12:11:11,803 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-17 12:11:11,802 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:11:11,803 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 12:11:11,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 12:11:11,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 12:11:11,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 12:11:11,803 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-17 12:11:11,803 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:11:11,803 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:11:11,803 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-17 12:11:11,803 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-17 12:11:11,804 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b202307173bbba833f9f14b75bcdb8c8de1d72e09, hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230717aa474b3ee7224df398470eba5e2ab0dd] mob files 2023-07-17 12:11:11,804 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b202307173bbba833f9f14b75bcdb8c8de1d72e09 2023-07-17 12:11:11,804 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230717aa474b3ee7224df398470eba5e2ab0dd 2023-07-17 12:11:11,818 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportWithTargetName 2023-07-17 12:11:11,819 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-17 12:11:11,870 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName to hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-07-17 12:11:11,964 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-07-17 12:11:11,964 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-17 12:11:11,965 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-17 12:11:11,965 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1689595871357Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1689595871818 (+461 ms)Consolidate snapshot: snaptb0-testExportWithTargetName at 1689595871818Loading Region manifests for snaptb0-testExportWithTargetName at 1689595871818Writing data manifest for snaptb0-testExportWithTargetName at 1689595871823 (+5 ms)Verifying snapshot: snaptb0-testExportWithTargetName at 1689595871846 (+23 ms)Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1689595871964 (+118 ms) 2023-07-17 12:11:11,968 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=20, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-17 12:11:11,974 DEBUG [Listener at jenkins-hbase4.apache.org/44127] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 12:11:11,977 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=20, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 614 msec 2023-07-17 12:11:11,977 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42013] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-17 12:11:11,978 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42013] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-17 12:11:11,978 INFO [Listener at jenkins-hbase4.apache.org/44127] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/export-test/export-1689595871978 2023-07-17 12:11:11,979 INFO [Listener at jenkins-hbase4.apache.org/44127] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:46215, tgtDir=hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/export-test/export-1689595871978, rawTgtDir=hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/export-test/export-1689595871978, srcFsUri=hdfs://localhost:46215, srcDir=hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b 2023-07-17 12:11:12,023 DEBUG [Listener at jenkins-hbase4.apache.org/44127] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:46215, inputRoot=hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b 2023-07-17 12:11:12,023 DEBUG [Listener at jenkins-hbase4.apache.org/44127] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1100345610_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/export-test/export-1689595871978, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/export-test/export-1689595871978/.hbase-snapshot/.tmp/testExportWithTargetName 2023-07-17 12:11:12,024 INFO [Listener at jenkins-hbase4.apache.org/44127] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:46215, inputRoot=hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b, snapshotDir=hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.hbase-snapshot/snaptb0-testExportWithTargetName. 2023-07-17 12:11:12,054 INFO [Listener at jenkins-hbase4.apache.org/44127] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.hbase-snapshot/snaptb0-testExportWithTargetName to hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/export-test/export-1689595871978/.hbase-snapshot/.tmp/testExportWithTargetName 2023-07-17 12:11:12,177 DEBUG [Listener at jenkins-hbase4.apache.org/44127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-17 12:11:12,178 DEBUG [Listener at jenkins-hbase4.apache.org/44127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-17 12:11:12,178 DEBUG [Listener at jenkins-hbase4.apache.org/44127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-17 12:11:12,179 DEBUG [Listener at jenkins-hbase4.apache.org/44127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-17 12:11:12,179 DEBUG [Listener at jenkins-hbase4.apache.org/44127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-17 12:11:12,180 DEBUG [Listener at jenkins-hbase4.apache.org/44127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-17 12:11:12,180 DEBUG [Listener at jenkins-hbase4.apache.org/44127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-17 12:11:12,287 DEBUG [Listener at jenkins-hbase4.apache.org/44127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58af5705-0594-af5f-981c-fa1d3b267fab/hadoop-6290852211044635146.jar 2023-07-17 12:11:12,287 DEBUG [Listener at jenkins-hbase4.apache.org/44127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-17 12:11:12,288 DEBUG [Listener at jenkins-hbase4.apache.org/44127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-17 12:11:12,289 DEBUG [Listener at jenkins-hbase4.apache.org/44127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-17 12:11:12,289 DEBUG [Listener at jenkins-hbase4.apache.org/44127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-17 12:11:12,290 DEBUG [Listener at jenkins-hbase4.apache.org/44127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-17 12:11:12,291 DEBUG [Listener at jenkins-hbase4.apache.org/44127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-17 12:11:12,291 DEBUG [Listener at jenkins-hbase4.apache.org/44127] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-17 12:11:12,292 DEBUG [Listener at jenkins-hbase4.apache.org/44127] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-17 12:11:12,293 DEBUG [Listener at jenkins-hbase4.apache.org/44127] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-17 12:11:12,294 DEBUG [Listener at jenkins-hbase4.apache.org/44127] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-17 12:11:12,294 DEBUG [Listener at jenkins-hbase4.apache.org/44127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-17 12:11:12,295 DEBUG [Listener at jenkins-hbase4.apache.org/44127] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-17 12:11:12,296 DEBUG [Listener at jenkins-hbase4.apache.org/44127] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-17 12:11:12,296 DEBUG [Listener at jenkins-hbase4.apache.org/44127] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-17 12:11:12,297 DEBUG [Listener at jenkins-hbase4.apache.org/44127] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-17 12:11:12,298 DEBUG [Listener at jenkins-hbase4.apache.org/44127] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-17 12:11:12,302 DEBUG [Listener at jenkins-hbase4.apache.org/44127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-17 12:11:12,303 DEBUG [Listener at jenkins-hbase4.apache.org/44127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-17 12:11:12,303 DEBUG [Listener at jenkins-hbase4.apache.org/44127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-17 12:11:12,304 DEBUG [Listener at jenkins-hbase4.apache.org/44127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-17 12:11:12,304 DEBUG [Listener at jenkins-hbase4.apache.org/44127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-17 12:11:12,305 DEBUG [Listener at jenkins-hbase4.apache.org/44127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-17 12:11:12,305 DEBUG [Listener at jenkins-hbase4.apache.org/44127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-17 12:11:13,651 WARN [Listener at jenkins-hbase4.apache.org/44127] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-17 12:11:13,658 INFO [Listener at jenkins-hbase4.apache.org/44127] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportWithTargetName' hfile list 2023-07-17 12:11:13,669 DEBUG [Listener at jenkins-hbase4.apache.org/44127] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-07-17 12:11:14,251 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-17 12:11:14,253 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-17 12:11:15,090 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689595867847_0001_000001 (auth:SIMPLE) 2023-07-17 12:11:15,371 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-17 12:11:20,358 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689595867847_0001_000001 (auth:SIMPLE) 2023-07-17 12:11:22,684 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689595867847_0001_000001 (auth:SIMPLE) 2023-07-17 12:11:25,824 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689595867847_0001_000001 (auth:SIMPLE) 2023-07-17 12:11:27,737 INFO [Listener at jenkins-hbase4.apache.org/44127] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-17 12:11:27,739 INFO [Listener at jenkins-hbase4.apache.org/44127] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-17 12:11:27,754 INFO [Listener at jenkins-hbase4.apache.org/44127] snapshot.ExportSnapshot(1127): Export Completed: testExportWithTargetName 2023-07-17 12:11:27,755 INFO [Listener at jenkins-hbase4.apache.org/44127] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-17 12:11:27,755 INFO [Listener at jenkins-hbase4.apache.org/44127] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-17 12:11:27,756 DEBUG [Listener at jenkins-hbase4.apache.org/44127] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1847813108_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.hbase-snapshot/snaptb0-testExportWithTargetName at hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-07-17 12:11:27,756 DEBUG [Listener at jenkins-hbase4.apache.org/44127] snapshot.TestExportSnapshot(367): hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.hbase-snapshot/snaptb0-testExportWithTargetName/.snapshotinfo 2023-07-17 12:11:27,757 DEBUG [Listener at jenkins-hbase4.apache.org/44127] snapshot.TestExportSnapshot(367): hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.hbase-snapshot/snaptb0-testExportWithTargetName/data.manifest 2023-07-17 12:11:27,757 DEBUG [Listener at jenkins-hbase4.apache.org/44127] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1847813108_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/export-test/export-1689595871978/.hbase-snapshot/testExportWithTargetName at hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/export-test/export-1689595871978/.hbase-snapshot/testExportWithTargetName 2023-07-17 12:11:27,757 DEBUG [Listener at jenkins-hbase4.apache.org/44127] snapshot.TestExportSnapshot(367): hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/export-test/export-1689595871978/.hbase-snapshot/testExportWithTargetName/.snapshotinfo 2023-07-17 12:11:27,757 DEBUG [Listener at jenkins-hbase4.apache.org/44127] snapshot.TestExportSnapshot(367): hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/export-test/export-1689595871978/.hbase-snapshot/testExportWithTargetName/data.manifest 2023-07-17 12:11:27,769 INFO [Listener at jenkins-hbase4.apache.org/44127] client.HBaseAdmin$15(890): Started disable of testtb-testExportWithTargetName 2023-07-17 12:11:27,774 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42013] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportWithTargetName 2023-07-17 12:11:27,782 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42013] procedure2.ProcedureExecutor(1029): Stored pid=21, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportWithTargetName 2023-07-17 12:11:27,787 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689595887787"}]},"ts":"1689595887787"} 2023-07-17 12:11:27,788 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42013] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-17 12:11:27,789 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLING in hbase:meta 2023-07-17 12:11:27,868 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testExportWithTargetName to state=DISABLING 2023-07-17 12:11:27,870 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=5db0803f609624bbe92bd4b0a80c58bd, UNASSIGN}, {pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=9b743b0f32a0fb2da34db5cb35625561, UNASSIGN}] 2023-07-17 12:11:27,873 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=5db0803f609624bbe92bd4b0a80c58bd, UNASSIGN 2023-07-17 12:11:27,873 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=9b743b0f32a0fb2da34db5cb35625561, UNASSIGN 2023-07-17 12:11:27,874 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=5db0803f609624bbe92bd4b0a80c58bd, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:11:27,874 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=9b743b0f32a0fb2da34db5cb35625561, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:11:27,874 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1689595869343.5db0803f609624bbe92bd4b0a80c58bd.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689595887874"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689595887874"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689595887874"}]},"ts":"1689595887874"} 2023-07-17 12:11:27,874 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1689595869343.9b743b0f32a0fb2da34db5cb35625561.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689595887874"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689595887874"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689595887874"}]},"ts":"1689595887874"} 2023-07-17 12:11:27,876 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=22, state=RUNNABLE; CloseRegionProcedure 5db0803f609624bbe92bd4b0a80c58bd, server=jenkins-hbase4.apache.org,39491,1689595859788}] 2023-07-17 12:11:27,877 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=23, state=RUNNABLE; CloseRegionProcedure 9b743b0f32a0fb2da34db5cb35625561, server=jenkins-hbase4.apache.org,33685,1689595859854}] 2023-07-17 12:11:27,889 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42013] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-17 12:11:28,037 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 9b743b0f32a0fb2da34db5cb35625561 2023-07-17 12:11:28,037 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 5db0803f609624bbe92bd4b0a80c58bd 2023-07-17 12:11:28,037 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 9b743b0f32a0fb2da34db5cb35625561, disabling compactions & flushes 2023-07-17 12:11:28,037 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 5db0803f609624bbe92bd4b0a80c58bd, disabling compactions & flushes 2023-07-17 12:11:28,037 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1689595869343.9b743b0f32a0fb2da34db5cb35625561. 2023-07-17 12:11:28,037 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1689595869343.5db0803f609624bbe92bd4b0a80c58bd. 2023-07-17 12:11:28,037 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1689595869343.9b743b0f32a0fb2da34db5cb35625561. 2023-07-17 12:11:28,037 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1689595869343.5db0803f609624bbe92bd4b0a80c58bd. 2023-07-17 12:11:28,037 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1689595869343.9b743b0f32a0fb2da34db5cb35625561. after waiting 0 ms 2023-07-17 12:11:28,037 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1689595869343.5db0803f609624bbe92bd4b0a80c58bd. after waiting 0 ms 2023-07-17 12:11:28,037 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1689595869343.9b743b0f32a0fb2da34db5cb35625561. 2023-07-17 12:11:28,038 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1689595869343.5db0803f609624bbe92bd4b0a80c58bd. 2023-07-17 12:11:28,055 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/default/testtb-testExportWithTargetName/5db0803f609624bbe92bd4b0a80c58bd/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-17 12:11:28,055 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/default/testtb-testExportWithTargetName/9b743b0f32a0fb2da34db5cb35625561/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-17 12:11:28,056 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-17 12:11:28,056 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-17 12:11:28,057 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1689595869343.5db0803f609624bbe92bd4b0a80c58bd. 2023-07-17 12:11:28,057 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 5db0803f609624bbe92bd4b0a80c58bd: 2023-07-17 12:11:28,058 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1689595869343.9b743b0f32a0fb2da34db5cb35625561. 2023-07-17 12:11:28,058 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 9b743b0f32a0fb2da34db5cb35625561: 2023-07-17 12:11:28,061 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 9b743b0f32a0fb2da34db5cb35625561 2023-07-17 12:11:28,061 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=9b743b0f32a0fb2da34db5cb35625561, regionState=CLOSED 2023-07-17 12:11:28,062 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1689595869343.9b743b0f32a0fb2da34db5cb35625561.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689595888061"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689595888061"}]},"ts":"1689595888061"} 2023-07-17 12:11:28,062 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 5db0803f609624bbe92bd4b0a80c58bd 2023-07-17 12:11:28,062 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=5db0803f609624bbe92bd4b0a80c58bd, regionState=CLOSED 2023-07-17 12:11:28,063 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1689595869343.5db0803f609624bbe92bd4b0a80c58bd.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689595888062"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689595888062"}]},"ts":"1689595888062"} 2023-07-17 12:11:28,068 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=23 2023-07-17 12:11:28,068 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=23, state=SUCCESS; CloseRegionProcedure 9b743b0f32a0fb2da34db5cb35625561, server=jenkins-hbase4.apache.org,33685,1689595859854 in 187 msec 2023-07-17 12:11:28,069 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=22 2023-07-17 12:11:28,069 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=22, state=SUCCESS; CloseRegionProcedure 5db0803f609624bbe92bd4b0a80c58bd, server=jenkins-hbase4.apache.org,39491,1689595859788 in 189 msec 2023-07-17 12:11:28,069 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=9b743b0f32a0fb2da34db5cb35625561, UNASSIGN in 198 msec 2023-07-17 12:11:28,071 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=22, resume processing ppid=21 2023-07-17 12:11:28,071 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=5db0803f609624bbe92bd4b0a80c58bd, UNASSIGN in 199 msec 2023-07-17 12:11:28,072 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689595888072"}]},"ts":"1689595888072"} 2023-07-17 12:11:28,074 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLED in hbase:meta 2023-07-17 12:11:28,090 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42013] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-17 12:11:28,129 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testExportWithTargetName to state=DISABLED 2023-07-17 12:11:28,133 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=21, state=SUCCESS; DisableTableProcedure table=testtb-testExportWithTargetName in 354 msec 2023-07-17 12:11:28,391 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42013] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-17 12:11:28,391 INFO [Listener at jenkins-hbase4.apache.org/44127] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportWithTargetName, procId: 21 completed 2023-07-17 12:11:28,396 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42013] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportWithTargetName 2023-07-17 12:11:28,403 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42013] procedure2.ProcedureExecutor(1029): Stored pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-17 12:11:28,406 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-17 12:11:28,407 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42013] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportWithTargetName 2023-07-17 12:11:28,408 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=26, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-17 12:11:28,412 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39491] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportWithTargetName 2023-07-17 12:11:28,415 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.tmp/data/default/testtb-testExportWithTargetName/5db0803f609624bbe92bd4b0a80c58bd 2023-07-17 12:11:28,415 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.tmp/data/default/testtb-testExportWithTargetName/9b743b0f32a0fb2da34db5cb35625561 2023-07-17 12:11:28,418 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.tmp/data/default/testtb-testExportWithTargetName/9b743b0f32a0fb2da34db5cb35625561/cf, FileablePath, hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.tmp/data/default/testtb-testExportWithTargetName/9b743b0f32a0fb2da34db5cb35625561/recovered.edits] 2023-07-17 12:11:28,418 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.tmp/data/default/testtb-testExportWithTargetName/5db0803f609624bbe92bd4b0a80c58bd/cf, FileablePath, hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.tmp/data/default/testtb-testExportWithTargetName/5db0803f609624bbe92bd4b0a80c58bd/recovered.edits] 2023-07-17 12:11:28,426 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.tmp/data/default/testtb-testExportWithTargetName/5db0803f609624bbe92bd4b0a80c58bd/cf/55545261169743a69680571b6abb51cb to hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/archive/data/default/testtb-testExportWithTargetName/5db0803f609624bbe92bd4b0a80c58bd/cf/55545261169743a69680571b6abb51cb 2023-07-17 12:11:28,426 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.tmp/data/default/testtb-testExportWithTargetName/9b743b0f32a0fb2da34db5cb35625561/cf/dcb35c47078c427db851fe9db2a5fa07 to hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/archive/data/default/testtb-testExportWithTargetName/9b743b0f32a0fb2da34db5cb35625561/cf/dcb35c47078c427db851fe9db2a5fa07 2023-07-17 12:11:28,430 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.tmp/data/default/testtb-testExportWithTargetName/5db0803f609624bbe92bd4b0a80c58bd/recovered.edits/9.seqid to hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/archive/data/default/testtb-testExportWithTargetName/5db0803f609624bbe92bd4b0a80c58bd/recovered.edits/9.seqid 2023-07-17 12:11:28,431 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.tmp/data/default/testtb-testExportWithTargetName/9b743b0f32a0fb2da34db5cb35625561/recovered.edits/9.seqid to hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/archive/data/default/testtb-testExportWithTargetName/9b743b0f32a0fb2da34db5cb35625561/recovered.edits/9.seqid 2023-07-17 12:11:28,431 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.tmp/data/default/testtb-testExportWithTargetName/5db0803f609624bbe92bd4b0a80c58bd 2023-07-17 12:11:28,431 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.tmp/data/default/testtb-testExportWithTargetName/9b743b0f32a0fb2da34db5cb35625561 2023-07-17 12:11:28,431 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-07-17 12:11:28,432 DEBUG [PEWorker-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-07-17 12:11:28,433 DEBUG [PEWorker-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf] 2023-07-17 12:11:28,437 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b202307173bbba833f9f14b75bcdb8c8de1d72e09 to hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b202307173bbba833f9f14b75bcdb8c8de1d72e09 2023-07-17 12:11:28,439 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230717aa474b3ee7224df398470eba5e2ab0dd to hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230717aa474b3ee7224df398470eba5e2ab0dd 2023-07-17 12:11:28,439 DEBUG [PEWorker-4] backup.HFileArchiver(596): Deleted hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-07-17 12:11:28,443 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=26, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-17 12:11:28,464 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportWithTargetName from hbase:meta 2023-07-17 12:11:28,467 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportWithTargetName' descriptor. 2023-07-17 12:11:28,468 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=26, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-17 12:11:28,468 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportWithTargetName' from region states. 2023-07-17 12:11:28,469 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,,1689595869343.5db0803f609624bbe92bd4b0a80c58bd.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689595888468"}]},"ts":"9223372036854775807"} 2023-07-17 12:11:28,469 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,1,1689595869343.9b743b0f32a0fb2da34db5cb35625561.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689595888468"}]},"ts":"9223372036854775807"} 2023-07-17 12:11:28,471 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-17 12:11:28,471 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 5db0803f609624bbe92bd4b0a80c58bd, NAME => 'testtb-testExportWithTargetName,,1689595869343.5db0803f609624bbe92bd4b0a80c58bd.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 9b743b0f32a0fb2da34db5cb35625561, NAME => 'testtb-testExportWithTargetName,1,1689595869343.9b743b0f32a0fb2da34db5cb35625561.', STARTKEY => '1', ENDKEY => ''}] 2023-07-17 12:11:28,471 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportWithTargetName' as deleted. 2023-07-17 12:11:28,471 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689595888471"}]},"ts":"9223372036854775807"} 2023-07-17 12:11:28,473 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportWithTargetName state from META 2023-07-17 12:11:28,537 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:42615-0x10173314c9f0003, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-17 12:11:28,539 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:33685-0x10173314c9f0002, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-17 12:11:28,537 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-17 12:11:28,537 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:39491-0x10173314c9f0001, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-17 12:11:28,592 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-07-17 12:11:28,592 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-07-17 12:11:28,592 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-07-17 12:11:28,592 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-07-17 12:11:28,593 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=26, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-17 12:11:28,596 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=26, state=SUCCESS; DeleteTableProcedure table=testtb-testExportWithTargetName in 197 msec 2023-07-17 12:11:28,614 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:39491-0x10173314c9f0001, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-17 12:11:28,614 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:33685-0x10173314c9f0002, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-17 12:11:28,614 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:39491-0x10173314c9f0001, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 12:11:28,614 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:33685-0x10173314c9f0002, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 12:11:28,614 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-17 12:11:28,614 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:42615-0x10173314c9f0003, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-17 12:11:28,614 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 12:11:28,614 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:42615-0x10173314c9f0003, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 12:11:28,617 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42013] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-07-17 12:11:28,617 INFO [Listener at jenkins-hbase4.apache.org/44127] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportWithTargetName, procId: 26 completed 2023-07-17 12:11:28,638 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42013] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportWithTargetName" 2023-07-17 12:11:28,642 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42013] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportWithTargetName 2023-07-17 12:11:28,646 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42013] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportWithTargetName" 2023-07-17 12:11:28,649 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42013] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportWithTargetName 2023-07-17 12:11:28,682 INFO [Listener at jenkins-hbase4.apache.org/44127] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=749 (was 704) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,33685,1689595859854' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MutableQuantiles-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1847813108_17 at /127.0.0.1:54996 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1abcf153-shared-pool-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,39491,1689595859788' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58af5705-0594-af5f-981c-fa1d3b267fab/cluster_dbe17dd1-5343-f0e6-c8ea-53484480c8b1/dfs/data/data5/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1315 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: ContainersLauncher #0 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.read1(BufferedReader.java:212) java.io.BufferedReader.read(BufferedReader.java:286) org.apache.hadoop.util.Shell$ShellCommandExecutor.parseExecResult(Shell.java:1229) org.apache.hadoop.util.Shell.runCommand(Shell.java:984) org.apache.hadoop.util.Shell.run(Shell.java:884) org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:1216) org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:294) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.launchContainer(ContainerLaunch.java:442) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:293) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:97) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1abcf153-shared-pool-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (232395425) connection to jenkins-hbase4.apache.org/172.31.14.131:45685 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_292359505_1 at /127.0.0.1:34594 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1abcf153-shared-pool-11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Container metrics unregistration java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: hconnection-0x1abcf153-shared-pool-12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58af5705-0594-af5f-981c-fa1d3b267fab/cluster_dbe17dd1-5343-f0e6-c8ea-53484480c8b1/dfs/data/data4/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1847813108_17 at /127.0.0.1:56132 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58af5705-0594-af5f-981c-fa1d3b267fab/cluster_dbe17dd1-5343-f0e6-c8ea-53484480c8b1/dfs/data/data3/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58af5705-0594-af5f-981c-fa1d3b267fab/cluster_dbe17dd1-5343-f0e6-c8ea-53484480c8b1/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58af5705-0594-af5f-981c-fa1d3b267fab/cluster_dbe17dd1-5343-f0e6-c8ea-53484480c8b1/dfs/data/data6/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (232395425) connection to jenkins-hbase4.apache.org/172.31.14.131:35259 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_292359505_1 at /127.0.0.1:56106 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1847813108_17 at /127.0.0.1:34630 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58af5705-0594-af5f-981c-fa1d3b267fab/cluster_dbe17dd1-5343-f0e6-c8ea-53484480c8b1/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=921 (was 913) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=490 (was 403) - SystemLoadAverage LEAK? -, ProcessCount=180 (was 174) - ProcessCount LEAK? -, AvailableMemoryMB=3135 (was 4913) 2023-07-17 12:11:28,682 WARN [Listener at jenkins-hbase4.apache.org/44127] hbase.ResourceChecker(130): Thread=749 is superior to 500 2023-07-17 12:11:28,706 INFO [Listener at jenkins-hbase4.apache.org/44127] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=749, OpenFileDescriptor=921, MaxFileDescriptor=60000, SystemLoadAverage=490, ProcessCount=180, AvailableMemoryMB=3134 2023-07-17 12:11:28,706 WARN [Listener at jenkins-hbase4.apache.org/44127] hbase.ResourceChecker(130): Thread=749 is superior to 500 2023-07-17 12:11:28,708 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42013] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-17 12:11:28,715 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42013] procedure2.ProcedureExecutor(1029): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemState 2023-07-17 12:11:28,718 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-07-17 12:11:28,719 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42013] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemState" procId is: 27 2023-07-17 12:11:28,720 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42013] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-17 12:11:28,720 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-17 12:11:28,723 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.tmp/data/default/testtb-testExportFileSystemState/734a9db668b8b752d63047284f69df2b 2023-07-17 12:11:28,723 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.tmp/data/default/testtb-testExportFileSystemState/640e2611f74902bc48c62a5c712524fc 2023-07-17 12:11:28,724 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.tmp/data/default/testtb-testExportFileSystemState/640e2611f74902bc48c62a5c712524fc empty. 2023-07-17 12:11:28,724 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.tmp/data/default/testtb-testExportFileSystemState/734a9db668b8b752d63047284f69df2b empty. 2023-07-17 12:11:28,725 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.tmp/data/default/testtb-testExportFileSystemState/640e2611f74902bc48c62a5c712524fc 2023-07-17 12:11:28,725 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.tmp/data/default/testtb-testExportFileSystemState/734a9db668b8b752d63047284f69df2b 2023-07-17 12:11:28,725 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-07-17 12:11:28,748 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.tmp/data/default/testtb-testExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-07-17 12:11:28,752 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 734a9db668b8b752d63047284f69df2b, NAME => 'testtb-testExportFileSystemState,,1689595888708.734a9db668b8b752d63047284f69df2b.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.tmp 2023-07-17 12:11:28,756 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => 640e2611f74902bc48c62a5c712524fc, NAME => 'testtb-testExportFileSystemState,1,1689595888708.640e2611f74902bc48c62a5c712524fc.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.tmp 2023-07-17 12:11:28,779 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1689595888708.640e2611f74902bc48c62a5c712524fc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 12:11:28,779 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing 640e2611f74902bc48c62a5c712524fc, disabling compactions & flushes 2023-07-17 12:11:28,779 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1689595888708.640e2611f74902bc48c62a5c712524fc. 2023-07-17 12:11:28,779 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1689595888708.640e2611f74902bc48c62a5c712524fc. 2023-07-17 12:11:28,779 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1689595888708.640e2611f74902bc48c62a5c712524fc. after waiting 0 ms 2023-07-17 12:11:28,779 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1689595888708.640e2611f74902bc48c62a5c712524fc. 2023-07-17 12:11:28,779 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1689595888708.640e2611f74902bc48c62a5c712524fc. 2023-07-17 12:11:28,779 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for 640e2611f74902bc48c62a5c712524fc: 2023-07-17 12:11:28,822 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42013] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-17 12:11:29,024 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42013] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-17 12:11:29,172 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1689595888708.734a9db668b8b752d63047284f69df2b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 12:11:29,172 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 734a9db668b8b752d63047284f69df2b, disabling compactions & flushes 2023-07-17 12:11:29,172 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1689595888708.734a9db668b8b752d63047284f69df2b. 2023-07-17 12:11:29,172 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1689595888708.734a9db668b8b752d63047284f69df2b. 2023-07-17 12:11:29,172 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1689595888708.734a9db668b8b752d63047284f69df2b. after waiting 0 ms 2023-07-17 12:11:29,172 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1689595888708.734a9db668b8b752d63047284f69df2b. 2023-07-17 12:11:29,172 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1689595888708.734a9db668b8b752d63047284f69df2b. 2023-07-17 12:11:29,172 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 734a9db668b8b752d63047284f69df2b: 2023-07-17 12:11:29,175 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-07-17 12:11:29,176 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1689595888708.640e2611f74902bc48c62a5c712524fc.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689595889176"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689595889176"}]},"ts":"1689595889176"} 2023-07-17 12:11:29,176 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1689595888708.734a9db668b8b752d63047284f69df2b.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689595889176"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689595889176"}]},"ts":"1689595889176"} 2023-07-17 12:11:29,179 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-17 12:11:29,180 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-17 12:11:29,180 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689595889180"}]},"ts":"1689595889180"} 2023-07-17 12:11:29,182 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLING in hbase:meta 2023-07-17 12:11:29,252 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-17 12:11:29,254 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-17 12:11:29,254 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-17 12:11:29,254 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-17 12:11:29,255 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-17 12:11:29,255 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=734a9db668b8b752d63047284f69df2b, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=640e2611f74902bc48c62a5c712524fc, ASSIGN}] 2023-07-17 12:11:29,258 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=734a9db668b8b752d63047284f69df2b, ASSIGN 2023-07-17 12:11:29,258 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=640e2611f74902bc48c62a5c712524fc, ASSIGN 2023-07-17 12:11:29,259 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=734a9db668b8b752d63047284f69df2b, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42615,1689595859906; forceNewPlan=false, retain=false 2023-07-17 12:11:29,259 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=640e2611f74902bc48c62a5c712524fc, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39491,1689595859788; forceNewPlan=false, retain=false 2023-07-17 12:11:29,326 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42013] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-17 12:11:29,410 INFO [jenkins-hbase4:42013] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-17 12:11:29,412 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=640e2611f74902bc48c62a5c712524fc, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:11:29,412 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=734a9db668b8b752d63047284f69df2b, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:11:29,413 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1689595888708.640e2611f74902bc48c62a5c712524fc.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689595889412"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689595889412"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689595889412"}]},"ts":"1689595889412"} 2023-07-17 12:11:29,413 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1689595888708.734a9db668b8b752d63047284f69df2b.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689595889412"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689595889412"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689595889412"}]},"ts":"1689595889412"} 2023-07-17 12:11:29,415 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=29, state=RUNNABLE; OpenRegionProcedure 640e2611f74902bc48c62a5c712524fc, server=jenkins-hbase4.apache.org,39491,1689595859788}] 2023-07-17 12:11:29,416 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=31, ppid=28, state=RUNNABLE; OpenRegionProcedure 734a9db668b8b752d63047284f69df2b, server=jenkins-hbase4.apache.org,42615,1689595859906}] 2023-07-17 12:11:29,570 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:11:29,570 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-17 12:11:29,574 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39060, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-17 12:11:29,575 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,1,1689595888708.640e2611f74902bc48c62a5c712524fc. 2023-07-17 12:11:29,576 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 640e2611f74902bc48c62a5c712524fc, NAME => 'testtb-testExportFileSystemState,1,1689595888708.640e2611f74902bc48c62a5c712524fc.', STARTKEY => '1', ENDKEY => ''} 2023-07-17 12:11:29,576 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,1,1689595888708.640e2611f74902bc48c62a5c712524fc. service=AccessControlService 2023-07-17 12:11:29,577 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-17 12:11:29,578 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 640e2611f74902bc48c62a5c712524fc 2023-07-17 12:11:29,578 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1689595888708.640e2611f74902bc48c62a5c712524fc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 12:11:29,578 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 640e2611f74902bc48c62a5c712524fc 2023-07-17 12:11:29,579 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 640e2611f74902bc48c62a5c712524fc 2023-07-17 12:11:29,581 INFO [StoreOpener-640e2611f74902bc48c62a5c712524fc-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 640e2611f74902bc48c62a5c712524fc 2023-07-17 12:11:29,582 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,,1689595888708.734a9db668b8b752d63047284f69df2b. 2023-07-17 12:11:29,582 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 734a9db668b8b752d63047284f69df2b, NAME => 'testtb-testExportFileSystemState,,1689595888708.734a9db668b8b752d63047284f69df2b.', STARTKEY => '', ENDKEY => '1'} 2023-07-17 12:11:29,582 DEBUG [StoreOpener-640e2611f74902bc48c62a5c712524fc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/default/testtb-testExportFileSystemState/640e2611f74902bc48c62a5c712524fc/cf 2023-07-17 12:11:29,582 DEBUG [StoreOpener-640e2611f74902bc48c62a5c712524fc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/default/testtb-testExportFileSystemState/640e2611f74902bc48c62a5c712524fc/cf 2023-07-17 12:11:29,583 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,,1689595888708.734a9db668b8b752d63047284f69df2b. service=AccessControlService 2023-07-17 12:11:29,583 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-17 12:11:29,583 INFO [StoreOpener-640e2611f74902bc48c62a5c712524fc-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 640e2611f74902bc48c62a5c712524fc columnFamilyName cf 2023-07-17 12:11:29,583 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 734a9db668b8b752d63047284f69df2b 2023-07-17 12:11:29,583 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1689595888708.734a9db668b8b752d63047284f69df2b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 12:11:29,583 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 734a9db668b8b752d63047284f69df2b 2023-07-17 12:11:29,583 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 734a9db668b8b752d63047284f69df2b 2023-07-17 12:11:29,585 INFO [StoreOpener-734a9db668b8b752d63047284f69df2b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 734a9db668b8b752d63047284f69df2b 2023-07-17 12:11:29,586 INFO [StoreOpener-640e2611f74902bc48c62a5c712524fc-1] regionserver.HStore(310): Store=640e2611f74902bc48c62a5c712524fc/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-17 12:11:29,587 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/default/testtb-testExportFileSystemState/640e2611f74902bc48c62a5c712524fc 2023-07-17 12:11:29,588 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/default/testtb-testExportFileSystemState/640e2611f74902bc48c62a5c712524fc 2023-07-17 12:11:29,588 DEBUG [StoreOpener-734a9db668b8b752d63047284f69df2b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/default/testtb-testExportFileSystemState/734a9db668b8b752d63047284f69df2b/cf 2023-07-17 12:11:29,588 DEBUG [StoreOpener-734a9db668b8b752d63047284f69df2b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/default/testtb-testExportFileSystemState/734a9db668b8b752d63047284f69df2b/cf 2023-07-17 12:11:29,589 INFO [StoreOpener-734a9db668b8b752d63047284f69df2b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 734a9db668b8b752d63047284f69df2b columnFamilyName cf 2023-07-17 12:11:29,590 INFO [StoreOpener-734a9db668b8b752d63047284f69df2b-1] regionserver.HStore(310): Store=734a9db668b8b752d63047284f69df2b/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-17 12:11:29,591 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/default/testtb-testExportFileSystemState/734a9db668b8b752d63047284f69df2b 2023-07-17 12:11:29,592 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/default/testtb-testExportFileSystemState/734a9db668b8b752d63047284f69df2b 2023-07-17 12:11:29,593 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 640e2611f74902bc48c62a5c712524fc 2023-07-17 12:11:29,595 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/default/testtb-testExportFileSystemState/640e2611f74902bc48c62a5c712524fc/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-17 12:11:29,596 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 640e2611f74902bc48c62a5c712524fc; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67287532, jitterRate=0.002662360668182373}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-17 12:11:29,596 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 640e2611f74902bc48c62a5c712524fc: 2023-07-17 12:11:29,596 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 734a9db668b8b752d63047284f69df2b 2023-07-17 12:11:29,597 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,1,1689595888708.640e2611f74902bc48c62a5c712524fc., pid=30, masterSystemTime=1689595889567 2023-07-17 12:11:29,604 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,1,1689595888708.640e2611f74902bc48c62a5c712524fc. 2023-07-17 12:11:29,605 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,1,1689595888708.640e2611f74902bc48c62a5c712524fc. 2023-07-17 12:11:29,605 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=640e2611f74902bc48c62a5c712524fc, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:11:29,606 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/default/testtb-testExportFileSystemState/734a9db668b8b752d63047284f69df2b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-17 12:11:29,606 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,1,1689595888708.640e2611f74902bc48c62a5c712524fc.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689595889605"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689595889605"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689595889605"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689595889605"}]},"ts":"1689595889605"} 2023-07-17 12:11:29,607 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 734a9db668b8b752d63047284f69df2b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67106669, jitterRate=-3.2708048820495605E-5}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-17 12:11:29,607 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 734a9db668b8b752d63047284f69df2b: 2023-07-17 12:11:29,608 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,,1689595888708.734a9db668b8b752d63047284f69df2b., pid=31, masterSystemTime=1689595889570 2023-07-17 12:11:29,612 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,,1689595888708.734a9db668b8b752d63047284f69df2b. 2023-07-17 12:11:29,614 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,,1689595888708.734a9db668b8b752d63047284f69df2b. 2023-07-17 12:11:29,614 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=734a9db668b8b752d63047284f69df2b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:11:29,615 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,,1689595888708.734a9db668b8b752d63047284f69df2b.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689595889614"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689595889614"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689595889614"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689595889614"}]},"ts":"1689595889614"} 2023-07-17 12:11:29,616 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=29 2023-07-17 12:11:29,616 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=29, state=SUCCESS; OpenRegionProcedure 640e2611f74902bc48c62a5c712524fc, server=jenkins-hbase4.apache.org,39491,1689595859788 in 195 msec 2023-07-17 12:11:29,618 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=640e2611f74902bc48c62a5c712524fc, ASSIGN in 361 msec 2023-07-17 12:11:29,622 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=31, resume processing ppid=28 2023-07-17 12:11:29,627 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=31, ppid=28, state=SUCCESS; OpenRegionProcedure 734a9db668b8b752d63047284f69df2b, server=jenkins-hbase4.apache.org,42615,1689595859906 in 201 msec 2023-07-17 12:11:29,633 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=28, resume processing ppid=27 2023-07-17 12:11:29,633 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=734a9db668b8b752d63047284f69df2b, ASSIGN in 373 msec 2023-07-17 12:11:29,634 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-17 12:11:29,635 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689595889634"}]},"ts":"1689595889634"} 2023-07-17 12:11:29,638 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLED in hbase:meta 2023-07-17 12:11:29,642 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-07-17 12:11:29,642 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemState jenkins: RWXCA 2023-07-17 12:11:29,644 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39491] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-17 12:11:29,646 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:33685-0x10173314c9f0002, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 12:11:29,646 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:42615-0x10173314c9f0003, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 12:11:29,646 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 12:11:29,646 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:39491-0x10173314c9f0001, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 12:11:29,648 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-17 12:11:29,648 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:33685-0x10173314c9f0002, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-17 12:11:29,648 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-17 12:11:29,648 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-17 12:11:29,649 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-17 12:11:29,649 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-17 12:11:29,651 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemState in 939 msec 2023-07-17 12:11:29,827 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42013] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-17 12:11:29,827 INFO [Listener at jenkins-hbase4.apache.org/44127] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemState, procId: 27 completed 2023-07-17 12:11:29,831 DEBUG [Listener at jenkins-hbase4.apache.org/44127] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-07-17 12:11:29,831 DEBUG [Listener at jenkins-hbase4.apache.org/44127] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1689595888708.734a9db668b8b752d63047284f69df2b. 2023-07-17 12:11:29,833 INFO [Listener at jenkins-hbase4.apache.org/44127] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-17 12:11:29,845 DEBUG [hconnection-0x14eacf93-shared-pool-10] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 12:11:29,850 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39070, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 12:11:29,857 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42013] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-17 12:11:29,857 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42013] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689595889857 (current time:1689595889857). 2023-07-17 12:11:29,857 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42013] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-17 12:11:29,857 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42013] zookeeper.ReadOnlyZKClient(139): Connect 0x1e1d6cd6 to 127.0.0.1:55622 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-17 12:11:29,867 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42013] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@9c92312, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-17 12:11:29,868 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42013] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 12:11:29,870 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58452, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 12:11:29,871 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42013] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1e1d6cd6 to 127.0.0.1:55622 2023-07-17 12:11:29,871 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42013] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 12:11:29,872 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42013] zookeeper.ReadOnlyZKClient(139): Connect 0x4887b2af to 127.0.0.1:55622 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-17 12:11:29,879 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42013] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3d091cb5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-17 12:11:29,884 DEBUG [hconnection-0x7d1869b5-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 12:11:29,888 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58460, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 12:11:29,894 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42013] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 12:11:29,895 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:32992, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 12:11:29,897 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42013] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4887b2af to 127.0.0.1:55622 2023-07-17 12:11:29,897 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42013] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 12:11:29,898 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42013] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-17 12:11:29,899 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42013] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-17 12:11:29,899 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42013] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-17 12:11:29,902 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42013] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-17 12:11:29,904 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-17 12:11:29,905 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689596489905 2023-07-17 12:11:29,905 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-07-17 12:11:29,905 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42013] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-17 12:11:29,907 DEBUG [Listener at jenkins-hbase4.apache.org/44127] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-17 12:11:29,908 DEBUG [Listener at jenkins-hbase4.apache.org/44127] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-17 12:11:29,916 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-17 12:11:29,916 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-17 12:11:29,920 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 15 msec 2023-07-17 12:11:29,922 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-17 12:11:29,923 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=33, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689596489923 2023-07-17 12:11:29,938 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemState 2023-07-17 12:11:29,938 INFO [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemState' 2023-07-17 12:11:29,938 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 12:11:29,940 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' 2023-07-17 12:11:29,940 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-07-17 12:11:29,941 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-17 12:11:29,941 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-17 12:11:29,945 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:11:29,945 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:39491-0x10173314c9f0001, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 12:11:29,945 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:42615-0x10173314c9f0003, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 12:11:29,945 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:33685-0x10173314c9f0002, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 12:11:29,945 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 12:11:29,945 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 12:11:29,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 12:11:29,945 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 12:11:29,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 12:11:29,946 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:11:29,946 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:11:29,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 12:11:29,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-17 12:11:29,946 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:11:29,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-17 12:11:29,946 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-17 12:11:29,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-17 12:11:29,946 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33685-0x10173314c9f0002, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-17 12:11:29,947 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42615-0x10173314c9f0003, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-17 12:11:29,947 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39491-0x10173314c9f0001, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-17 12:11:29,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-17 12:11:29,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-17 12:11:29,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-17 12:11:29,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-17 12:11:29,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-17 12:11:29,947 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-17 12:11:29,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-17 12:11:29,947 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-17 12:11:29,947 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-17 12:11:29,948 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-17 12:11:29,948 DEBUG [member: 'jenkins-hbase4.apache.org,33685,1689595859854' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-17 12:11:29,948 DEBUG [member: 'jenkins-hbase4.apache.org,33685,1689595859854' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 12:11:29,949 DEBUG [member: 'jenkins-hbase4.apache.org,33685,1689595859854' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-17 12:11:29,949 DEBUG [member: 'jenkins-hbase4.apache.org,33685,1689595859854' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-17 12:11:29,949 DEBUG [member: 'jenkins-hbase4.apache.org,33685,1689595859854' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33685,1689595859854' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-17 12:11:29,949 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-17 12:11:29,950 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-17 12:11:29,950 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-17 12:11:29,950 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 12:11:29,950 DEBUG [member: 'jenkins-hbase4.apache.org,39491,1689595859788' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-17 12:11:29,951 DEBUG [member: 'jenkins-hbase4.apache.org,39491,1689595859788' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 12:11:29,951 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-17 12:11:29,951 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-17 12:11:29,951 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42615,1689595859906' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-17 12:11:29,953 DEBUG [member: 'jenkins-hbase4.apache.org,39491,1689595859788' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-17 12:11:29,953 DEBUG [member: 'jenkins-hbase4.apache.org,39491,1689595859788' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-17 12:11:29,953 DEBUG [member: 'jenkins-hbase4.apache.org,39491,1689595859788' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39491,1689595859788' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-17 12:11:29,954 DEBUG [member: 'jenkins-hbase4.apache.org,33685,1689595859854' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-17 12:11:29,954 DEBUG [member: 'jenkins-hbase4.apache.org,33685,1689595859854' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33685-0x10173314c9f0002, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-17 12:11:29,954 DEBUG [member: 'jenkins-hbase4.apache.org,33685,1689595859854' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 12:11:29,960 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-17 12:11:29,960 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:11:29,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:11:29,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 12:11:29,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 12:11:29,961 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:11:29,961 DEBUG [member: 'jenkins-hbase4.apache.org,39491,1689595859788' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-17 12:11:29,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 12:11:29,961 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42615-0x10173314c9f0003, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-17 12:11:29,961 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 12:11:29,961 DEBUG [member: 'jenkins-hbase4.apache.org,39491,1689595859788' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39491-0x10173314c9f0001, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-17 12:11:29,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 12:11:29,961 DEBUG [member: 'jenkins-hbase4.apache.org,39491,1689595859788' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 12:11:29,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-17 12:11:29,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:11:29,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:11:29,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:11:29,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 12:11:29,964 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42615,1689595859906' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-07-17 12:11:29,964 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1a093e3a[Count = 1] remaining members to acquire global barrier 2023-07-17 12:11:29,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:11:29,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 12:11:29,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 12:11:29,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 12:11:29,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 12:11:29,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-17 12:11:29,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:11:29,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:11:29,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:11:29,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 12:11:29,967 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39491,1689595859788' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-07-17 12:11:29,967 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1a093e3a[Count = 0] remaining members to acquire global barrier 2023-07-17 12:11:29,967 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-07-17 12:11:29,967 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-17 12:11:29,968 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:33685-0x10173314c9f0002, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-17 12:11:29,968 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:39491-0x10173314c9f0001, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-17 12:11:29,968 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:42615-0x10173314c9f0003, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-17 12:11:29,968 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-17 12:11:29,968 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-17 12:11:29,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-17 12:11:29,968 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-17 12:11:29,968 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-17 12:11:29,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-17 12:11:29,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-17 12:11:29,968 DEBUG [member: 'jenkins-hbase4.apache.org,33685,1689595859854' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-17 12:11:29,969 DEBUG [member: 'jenkins-hbase4.apache.org,33685,1689595859854' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-17 12:11:29,969 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:11:29,968 DEBUG [member: 'jenkins-hbase4.apache.org,39491,1689595859788' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-17 12:11:29,969 DEBUG [member: 'jenkins-hbase4.apache.org,33685,1689595859854' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,33685,1689595859854' in zk 2023-07-17 12:11:29,969 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-17 12:11:29,969 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-17 12:11:29,969 DEBUG [rs(jenkins-hbase4.apache.org,42615,1689595859906)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1689595888708.734a9db668b8b752d63047284f69df2b. 2023-07-17 12:11:29,969 DEBUG [rs(jenkins-hbase4.apache.org,42615,1689595859906)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1689595888708.734a9db668b8b752d63047284f69df2b. started... 2023-07-17 12:11:29,969 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:11:29,969 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-17 12:11:29,970 DEBUG [member: 'jenkins-hbase4.apache.org,39491,1689595859788' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-17 12:11:29,970 DEBUG [member: 'jenkins-hbase4.apache.org,39491,1689595859788' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-17 12:11:29,970 DEBUG [rs(jenkins-hbase4.apache.org,42615,1689595859906)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 734a9db668b8b752d63047284f69df2b: 2023-07-17 12:11:29,970 DEBUG [rs(jenkins-hbase4.apache.org,39491,1689595859788)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1689595888708.640e2611f74902bc48c62a5c712524fc. 2023-07-17 12:11:29,970 DEBUG [rs(jenkins-hbase4.apache.org,39491,1689595859788)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1689595888708.640e2611f74902bc48c62a5c712524fc. started... 2023-07-17 12:11:29,970 DEBUG [rs(jenkins-hbase4.apache.org,42615,1689595859906)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1689595888708.734a9db668b8b752d63047284f69df2b.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-17 12:11:29,970 DEBUG [rs(jenkins-hbase4.apache.org,42615,1689595859906)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-17 12:11:29,971 DEBUG [rs(jenkins-hbase4.apache.org,39491,1689595859788)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 640e2611f74902bc48c62a5c712524fc: 2023-07-17 12:11:29,971 DEBUG [rs(jenkins-hbase4.apache.org,42615,1689595859906)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-17 12:11:29,972 DEBUG [member: 'jenkins-hbase4.apache.org,33685,1689595859854' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-17 12:11:29,972 DEBUG [member: 'jenkins-hbase4.apache.org,33685,1689595859854' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 12:11:29,972 DEBUG [rs(jenkins-hbase4.apache.org,39491,1689595859788)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1689595888708.640e2611f74902bc48c62a5c712524fc.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-17 12:11:29,972 DEBUG [member: 'jenkins-hbase4.apache.org,33685,1689595859854' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-17 12:11:29,973 DEBUG [rs(jenkins-hbase4.apache.org,39491,1689595859788)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-17 12:11:29,974 DEBUG [rs(jenkins-hbase4.apache.org,39491,1689595859788)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-17 12:11:30,008 DEBUG [Listener at jenkins-hbase4.apache.org/44127] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 12:11:30,009 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42013] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-17 12:11:30,009 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42013] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-17 12:11:30,010 DEBUG [Listener at jenkins-hbase4.apache.org/44127] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-17 12:11:30,024 DEBUG [rs(jenkins-hbase4.apache.org,39491,1689595859788)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1689595888708.640e2611f74902bc48c62a5c712524fc. completed. 2023-07-17 12:11:30,024 DEBUG [rs(jenkins-hbase4.apache.org,39491,1689595859788)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1689595888708.640e2611f74902bc48c62a5c712524fc. 2023-07-17 12:11:30,024 DEBUG [member: 'jenkins-hbase4.apache.org,39491,1689595859788' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-17 12:11:30,024 DEBUG [member: 'jenkins-hbase4.apache.org,39491,1689595859788' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-17 12:11:30,025 DEBUG [member: 'jenkins-hbase4.apache.org,39491,1689595859788' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:11:30,025 DEBUG [member: 'jenkins-hbase4.apache.org,39491,1689595859788' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-17 12:11:30,025 DEBUG [member: 'jenkins-hbase4.apache.org,39491,1689595859788' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,39491,1689595859788' in zk 2023-07-17 12:11:30,027 DEBUG [rs(jenkins-hbase4.apache.org,42615,1689595859906)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1689595888708.734a9db668b8b752d63047284f69df2b. completed. 2023-07-17 12:11:30,028 DEBUG [rs(jenkins-hbase4.apache.org,42615,1689595859906)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1689595888708.734a9db668b8b752d63047284f69df2b. 2023-07-17 12:11:30,028 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-17 12:11:30,028 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-17 12:11:30,028 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:11:30,028 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-17 12:11:30,028 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,42615,1689595859906' in zk 2023-07-17 12:11:30,028 DEBUG [member: 'jenkins-hbase4.apache.org,39491,1689595859788' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-17 12:11:30,028 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:11:30,028 DEBUG [member: 'jenkins-hbase4.apache.org,39491,1689595859788' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 12:11:30,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:11:30,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 12:11:30,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 12:11:30,029 DEBUG [member: 'jenkins-hbase4.apache.org,39491,1689595859788' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-17 12:11:30,031 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:11:30,032 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-17 12:11:30,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 12:11:30,032 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 12:11:30,032 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-17 12:11:30,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 12:11:30,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-17 12:11:30,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:11:30,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:11:30,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:11:30,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 12:11:30,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-17 12:11:30,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:11:30,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:11:30,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:11:30,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,39491,1689595859788': 2023-07-17 12:11:30,040 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39491,1689595859788' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-17 12:11:30,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:11:30,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 12:11:30,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 12:11:30,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 12:11:30,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 12:11:30,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-17 12:11:30,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:11:30,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:11:30,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:11:30,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 12:11:30,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-17 12:11:30,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:11:30,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:11:30,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:11:30,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,42615,1689595859906': 2023-07-17 12:11:30,048 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42615,1689595859906' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-17 12:11:30,048 INFO [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemState' execution completed 2023-07-17 12:11:30,048 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-17 12:11:30,048 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-17 12:11:30,048 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemState 2023-07-17 12:11:30,048 INFO [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-17 12:11:30,051 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:42615-0x10173314c9f0003, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-17 12:11:30,051 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-17 12:11:30,051 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:42615-0x10173314c9f0003, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 12:11:30,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-17 12:11:30,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 12:11:30,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 12:11:30,051 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:39491-0x10173314c9f0001, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-17 12:11:30,051 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:33685-0x10173314c9f0002, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-17 12:11:30,051 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-17 12:11:30,051 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-17 12:11:30,051 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:39491-0x10173314c9f0001, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 12:11:30,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-17 12:11:30,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-17 12:11:30,051 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:33685-0x10173314c9f0002, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 12:11:30,052 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-17 12:11:30,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-17 12:11:30,053 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 12:11:30,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 12:11:30,053 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 12:11:30,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 12:11:30,053 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 12:11:30,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 12:11:30,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-17 12:11:30,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-17 12:11:30,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 12:11:30,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-17 12:11:30,054 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:11:30,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-17 12:11:30,055 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:11:30,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 12:11:30,056 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:11:30,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-17 12:11:30,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:11:30,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:11:30,058 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:11:30,059 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:11:30,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:11:30,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 12:11:30,060 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:11:30,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-17 12:11:30,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:11:30,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:11:30,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:11:30,066 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:42615-0x10173314c9f0003, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 12:11:30,066 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:33685-0x10173314c9f0002, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 12:11:30,066 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 12:11:30,066 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:11:30,066 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 12:11:30,066 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-17 12:11:30,066 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:11:30,066 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 12:11:30,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 12:11:30,066 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemState 2023-07-17 12:11:30,066 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-07-17 12:11:30,066 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:33685-0x10173314c9f0002, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 12:11:30,066 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:39491-0x10173314c9f0001, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 12:11:30,066 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:42615-0x10173314c9f0003, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 12:11:30,069 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 12:11:30,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 12:11:30,069 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 12:11:30,069 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:39491-0x10173314c9f0001, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 12:11:30,069 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-17 12:11:30,066 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:11:30,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 12:11:30,069 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-17 12:11:30,069 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:11:30,070 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-17 12:11:30,070 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:11:30,070 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:11:30,070 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 12:11:30,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 12:11:30,069 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-17 12:11:30,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 12:11:30,070 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-17 12:11:30,070 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-17 12:11:30,071 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 12:11:30,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 12:11:30,071 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-17 12:11:30,096 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemState 2023-07-17 12:11:30,099 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-17 12:11:30,148 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState to hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.hbase-snapshot/emptySnaptb0-testExportFileSystemState 2023-07-17 12:11:30,182 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-07-17 12:11:30,182 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-17 12:11:30,182 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-17 12:11:30,182 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1689595889906Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1689595890096 (+190 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemState at 1689595890096Loading Region manifests for emptySnaptb0-testExportFileSystemState at 1689595890096Writing data manifest for emptySnaptb0-testExportFileSystemState at 1689595890114 (+18 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemState at 1689595890139 (+25 ms)Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1689595890182 (+43 ms) 2023-07-17 12:11:30,185 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=33, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-17 12:11:30,187 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=33, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 278 msec 2023-07-17 12:11:30,210 DEBUG [Listener at jenkins-hbase4.apache.org/44127] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 12:11:30,211 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42013] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-17 12:11:30,211 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42013] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-17 12:11:30,215 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42615] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,,1689595888708.734a9db668b8b752d63047284f69df2b. with WAL disabled. Data may be lost in the event of a crash. 2023-07-17 12:11:30,217 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39491] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,1,1689595888708.640e2611f74902bc48c62a5c712524fc. with WAL disabled. Data may be lost in the event of a crash. 2023-07-17 12:11:30,221 DEBUG [Listener at jenkins-hbase4.apache.org/44127] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-07-17 12:11:30,221 DEBUG [Listener at jenkins-hbase4.apache.org/44127] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1689595888708.734a9db668b8b752d63047284f69df2b. 2023-07-17 12:11:30,221 INFO [Listener at jenkins-hbase4.apache.org/44127] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-17 12:11:30,234 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42013] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-17 12:11:30,234 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42013] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689595890234 (current time:1689595890234). 2023-07-17 12:11:30,234 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42013] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-17 12:11:30,234 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42013] zookeeper.ReadOnlyZKClient(139): Connect 0x4e7a6f58 to 127.0.0.1:55622 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-17 12:11:30,241 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42013] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@45c10dba, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-17 12:11:30,243 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42013] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 12:11:30,245 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58474, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 12:11:30,246 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42013] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4e7a6f58 to 127.0.0.1:55622 2023-07-17 12:11:30,246 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42013] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 12:11:30,247 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42013] zookeeper.ReadOnlyZKClient(139): Connect 0x7a2201d6 to 127.0.0.1:55622 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-17 12:11:30,256 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42013] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2a5eccf5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-17 12:11:30,258 DEBUG [hconnection-0x2f1fa5b-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 12:11:30,259 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58490, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 12:11:30,263 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42013] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 12:11:30,265 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33000, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 12:11:30,266 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42013] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7a2201d6 to 127.0.0.1:55622 2023-07-17 12:11:30,266 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42013] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 12:11:30,266 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42013] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-17 12:11:30,267 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42013] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-17 12:11:30,267 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42013] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-17 12:11:30,270 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42013] procedure2.ProcedureExecutor(1029): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-17 12:11:30,271 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-17 12:11:30,272 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689596490272 2023-07-17 12:11:30,272 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-07-17 12:11:30,272 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42013] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-17 12:11:30,273 DEBUG [Listener at jenkins-hbase4.apache.org/44127] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-17 12:11:30,273 DEBUG [Listener at jenkins-hbase4.apache.org/44127] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-17 12:11:30,274 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-17 12:11:30,274 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-17 12:11:30,276 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 5 msec 2023-07-17 12:11:30,277 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-17 12:11:30,278 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=35, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689596490278 2023-07-17 12:11:30,294 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemState 2023-07-17 12:11:30,294 INFO [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemState' 2023-07-17 12:11:30,294 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 12:11:30,296 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemState' starting 'acquire' 2023-07-17 12:11:30,296 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-07-17 12:11:30,296 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-17 12:11:30,296 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-17 12:11:30,298 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:33685-0x10173314c9f0002, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 12:11:30,298 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:39491-0x10173314c9f0001, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 12:11:30,298 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 12:11:30,298 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 12:11:30,298 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:11:30,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 12:11:30,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 12:11:30,298 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:42615-0x10173314c9f0003, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 12:11:30,298 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 12:11:30,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 12:11:30,299 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:11:30,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-17 12:11:30,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-17 12:11:30,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-17 12:11:30,299 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:11:30,299 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39491-0x10173314c9f0001, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-17 12:11:30,299 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42615-0x10173314c9f0003, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-17 12:11:30,299 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33685-0x10173314c9f0002, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-17 12:11:30,299 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:11:30,300 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-17 12:11:30,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-17 12:11:30,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-17 12:11:30,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-17 12:11:30,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-17 12:11:30,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-17 12:11:30,300 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-17 12:11:30,300 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-17 12:11:30,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-17 12:11:30,300 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-17 12:11:30,300 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-17 12:11:30,300 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-17 12:11:30,300 DEBUG [member: 'jenkins-hbase4.apache.org,39491,1689595859788' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-17 12:11:30,300 DEBUG [member: 'jenkins-hbase4.apache.org,39491,1689595859788' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 12:11:30,300 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-17 12:11:30,300 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 12:11:30,304 DEBUG [member: 'jenkins-hbase4.apache.org,39491,1689595859788' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-17 12:11:30,304 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-17 12:11:30,304 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-17 12:11:30,304 DEBUG [member: 'jenkins-hbase4.apache.org,39491,1689595859788' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-17 12:11:30,304 DEBUG [member: 'jenkins-hbase4.apache.org,39491,1689595859788' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39491,1689595859788' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-17 12:11:30,304 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-17 12:11:30,304 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42615,1689595859906' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-17 12:11:30,304 DEBUG [member: 'jenkins-hbase4.apache.org,33685,1689595859854' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-17 12:11:30,304 DEBUG [member: 'jenkins-hbase4.apache.org,33685,1689595859854' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 12:11:30,305 DEBUG [member: 'jenkins-hbase4.apache.org,33685,1689595859854' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-17 12:11:30,305 DEBUG [member: 'jenkins-hbase4.apache.org,33685,1689595859854' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-17 12:11:30,305 DEBUG [member: 'jenkins-hbase4.apache.org,33685,1689595859854' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33685,1689595859854' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-17 12:11:30,306 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:11:30,306 DEBUG [member: 'jenkins-hbase4.apache.org,39491,1689595859788' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-17 12:11:30,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:11:30,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 12:11:30,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 12:11:30,308 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-17 12:11:30,309 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:11:30,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 12:11:30,309 DEBUG [member: 'jenkins-hbase4.apache.org,39491,1689595859788' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39491-0x10173314c9f0001, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-17 12:11:30,309 DEBUG [member: 'jenkins-hbase4.apache.org,39491,1689595859788' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 12:11:30,309 DEBUG [member: 'jenkins-hbase4.apache.org,33685,1689595859854' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-17 12:11:30,309 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42615-0x10173314c9f0003, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-17 12:11:30,309 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 12:11:30,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 12:11:30,309 DEBUG [member: 'jenkins-hbase4.apache.org,33685,1689595859854' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33685-0x10173314c9f0002, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-17 12:11:30,309 DEBUG [member: 'jenkins-hbase4.apache.org,33685,1689595859854' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 12:11:30,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-17 12:11:30,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:11:30,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:11:30,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:11:30,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 12:11:30,311 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39491,1689595859788' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-07-17 12:11:30,311 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@63277cd5[Count = 1] remaining members to acquire global barrier 2023-07-17 12:11:30,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:11:30,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 12:11:30,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 12:11:30,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 12:11:30,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 12:11:30,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-17 12:11:30,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:11:30,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:11:30,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:11:30,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 12:11:30,314 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42615,1689595859906' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-07-17 12:11:30,314 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@63277cd5[Count = 0] remaining members to acquire global barrier 2023-07-17 12:11:30,314 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-07-17 12:11:30,314 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-17 12:11:30,315 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:33685-0x10173314c9f0002, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-17 12:11:30,315 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:39491-0x10173314c9f0001, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-17 12:11:30,315 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-17 12:11:30,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-17 12:11:30,315 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:42615-0x10173314c9f0003, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-17 12:11:30,315 DEBUG [member: 'jenkins-hbase4.apache.org,33685,1689595859854' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-17 12:11:30,315 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-17 12:11:30,315 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-17 12:11:30,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-17 12:11:30,315 DEBUG [member: 'jenkins-hbase4.apache.org,33685,1689595859854' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-17 12:11:30,315 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:11:30,316 DEBUG [member: 'jenkins-hbase4.apache.org,33685,1689595859854' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,33685,1689595859854' in zk 2023-07-17 12:11:30,316 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-17 12:11:30,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-17 12:11:30,316 DEBUG [member: 'jenkins-hbase4.apache.org,39491,1689595859788' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-17 12:11:30,316 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-17 12:11:30,316 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:11:30,316 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-17 12:11:30,316 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-17 12:11:30,316 DEBUG [rs(jenkins-hbase4.apache.org,42615,1689595859906)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1689595888708.734a9db668b8b752d63047284f69df2b. 2023-07-17 12:11:30,316 DEBUG [member: 'jenkins-hbase4.apache.org,39491,1689595859788' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-17 12:11:30,316 DEBUG [member: 'jenkins-hbase4.apache.org,39491,1689595859788' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-17 12:11:30,316 DEBUG [rs(jenkins-hbase4.apache.org,42615,1689595859906)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1689595888708.734a9db668b8b752d63047284f69df2b. started... 2023-07-17 12:11:30,316 DEBUG [rs(jenkins-hbase4.apache.org,39491,1689595859788)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1689595888708.640e2611f74902bc48c62a5c712524fc. 2023-07-17 12:11:30,317 DEBUG [rs(jenkins-hbase4.apache.org,39491,1689595859788)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1689595888708.640e2611f74902bc48c62a5c712524fc. started... 2023-07-17 12:11:30,317 INFO [rs(jenkins-hbase4.apache.org,42615,1689595859906)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 734a9db668b8b752d63047284f69df2b 1/1 column families, dataSize=132 B heapSize=544 B 2023-07-17 12:11:30,317 INFO [rs(jenkins-hbase4.apache.org,39491,1689595859788)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 640e2611f74902bc48c62a5c712524fc 1/1 column families, dataSize=3.13 KB heapSize=7 KB 2023-07-17 12:11:30,317 DEBUG [member: 'jenkins-hbase4.apache.org,33685,1689595859854' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-17 12:11:30,317 DEBUG [member: 'jenkins-hbase4.apache.org,33685,1689595859854' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 12:11:30,317 DEBUG [member: 'jenkins-hbase4.apache.org,33685,1689595859854' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-17 12:11:30,348 INFO [rs(jenkins-hbase4.apache.org,42615,1689595859906)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230717de38f2bb3dcc44b58048c2d5becce2e6 to hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230717de38f2bb3dcc44b58048c2d5becce2e6 2023-07-17 12:11:30,356 INFO [rs(jenkins-hbase4.apache.org,39491,1689595859788)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023071721c3e0d59d394ff8988d61c5c23a3d69 to hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b2023071721c3e0d59d394ff8988d61c5c23a3d69 2023-07-17 12:11:30,370 INFO [rs(jenkins-hbase4.apache.org,42615,1689595859906)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=132, hasBloomFilter=true, into tmp file hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/default/testtb-testExportFileSystemState/734a9db668b8b752d63047284f69df2b/.tmp/cf/d1494fecb80f42ff9f88f6466af7045b 2023-07-17 12:11:30,373 DEBUG [Listener at jenkins-hbase4.apache.org/44127] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 12:11:30,373 INFO [rs(jenkins-hbase4.apache.org,39491,1689595859788)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/default/testtb-testExportFileSystemState/640e2611f74902bc48c62a5c712524fc/.tmp/cf/534b35fe42e44daabac2ff7f81e2b909 2023-07-17 12:11:30,374 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42013] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-17 12:11:30,374 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42013] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-17 12:11:30,375 DEBUG [Listener at jenkins-hbase4.apache.org/44127] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-17 12:11:30,377 DEBUG [rs(jenkins-hbase4.apache.org,42615,1689595859906)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/default/testtb-testExportFileSystemState/734a9db668b8b752d63047284f69df2b/.tmp/cf/d1494fecb80f42ff9f88f6466af7045b as hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/default/testtb-testExportFileSystemState/734a9db668b8b752d63047284f69df2b/cf/d1494fecb80f42ff9f88f6466af7045b 2023-07-17 12:11:30,380 DEBUG [rs(jenkins-hbase4.apache.org,39491,1689595859788)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/default/testtb-testExportFileSystemState/640e2611f74902bc48c62a5c712524fc/.tmp/cf/534b35fe42e44daabac2ff7f81e2b909 as hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/default/testtb-testExportFileSystemState/640e2611f74902bc48c62a5c712524fc/cf/534b35fe42e44daabac2ff7f81e2b909 2023-07-17 12:11:30,384 INFO [rs(jenkins-hbase4.apache.org,42615,1689595859906)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/default/testtb-testExportFileSystemState/734a9db668b8b752d63047284f69df2b/cf/d1494fecb80f42ff9f88f6466af7045b, entries=2, sequenceid=6, filesize=5.2 K 2023-07-17 12:11:30,385 INFO [rs(jenkins-hbase4.apache.org,42615,1689595859906)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~132 B/132, heapSize ~528 B/528, currentSize=0 B/0 for 734a9db668b8b752d63047284f69df2b in 68ms, sequenceid=6, compaction requested=false 2023-07-17 12:11:30,385 DEBUG [rs(jenkins-hbase4.apache.org,42615,1689595859906)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemState' 2023-07-17 12:11:30,385 DEBUG [rs(jenkins-hbase4.apache.org,42615,1689595859906)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 734a9db668b8b752d63047284f69df2b: 2023-07-17 12:11:30,386 DEBUG [rs(jenkins-hbase4.apache.org,42615,1689595859906)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1689595888708.734a9db668b8b752d63047284f69df2b.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-17 12:11:30,386 DEBUG [rs(jenkins-hbase4.apache.org,42615,1689595859906)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-17 12:11:30,386 DEBUG [rs(jenkins-hbase4.apache.org,42615,1689595859906)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/default/testtb-testExportFileSystemState/734a9db668b8b752d63047284f69df2b/cf/d1494fecb80f42ff9f88f6466af7045b] hfiles 2023-07-17 12:11:30,386 DEBUG [rs(jenkins-hbase4.apache.org,42615,1689595859906)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/default/testtb-testExportFileSystemState/734a9db668b8b752d63047284f69df2b/cf/d1494fecb80f42ff9f88f6466af7045b for snapshot=snaptb0-testExportFileSystemState 2023-07-17 12:11:30,387 INFO [rs(jenkins-hbase4.apache.org,39491,1689595859788)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/default/testtb-testExportFileSystemState/640e2611f74902bc48c62a5c712524fc/cf/534b35fe42e44daabac2ff7f81e2b909, entries=48, sequenceid=6, filesize=13.0 K 2023-07-17 12:11:30,388 INFO [rs(jenkins-hbase4.apache.org,39491,1689595859788)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.13 KB/3204, heapSize ~6.98 KB/7152, currentSize=0 B/0 for 640e2611f74902bc48c62a5c712524fc in 71ms, sequenceid=6, compaction requested=false 2023-07-17 12:11:30,389 DEBUG [rs(jenkins-hbase4.apache.org,39491,1689595859788)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 640e2611f74902bc48c62a5c712524fc: 2023-07-17 12:11:30,389 DEBUG [rs(jenkins-hbase4.apache.org,39491,1689595859788)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1689595888708.640e2611f74902bc48c62a5c712524fc.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-17 12:11:30,389 DEBUG [rs(jenkins-hbase4.apache.org,39491,1689595859788)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-17 12:11:30,390 DEBUG [rs(jenkins-hbase4.apache.org,39491,1689595859788)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/default/testtb-testExportFileSystemState/640e2611f74902bc48c62a5c712524fc/cf/534b35fe42e44daabac2ff7f81e2b909] hfiles 2023-07-17 12:11:30,390 DEBUG [rs(jenkins-hbase4.apache.org,39491,1689595859788)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/default/testtb-testExportFileSystemState/640e2611f74902bc48c62a5c712524fc/cf/534b35fe42e44daabac2ff7f81e2b909 for snapshot=snaptb0-testExportFileSystemState 2023-07-17 12:11:30,399 DEBUG [rs(jenkins-hbase4.apache.org,42615,1689595859906)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1689595888708.734a9db668b8b752d63047284f69df2b. completed. 2023-07-17 12:11:30,399 DEBUG [rs(jenkins-hbase4.apache.org,42615,1689595859906)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1689595888708.734a9db668b8b752d63047284f69df2b. 2023-07-17 12:11:30,400 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-17 12:11:30,400 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-17 12:11:30,400 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:11:30,400 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-17 12:11:30,400 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,42615,1689595859906' in zk 2023-07-17 12:11:30,402 DEBUG [rs(jenkins-hbase4.apache.org,39491,1689595859788)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1689595888708.640e2611f74902bc48c62a5c712524fc. completed. 2023-07-17 12:11:30,402 DEBUG [rs(jenkins-hbase4.apache.org,39491,1689595859788)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1689595888708.640e2611f74902bc48c62a5c712524fc. 2023-07-17 12:11:30,402 DEBUG [member: 'jenkins-hbase4.apache.org,39491,1689595859788' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-17 12:11:30,402 DEBUG [member: 'jenkins-hbase4.apache.org,39491,1689595859788' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-17 12:11:30,402 DEBUG [member: 'jenkins-hbase4.apache.org,39491,1689595859788' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:11:30,402 DEBUG [member: 'jenkins-hbase4.apache.org,39491,1689595859788' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-17 12:11:30,402 DEBUG [member: 'jenkins-hbase4.apache.org,39491,1689595859788' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,39491,1689595859788' in zk 2023-07-17 12:11:30,408 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:11:30,408 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-17 12:11:30,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:11:30,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 12:11:30,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 12:11:30,408 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 12:11:30,408 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-17 12:11:30,411 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:11:30,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 12:11:30,411 DEBUG [member: 'jenkins-hbase4.apache.org,39491,1689595859788' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-17 12:11:30,411 DEBUG [member: 'jenkins-hbase4.apache.org,39491,1689595859788' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 12:11:30,411 DEBUG [member: 'jenkins-hbase4.apache.org,39491,1689595859788' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-17 12:11:30,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 12:11:30,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-17 12:11:30,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:11:30,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:11:30,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:11:30,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 12:11:30,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-17 12:11:30,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:11:30,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:11:30,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:11:30,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,42615,1689595859906': 2023-07-17 12:11:30,416 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42615,1689595859906' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-17 12:11:30,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:11:30,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 12:11:30,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 12:11:30,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 12:11:30,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 12:11:30,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-17 12:11:30,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:11:30,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:11:30,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:11:30,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 12:11:30,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-17 12:11:30,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:11:30,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:11:30,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:11:30,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,39491,1689595859788': 2023-07-17 12:11:30,420 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39491,1689595859788' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-17 12:11:30,420 INFO [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemState' execution completed 2023-07-17 12:11:30,420 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-17 12:11:30,420 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-17 12:11:30,420 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemState 2023-07-17 12:11:30,420 INFO [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-17 12:11:30,422 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:39491-0x10173314c9f0001, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-17 12:11:30,422 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:39491-0x10173314c9f0001, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 12:11:30,422 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:42615-0x10173314c9f0003, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-17 12:11:30,422 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:33685-0x10173314c9f0002, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-17 12:11:30,422 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-17 12:11:30,422 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-17 12:11:30,422 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-17 12:11:30,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-17 12:11:30,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-17 12:11:30,422 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:33685-0x10173314c9f0002, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 12:11:30,422 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:42615-0x10173314c9f0003, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 12:11:30,422 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-17 12:11:30,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-17 12:11:30,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-17 12:11:30,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 12:11:30,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 12:11:30,423 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 12:11:30,423 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 12:11:30,423 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:11:30,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 12:11:30,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 12:11:30,423 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 12:11:30,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 12:11:30,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-17 12:11:30,424 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:11:30,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 12:11:30,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-17 12:11:30,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-17 12:11:30,424 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:11:30,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-17 12:11:30,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 12:11:30,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-17 12:11:30,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:11:30,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:11:30,426 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:11:30,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:11:30,426 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:11:30,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 12:11:30,426 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:11:30,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-17 12:11:30,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:11:30,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:11:30,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:11:30,430 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:11:30,430 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-17 12:11:30,430 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:11:30,430 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:11:30,430 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-17 12:11:30,430 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:11:30,430 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-17 12:11:30,430 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:11:30,430 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:11:30,430 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-17 12:11:30,430 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:39491-0x10173314c9f0001, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 12:11:30,431 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:39491-0x10173314c9f0001, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 12:11:30,430 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-17 12:11:30,431 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:42615-0x10173314c9f0003, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 12:11:30,431 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 12:11:30,431 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemState 2023-07-17 12:11:30,431 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 12:11:30,431 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:42615-0x10173314c9f0003, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 12:11:30,433 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:33685-0x10173314c9f0002, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 12:11:30,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 12:11:30,433 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-07-17 12:11:30,433 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-17 12:11:30,433 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-17 12:11:30,433 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 12:11:30,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 12:11:30,431 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 12:11:30,433 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 12:11:30,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 12:11:30,433 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:33685-0x10173314c9f0002, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 12:11:30,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 12:11:30,435 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 12:11:30,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 12:11:30,435 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 12:11:30,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 12:11:30,435 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b2023071721c3e0d59d394ff8988d61c5c23a3d69, hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230717de38f2bb3dcc44b58048c2d5becce2e6] mob files 2023-07-17 12:11:30,435 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b2023071721c3e0d59d394ff8988d61c5c23a3d69 2023-07-17 12:11:30,435 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230717de38f2bb3dcc44b58048c2d5becce2e6 2023-07-17 12:11:30,456 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemState 2023-07-17 12:11:30,457 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-17 12:11:30,505 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState to hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-17 12:11:30,544 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-07-17 12:11:30,544 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-17 12:11:30,545 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-17 12:11:30,545 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1689595890272Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1689595890456 (+184 ms)Consolidate snapshot: snaptb0-testExportFileSystemState at 1689595890456Loading Region manifests for snaptb0-testExportFileSystemState at 1689595890456Writing data manifest for snaptb0-testExportFileSystemState at 1689595890466 (+10 ms)Verifying snapshot: snaptb0-testExportFileSystemState at 1689595890494 (+28 ms)Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1689595890544 (+50 ms) 2023-07-17 12:11:30,547 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=35, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-17 12:11:30,550 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=35, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 275 msec 2023-07-17 12:11:30,575 DEBUG [Listener at jenkins-hbase4.apache.org/44127] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 12:11:30,576 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42013] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-17 12:11:30,576 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42013] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-17 12:11:30,576 INFO [Listener at jenkins-hbase4.apache.org/44127] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/export-test/export-1689595890576 2023-07-17 12:11:30,576 INFO [Listener at jenkins-hbase4.apache.org/44127] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:46215, tgtDir=hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/export-test/export-1689595890576, rawTgtDir=hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/export-test/export-1689595890576, srcFsUri=hdfs://localhost:46215, srcDir=hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b 2023-07-17 12:11:30,600 DEBUG [Listener at jenkins-hbase4.apache.org/44127] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:46215, inputRoot=hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b 2023-07-17 12:11:30,600 DEBUG [Listener at jenkins-hbase4.apache.org/44127] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1837110954_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/export-test/export-1689595890576, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/export-test/export-1689595890576/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-17 12:11:30,600 INFO [Listener at jenkins-hbase4.apache.org/44127] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:46215, inputRoot=hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b, snapshotDir=hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.hbase-snapshot/snaptb0-testExportFileSystemState. 2023-07-17 12:11:30,619 INFO [Listener at jenkins-hbase4.apache.org/44127] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.hbase-snapshot/snaptb0-testExportFileSystemState to hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/export-test/export-1689595890576/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-17 12:11:30,673 DEBUG [Listener at jenkins-hbase4.apache.org/44127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-17 12:11:30,673 DEBUG [Listener at jenkins-hbase4.apache.org/44127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-17 12:11:30,674 DEBUG [Listener at jenkins-hbase4.apache.org/44127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-17 12:11:30,674 DEBUG [Listener at jenkins-hbase4.apache.org/44127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-17 12:11:30,674 DEBUG [Listener at jenkins-hbase4.apache.org/44127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-17 12:11:30,675 DEBUG [Listener at jenkins-hbase4.apache.org/44127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-17 12:11:30,675 DEBUG [Listener at jenkins-hbase4.apache.org/44127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-17 12:11:30,764 DEBUG [Listener at jenkins-hbase4.apache.org/44127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58af5705-0594-af5f-981c-fa1d3b267fab/hadoop-6443291140609413568.jar 2023-07-17 12:11:30,765 DEBUG [Listener at jenkins-hbase4.apache.org/44127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-17 12:11:30,765 DEBUG [Listener at jenkins-hbase4.apache.org/44127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-17 12:11:30,766 DEBUG [Listener at jenkins-hbase4.apache.org/44127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-17 12:11:30,766 DEBUG [Listener at jenkins-hbase4.apache.org/44127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-17 12:11:30,767 DEBUG [Listener at jenkins-hbase4.apache.org/44127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-17 12:11:30,767 DEBUG [Listener at jenkins-hbase4.apache.org/44127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-17 12:11:30,768 DEBUG [Listener at jenkins-hbase4.apache.org/44127] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-17 12:11:30,768 DEBUG [Listener at jenkins-hbase4.apache.org/44127] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-17 12:11:30,769 DEBUG [Listener at jenkins-hbase4.apache.org/44127] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-17 12:11:30,769 DEBUG [Listener at jenkins-hbase4.apache.org/44127] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-17 12:11:30,770 DEBUG [Listener at jenkins-hbase4.apache.org/44127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-17 12:11:30,770 DEBUG [Listener at jenkins-hbase4.apache.org/44127] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-17 12:11:30,770 DEBUG [Listener at jenkins-hbase4.apache.org/44127] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-17 12:11:30,771 DEBUG [Listener at jenkins-hbase4.apache.org/44127] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-17 12:11:30,771 DEBUG [Listener at jenkins-hbase4.apache.org/44127] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-17 12:11:30,772 DEBUG [Listener at jenkins-hbase4.apache.org/44127] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-17 12:11:30,772 DEBUG [Listener at jenkins-hbase4.apache.org/44127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-17 12:11:30,773 DEBUG [Listener at jenkins-hbase4.apache.org/44127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-17 12:11:30,773 DEBUG [Listener at jenkins-hbase4.apache.org/44127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-17 12:11:30,773 DEBUG [Listener at jenkins-hbase4.apache.org/44127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-17 12:11:30,774 DEBUG [Listener at jenkins-hbase4.apache.org/44127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-17 12:11:30,774 DEBUG [Listener at jenkins-hbase4.apache.org/44127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-17 12:11:30,775 DEBUG [Listener at jenkins-hbase4.apache.org/44127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-17 12:11:31,392 WARN [Listener at jenkins-hbase4.apache.org/44127] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-17 12:11:31,395 INFO [Listener at jenkins-hbase4.apache.org/44127] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemState' hfile list 2023-07-17 12:11:31,398 DEBUG [Listener at jenkins-hbase4.apache.org/44127] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-07-17 12:11:32,028 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-17 12:11:32,028 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-17 12:11:32,034 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689595867847_0001_000001 (auth:SIMPLE) 2023-07-17 12:11:32,242 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689595867847_0002_000001 (auth:SIMPLE) 2023-07-17 12:11:33,669 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-17 12:11:37,210 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689595867847_0002_000001 (auth:SIMPLE) 2023-07-17 12:11:39,441 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689595867847_0002_000001 (auth:SIMPLE) 2023-07-17 12:11:43,035 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689595867847_0002_000001 (auth:SIMPLE) 2023-07-17 12:11:44,596 INFO [Listener at jenkins-hbase4.apache.org/44127] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-17 12:11:44,597 INFO [Listener at jenkins-hbase4.apache.org/44127] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-17 12:11:44,606 INFO [Listener at jenkins-hbase4.apache.org/44127] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemState 2023-07-17 12:11:44,607 INFO [Listener at jenkins-hbase4.apache.org/44127] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-17 12:11:44,607 INFO [Listener at jenkins-hbase4.apache.org/44127] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-17 12:11:44,607 DEBUG [Listener at jenkins-hbase4.apache.org/44127] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1847813108_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-17 12:11:44,608 DEBUG [Listener at jenkins-hbase4.apache.org/44127] snapshot.TestExportSnapshot(367): hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-07-17 12:11:44,608 DEBUG [Listener at jenkins-hbase4.apache.org/44127] snapshot.TestExportSnapshot(367): hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-07-17 12:11:44,608 DEBUG [Listener at jenkins-hbase4.apache.org/44127] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1847813108_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/export-test/export-1689595890576/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/export-test/export-1689595890576/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-17 12:11:44,608 DEBUG [Listener at jenkins-hbase4.apache.org/44127] snapshot.TestExportSnapshot(367): hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/export-test/export-1689595890576/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-07-17 12:11:44,608 DEBUG [Listener at jenkins-hbase4.apache.org/44127] snapshot.TestExportSnapshot(367): hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/export-test/export-1689595890576/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-07-17 12:11:44,617 INFO [Listener at jenkins-hbase4.apache.org/44127] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemState 2023-07-17 12:11:44,617 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42013] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemState 2023-07-17 12:11:44,618 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42013] procedure2.ProcedureExecutor(1029): Stored pid=36, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemState 2023-07-17 12:11:44,623 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42013] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-17 12:11:44,624 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689595904624"}]},"ts":"1689595904624"} 2023-07-17 12:11:44,632 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLING in hbase:meta 2023-07-17 12:11:44,639 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemState to state=DISABLING 2023-07-17 12:11:44,640 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=734a9db668b8b752d63047284f69df2b, UNASSIGN}, {pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=640e2611f74902bc48c62a5c712524fc, UNASSIGN}] 2023-07-17 12:11:44,643 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=734a9db668b8b752d63047284f69df2b, UNASSIGN 2023-07-17 12:11:44,643 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=640e2611f74902bc48c62a5c712524fc, UNASSIGN 2023-07-17 12:11:44,644 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=734a9db668b8b752d63047284f69df2b, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:11:44,645 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1689595888708.734a9db668b8b752d63047284f69df2b.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689595904644"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689595904644"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689595904644"}]},"ts":"1689595904644"} 2023-07-17 12:11:44,645 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=640e2611f74902bc48c62a5c712524fc, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:11:44,645 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1689595888708.640e2611f74902bc48c62a5c712524fc.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689595904645"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689595904645"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689595904645"}]},"ts":"1689595904645"} 2023-07-17 12:11:44,647 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=39, ppid=37, state=RUNNABLE; CloseRegionProcedure 734a9db668b8b752d63047284f69df2b, server=jenkins-hbase4.apache.org,42615,1689595859906}] 2023-07-17 12:11:44,648 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=40, ppid=38, state=RUNNABLE; CloseRegionProcedure 640e2611f74902bc48c62a5c712524fc, server=jenkins-hbase4.apache.org,39491,1689595859788}] 2023-07-17 12:11:44,725 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42013] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-17 12:11:44,800 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 734a9db668b8b752d63047284f69df2b 2023-07-17 12:11:44,800 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 734a9db668b8b752d63047284f69df2b, disabling compactions & flushes 2023-07-17 12:11:44,800 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1689595888708.734a9db668b8b752d63047284f69df2b. 2023-07-17 12:11:44,800 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1689595888708.734a9db668b8b752d63047284f69df2b. 2023-07-17 12:11:44,800 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1689595888708.734a9db668b8b752d63047284f69df2b. after waiting 0 ms 2023-07-17 12:11:44,800 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1689595888708.734a9db668b8b752d63047284f69df2b. 2023-07-17 12:11:44,800 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 640e2611f74902bc48c62a5c712524fc 2023-07-17 12:11:44,802 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 640e2611f74902bc48c62a5c712524fc, disabling compactions & flushes 2023-07-17 12:11:44,804 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1689595888708.640e2611f74902bc48c62a5c712524fc. 2023-07-17 12:11:44,804 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1689595888708.640e2611f74902bc48c62a5c712524fc. 2023-07-17 12:11:44,804 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1689595888708.640e2611f74902bc48c62a5c712524fc. after waiting 0 ms 2023-07-17 12:11:44,804 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1689595888708.640e2611f74902bc48c62a5c712524fc. 2023-07-17 12:11:44,817 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/default/testtb-testExportFileSystemState/734a9db668b8b752d63047284f69df2b/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-17 12:11:44,817 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/default/testtb-testExportFileSystemState/640e2611f74902bc48c62a5c712524fc/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-17 12:11:44,817 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-17 12:11:44,817 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-17 12:11:44,819 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1689595888708.734a9db668b8b752d63047284f69df2b. 2023-07-17 12:11:44,819 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1689595888708.640e2611f74902bc48c62a5c712524fc. 2023-07-17 12:11:44,819 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 734a9db668b8b752d63047284f69df2b: 2023-07-17 12:11:44,819 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 640e2611f74902bc48c62a5c712524fc: 2023-07-17 12:11:44,821 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 734a9db668b8b752d63047284f69df2b 2023-07-17 12:11:44,822 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=734a9db668b8b752d63047284f69df2b, regionState=CLOSED 2023-07-17 12:11:44,822 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 640e2611f74902bc48c62a5c712524fc 2023-07-17 12:11:44,822 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1689595888708.734a9db668b8b752d63047284f69df2b.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689595904822"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689595904822"}]},"ts":"1689595904822"} 2023-07-17 12:11:44,823 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=640e2611f74902bc48c62a5c712524fc, regionState=CLOSED 2023-07-17 12:11:44,824 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1689595888708.640e2611f74902bc48c62a5c712524fc.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689595904823"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689595904823"}]},"ts":"1689595904823"} 2023-07-17 12:11:44,837 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=39, resume processing ppid=37 2023-07-17 12:11:44,837 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=39, ppid=37, state=SUCCESS; CloseRegionProcedure 734a9db668b8b752d63047284f69df2b, server=jenkins-hbase4.apache.org,42615,1689595859906 in 181 msec 2023-07-17 12:11:44,838 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=40, resume processing ppid=38 2023-07-17 12:11:44,838 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=38, state=SUCCESS; CloseRegionProcedure 640e2611f74902bc48c62a5c712524fc, server=jenkins-hbase4.apache.org,39491,1689595859788 in 181 msec 2023-07-17 12:11:44,839 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=734a9db668b8b752d63047284f69df2b, UNASSIGN in 197 msec 2023-07-17 12:11:44,841 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=38, resume processing ppid=36 2023-07-17 12:11:44,841 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=38, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=640e2611f74902bc48c62a5c712524fc, UNASSIGN in 198 msec 2023-07-17 12:11:44,842 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689595904842"}]},"ts":"1689595904842"} 2023-07-17 12:11:44,845 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLED in hbase:meta 2023-07-17 12:11:44,850 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemState to state=DISABLED 2023-07-17 12:11:44,858 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=36, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemState in 235 msec 2023-07-17 12:11:44,926 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42013] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-17 12:11:44,926 INFO [Listener at jenkins-hbase4.apache.org/44127] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemState, procId: 36 completed 2023-07-17 12:11:44,927 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42013] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemState 2023-07-17 12:11:44,929 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42013] procedure2.ProcedureExecutor(1029): Stored pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-17 12:11:44,931 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-17 12:11:44,931 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42013] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemState 2023-07-17 12:11:44,932 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=41, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-17 12:11:44,933 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39491] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemState 2023-07-17 12:11:44,937 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.tmp/data/default/testtb-testExportFileSystemState/734a9db668b8b752d63047284f69df2b 2023-07-17 12:11:44,937 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.tmp/data/default/testtb-testExportFileSystemState/640e2611f74902bc48c62a5c712524fc 2023-07-17 12:11:44,937 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:33685-0x10173314c9f0002, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-17 12:11:44,937 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:42615-0x10173314c9f0003, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-17 12:11:44,937 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:39491-0x10173314c9f0001, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-17 12:11:44,937 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-17 12:11:44,938 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-17 12:11:44,938 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-17 12:11:44,938 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-17 12:11:44,938 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-17 12:11:44,939 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-17 12:11:44,939 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:39491-0x10173314c9f0001, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-17 12:11:44,939 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:39491-0x10173314c9f0001, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 12:11:44,939 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:42615-0x10173314c9f0003, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-17 12:11:44,939 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:42615-0x10173314c9f0003, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 12:11:44,939 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 12:11:44,939 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:33685-0x10173314c9f0002, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-17 12:11:44,940 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:33685-0x10173314c9f0002, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 12:11:44,940 DEBUG [HFileArchiver-9] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.tmp/data/default/testtb-testExportFileSystemState/734a9db668b8b752d63047284f69df2b/cf, FileablePath, hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.tmp/data/default/testtb-testExportFileSystemState/734a9db668b8b752d63047284f69df2b/recovered.edits] 2023-07-17 12:11:44,940 DEBUG [HFileArchiver-10] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.tmp/data/default/testtb-testExportFileSystemState/640e2611f74902bc48c62a5c712524fc/cf, FileablePath, hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.tmp/data/default/testtb-testExportFileSystemState/640e2611f74902bc48c62a5c712524fc/recovered.edits] 2023-07-17 12:11:44,941 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42013] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-07-17 12:11:44,945 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.tmp/data/default/testtb-testExportFileSystemState/640e2611f74902bc48c62a5c712524fc/cf/534b35fe42e44daabac2ff7f81e2b909 to hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/archive/data/default/testtb-testExportFileSystemState/640e2611f74902bc48c62a5c712524fc/cf/534b35fe42e44daabac2ff7f81e2b909 2023-07-17 12:11:44,945 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.tmp/data/default/testtb-testExportFileSystemState/734a9db668b8b752d63047284f69df2b/cf/d1494fecb80f42ff9f88f6466af7045b to hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/archive/data/default/testtb-testExportFileSystemState/734a9db668b8b752d63047284f69df2b/cf/d1494fecb80f42ff9f88f6466af7045b 2023-07-17 12:11:44,948 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.tmp/data/default/testtb-testExportFileSystemState/640e2611f74902bc48c62a5c712524fc/recovered.edits/9.seqid to hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/archive/data/default/testtb-testExportFileSystemState/640e2611f74902bc48c62a5c712524fc/recovered.edits/9.seqid 2023-07-17 12:11:44,948 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.tmp/data/default/testtb-testExportFileSystemState/734a9db668b8b752d63047284f69df2b/recovered.edits/9.seqid to hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/archive/data/default/testtb-testExportFileSystemState/734a9db668b8b752d63047284f69df2b/recovered.edits/9.seqid 2023-07-17 12:11:44,949 DEBUG [HFileArchiver-10] backup.HFileArchiver(596): Deleted hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.tmp/data/default/testtb-testExportFileSystemState/640e2611f74902bc48c62a5c712524fc 2023-07-17 12:11:44,949 DEBUG [HFileArchiver-9] backup.HFileArchiver(596): Deleted hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.tmp/data/default/testtb-testExportFileSystemState/734a9db668b8b752d63047284f69df2b 2023-07-17 12:11:44,949 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-07-17 12:11:44,949 DEBUG [PEWorker-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-07-17 12:11:44,950 DEBUG [PEWorker-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf] 2023-07-17 12:11:44,953 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b2023071721c3e0d59d394ff8988d61c5c23a3d69 to hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b2023071721c3e0d59d394ff8988d61c5c23a3d69 2023-07-17 12:11:44,954 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230717de38f2bb3dcc44b58048c2d5becce2e6 to hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230717de38f2bb3dcc44b58048c2d5becce2e6 2023-07-17 12:11:44,955 DEBUG [PEWorker-5] backup.HFileArchiver(596): Deleted hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-07-17 12:11:44,957 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=41, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-17 12:11:44,959 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemState from hbase:meta 2023-07-17 12:11:44,961 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemState' descriptor. 2023-07-17 12:11:44,963 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=41, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-17 12:11:44,963 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemState' from region states. 2023-07-17 12:11:44,963 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,,1689595888708.734a9db668b8b752d63047284f69df2b.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689595904963"}]},"ts":"9223372036854775807"} 2023-07-17 12:11:44,963 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,1,1689595888708.640e2611f74902bc48c62a5c712524fc.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689595904963"}]},"ts":"9223372036854775807"} 2023-07-17 12:11:44,965 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-17 12:11:44,965 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 734a9db668b8b752d63047284f69df2b, NAME => 'testtb-testExportFileSystemState,,1689595888708.734a9db668b8b752d63047284f69df2b.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 640e2611f74902bc48c62a5c712524fc, NAME => 'testtb-testExportFileSystemState,1,1689595888708.640e2611f74902bc48c62a5c712524fc.', STARTKEY => '1', ENDKEY => ''}] 2023-07-17 12:11:44,965 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemState' as deleted. 2023-07-17 12:11:44,965 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689595904965"}]},"ts":"9223372036854775807"} 2023-07-17 12:11:44,967 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemState state from META 2023-07-17 12:11:44,969 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=41, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-17 12:11:44,970 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=41, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemState in 42 msec 2023-07-17 12:11:45,042 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42013] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-07-17 12:11:45,042 INFO [Listener at jenkins-hbase4.apache.org/44127] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemState, procId: 41 completed 2023-07-17 12:11:45,050 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42013] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemState" 2023-07-17 12:11:45,052 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42013] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemState 2023-07-17 12:11:45,053 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42013] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemState" 2023-07-17 12:11:45,055 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42013] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemState 2023-07-17 12:11:45,081 INFO [Listener at jenkins-hbase4.apache.org/44127] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=759 (was 749) Potentially hanging thread: HFileArchiver-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1847813108_17 at /127.0.0.1:60604 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-2026 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: ApplicationMasterLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1abcf153-shared-pool-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1847813108_17 at /127.0.0.1:53652 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1abcf153-shared-pool-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1516127048_1 at /127.0.0.1:60576 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1847813108_17 at /127.0.0.1:57032 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (232395425) connection to jenkins-hbase4.apache.org/172.31.14.131:37415 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x1abcf153-shared-pool-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (232395425) connection to jenkins-hbase4.apache.org/172.31.14.131:37519 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x1abcf153-shared-pool-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=939 (was 921) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=483 (was 490), ProcessCount=181 (was 180) - ProcessCount LEAK? -, AvailableMemoryMB=3050 (was 3134) 2023-07-17 12:11:45,082 WARN [Listener at jenkins-hbase4.apache.org/44127] hbase.ResourceChecker(130): Thread=759 is superior to 500 2023-07-17 12:11:45,103 INFO [Listener at jenkins-hbase4.apache.org/44127] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=759, OpenFileDescriptor=939, MaxFileDescriptor=60000, SystemLoadAverage=483, ProcessCount=181, AvailableMemoryMB=3049 2023-07-17 12:11:45,103 WARN [Listener at jenkins-hbase4.apache.org/44127] hbase.ResourceChecker(130): Thread=759 is superior to 500 2023-07-17 12:11:45,104 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42013] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-17 12:11:45,106 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42013] procedure2.ProcedureExecutor(1029): Stored pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testConsecutiveExports 2023-07-17 12:11:45,108 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_PRE_OPERATION 2023-07-17 12:11:45,108 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42013] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testConsecutiveExports" procId is: 42 2023-07-17 12:11:45,109 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-17 12:11:45,109 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42013] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-17 12:11:45,112 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.tmp/data/default/testtb-testConsecutiveExports/50a68336a8ca42089e7dc50f3af53173 2023-07-17 12:11:45,112 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.tmp/data/default/testtb-testConsecutiveExports/717e0279a7aadcbaef16a08a902d723a 2023-07-17 12:11:45,113 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.tmp/data/default/testtb-testConsecutiveExports/50a68336a8ca42089e7dc50f3af53173 empty. 2023-07-17 12:11:45,113 DEBUG [HFileArchiver-12] backup.HFileArchiver(153): Directory hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.tmp/data/default/testtb-testConsecutiveExports/717e0279a7aadcbaef16a08a902d723a empty. 2023-07-17 12:11:45,113 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.tmp/data/default/testtb-testConsecutiveExports/50a68336a8ca42089e7dc50f3af53173 2023-07-17 12:11:45,113 DEBUG [HFileArchiver-12] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.tmp/data/default/testtb-testConsecutiveExports/717e0279a7aadcbaef16a08a902d723a 2023-07-17 12:11:45,113 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-07-17 12:11:45,128 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.tmp/data/default/testtb-testConsecutiveExports/.tabledesc/.tableinfo.0000000001 2023-07-17 12:11:45,129 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(7675): creating {ENCODED => 50a68336a8ca42089e7dc50f3af53173, NAME => 'testtb-testConsecutiveExports,,1689595905104.50a68336a8ca42089e7dc50f3af53173.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.tmp 2023-07-17 12:11:45,129 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(7675): creating {ENCODED => 717e0279a7aadcbaef16a08a902d723a, NAME => 'testtb-testConsecutiveExports,1,1689595905104.717e0279a7aadcbaef16a08a902d723a.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.tmp 2023-07-17 12:11:45,158 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1689595905104.50a68336a8ca42089e7dc50f3af53173.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 12:11:45,159 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1604): Closing 50a68336a8ca42089e7dc50f3af53173, disabling compactions & flushes 2023-07-17 12:11:45,159 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1689595905104.717e0279a7aadcbaef16a08a902d723a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 12:11:45,159 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1689595905104.50a68336a8ca42089e7dc50f3af53173. 2023-07-17 12:11:45,159 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1604): Closing 717e0279a7aadcbaef16a08a902d723a, disabling compactions & flushes 2023-07-17 12:11:45,159 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1689595905104.50a68336a8ca42089e7dc50f3af53173. 2023-07-17 12:11:45,159 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1689595905104.717e0279a7aadcbaef16a08a902d723a. 2023-07-17 12:11:45,159 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1689595905104.50a68336a8ca42089e7dc50f3af53173. after waiting 0 ms 2023-07-17 12:11:45,159 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1689595905104.717e0279a7aadcbaef16a08a902d723a. 2023-07-17 12:11:45,159 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1689595905104.50a68336a8ca42089e7dc50f3af53173. 2023-07-17 12:11:45,159 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1689595905104.717e0279a7aadcbaef16a08a902d723a. after waiting 0 ms 2023-07-17 12:11:45,159 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1689595905104.50a68336a8ca42089e7dc50f3af53173. 2023-07-17 12:11:45,159 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1689595905104.717e0279a7aadcbaef16a08a902d723a. 2023-07-17 12:11:45,159 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1558): Region close journal for 50a68336a8ca42089e7dc50f3af53173: 2023-07-17 12:11:45,159 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1689595905104.717e0279a7aadcbaef16a08a902d723a. 2023-07-17 12:11:45,159 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1558): Region close journal for 717e0279a7aadcbaef16a08a902d723a: 2023-07-17 12:11:45,163 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ADD_TO_META 2023-07-17 12:11:45,165 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1689595905104.50a68336a8ca42089e7dc50f3af53173.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689595905164"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689595905164"}]},"ts":"1689595905164"} 2023-07-17 12:11:45,165 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1689595905104.717e0279a7aadcbaef16a08a902d723a.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689595905164"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689595905164"}]},"ts":"1689595905164"} 2023-07-17 12:11:45,168 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-17 12:11:45,170 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-17 12:11:45,170 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689595905170"}]},"ts":"1689595905170"} 2023-07-17 12:11:45,171 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLING in hbase:meta 2023-07-17 12:11:45,183 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-17 12:11:45,185 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-17 12:11:45,185 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-17 12:11:45,185 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-17 12:11:45,185 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-17 12:11:45,185 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=50a68336a8ca42089e7dc50f3af53173, ASSIGN}, {pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=717e0279a7aadcbaef16a08a902d723a, ASSIGN}] 2023-07-17 12:11:45,189 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=50a68336a8ca42089e7dc50f3af53173, ASSIGN 2023-07-17 12:11:45,189 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=717e0279a7aadcbaef16a08a902d723a, ASSIGN 2023-07-17 12:11:45,190 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=717e0279a7aadcbaef16a08a902d723a, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42615,1689595859906; forceNewPlan=false, retain=false 2023-07-17 12:11:45,190 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=50a68336a8ca42089e7dc50f3af53173, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39491,1689595859788; forceNewPlan=false, retain=false 2023-07-17 12:11:45,211 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42013] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-17 12:11:45,340 INFO [jenkins-hbase4:42013] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-17 12:11:45,343 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=50a68336a8ca42089e7dc50f3af53173, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:11:45,343 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=717e0279a7aadcbaef16a08a902d723a, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:11:45,343 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1689595905104.50a68336a8ca42089e7dc50f3af53173.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689595905343"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689595905343"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689595905343"}]},"ts":"1689595905343"} 2023-07-17 12:11:45,343 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1689595905104.717e0279a7aadcbaef16a08a902d723a.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689595905343"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689595905343"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689595905343"}]},"ts":"1689595905343"} 2023-07-17 12:11:45,345 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=43, state=RUNNABLE; OpenRegionProcedure 50a68336a8ca42089e7dc50f3af53173, server=jenkins-hbase4.apache.org,39491,1689595859788}] 2023-07-17 12:11:45,347 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=44, state=RUNNABLE; OpenRegionProcedure 717e0279a7aadcbaef16a08a902d723a, server=jenkins-hbase4.apache.org,42615,1689595859906}] 2023-07-17 12:11:45,412 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42013] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-17 12:11:45,501 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,,1689595905104.50a68336a8ca42089e7dc50f3af53173. 2023-07-17 12:11:45,501 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 50a68336a8ca42089e7dc50f3af53173, NAME => 'testtb-testConsecutiveExports,,1689595905104.50a68336a8ca42089e7dc50f3af53173.', STARTKEY => '', ENDKEY => '1'} 2023-07-17 12:11:45,502 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,,1689595905104.50a68336a8ca42089e7dc50f3af53173. service=AccessControlService 2023-07-17 12:11:45,502 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-17 12:11:45,502 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports 50a68336a8ca42089e7dc50f3af53173 2023-07-17 12:11:45,502 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1689595905104.50a68336a8ca42089e7dc50f3af53173.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 12:11:45,502 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 50a68336a8ca42089e7dc50f3af53173 2023-07-17 12:11:45,502 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 50a68336a8ca42089e7dc50f3af53173 2023-07-17 12:11:45,503 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,1,1689595905104.717e0279a7aadcbaef16a08a902d723a. 2023-07-17 12:11:45,504 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 717e0279a7aadcbaef16a08a902d723a, NAME => 'testtb-testConsecutiveExports,1,1689595905104.717e0279a7aadcbaef16a08a902d723a.', STARTKEY => '1', ENDKEY => ''} 2023-07-17 12:11:45,504 INFO [StoreOpener-50a68336a8ca42089e7dc50f3af53173-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 50a68336a8ca42089e7dc50f3af53173 2023-07-17 12:11:45,504 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,1,1689595905104.717e0279a7aadcbaef16a08a902d723a. service=AccessControlService 2023-07-17 12:11:45,504 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-17 12:11:45,504 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports 717e0279a7aadcbaef16a08a902d723a 2023-07-17 12:11:45,504 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1689595905104.717e0279a7aadcbaef16a08a902d723a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 12:11:45,504 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 717e0279a7aadcbaef16a08a902d723a 2023-07-17 12:11:45,504 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 717e0279a7aadcbaef16a08a902d723a 2023-07-17 12:11:45,505 INFO [StoreOpener-717e0279a7aadcbaef16a08a902d723a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 717e0279a7aadcbaef16a08a902d723a 2023-07-17 12:11:45,506 DEBUG [StoreOpener-50a68336a8ca42089e7dc50f3af53173-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/default/testtb-testConsecutiveExports/50a68336a8ca42089e7dc50f3af53173/cf 2023-07-17 12:11:45,506 DEBUG [StoreOpener-50a68336a8ca42089e7dc50f3af53173-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/default/testtb-testConsecutiveExports/50a68336a8ca42089e7dc50f3af53173/cf 2023-07-17 12:11:45,507 INFO [StoreOpener-50a68336a8ca42089e7dc50f3af53173-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 50a68336a8ca42089e7dc50f3af53173 columnFamilyName cf 2023-07-17 12:11:45,507 DEBUG [StoreOpener-717e0279a7aadcbaef16a08a902d723a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/default/testtb-testConsecutiveExports/717e0279a7aadcbaef16a08a902d723a/cf 2023-07-17 12:11:45,507 DEBUG [StoreOpener-717e0279a7aadcbaef16a08a902d723a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/default/testtb-testConsecutiveExports/717e0279a7aadcbaef16a08a902d723a/cf 2023-07-17 12:11:45,507 INFO [StoreOpener-717e0279a7aadcbaef16a08a902d723a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 717e0279a7aadcbaef16a08a902d723a columnFamilyName cf 2023-07-17 12:11:45,508 INFO [StoreOpener-717e0279a7aadcbaef16a08a902d723a-1] regionserver.HStore(310): Store=717e0279a7aadcbaef16a08a902d723a/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-17 12:11:45,509 INFO [StoreOpener-50a68336a8ca42089e7dc50f3af53173-1] regionserver.HStore(310): Store=50a68336a8ca42089e7dc50f3af53173/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-17 12:11:45,509 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/default/testtb-testConsecutiveExports/717e0279a7aadcbaef16a08a902d723a 2023-07-17 12:11:45,510 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/default/testtb-testConsecutiveExports/50a68336a8ca42089e7dc50f3af53173 2023-07-17 12:11:45,510 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/default/testtb-testConsecutiveExports/717e0279a7aadcbaef16a08a902d723a 2023-07-17 12:11:45,510 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/default/testtb-testConsecutiveExports/50a68336a8ca42089e7dc50f3af53173 2023-07-17 12:11:45,513 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 717e0279a7aadcbaef16a08a902d723a 2023-07-17 12:11:45,513 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 50a68336a8ca42089e7dc50f3af53173 2023-07-17 12:11:45,515 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/default/testtb-testConsecutiveExports/717e0279a7aadcbaef16a08a902d723a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-17 12:11:45,516 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/default/testtb-testConsecutiveExports/50a68336a8ca42089e7dc50f3af53173/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-17 12:11:45,516 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 717e0279a7aadcbaef16a08a902d723a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68761595, jitterRate=0.02462761104106903}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-17 12:11:45,516 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 717e0279a7aadcbaef16a08a902d723a: 2023-07-17 12:11:45,517 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 50a68336a8ca42089e7dc50f3af53173; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62361965, jitterRate=-0.07073430716991425}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-17 12:11:45,517 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 50a68336a8ca42089e7dc50f3af53173: 2023-07-17 12:11:45,517 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,1,1689595905104.717e0279a7aadcbaef16a08a902d723a., pid=46, masterSystemTime=1689595905499 2023-07-17 12:11:45,518 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,,1689595905104.50a68336a8ca42089e7dc50f3af53173., pid=45, masterSystemTime=1689595905498 2023-07-17 12:11:45,519 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,1,1689595905104.717e0279a7aadcbaef16a08a902d723a. 2023-07-17 12:11:45,519 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,1,1689595905104.717e0279a7aadcbaef16a08a902d723a. 2023-07-17 12:11:45,520 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,,1689595905104.50a68336a8ca42089e7dc50f3af53173. 2023-07-17 12:11:45,520 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,,1689595905104.50a68336a8ca42089e7dc50f3af53173. 2023-07-17 12:11:45,522 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=50a68336a8ca42089e7dc50f3af53173, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:11:45,522 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=717e0279a7aadcbaef16a08a902d723a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:11:45,522 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,,1689595905104.50a68336a8ca42089e7dc50f3af53173.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689595905522"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689595905522"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689595905522"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689595905522"}]},"ts":"1689595905522"} 2023-07-17 12:11:45,523 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,1,1689595905104.717e0279a7aadcbaef16a08a902d723a.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689595905522"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689595905522"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689595905522"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689595905522"}]},"ts":"1689595905522"} 2023-07-17 12:11:45,527 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=43 2023-07-17 12:11:45,527 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=43, state=SUCCESS; OpenRegionProcedure 50a68336a8ca42089e7dc50f3af53173, server=jenkins-hbase4.apache.org,39491,1689595859788 in 179 msec 2023-07-17 12:11:45,528 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=44 2023-07-17 12:11:45,528 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=44, state=SUCCESS; OpenRegionProcedure 717e0279a7aadcbaef16a08a902d723a, server=jenkins-hbase4.apache.org,42615,1689595859906 in 178 msec 2023-07-17 12:11:45,529 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=43, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=50a68336a8ca42089e7dc50f3af53173, ASSIGN in 342 msec 2023-07-17 12:11:45,531 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=44, resume processing ppid=42 2023-07-17 12:11:45,531 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=717e0279a7aadcbaef16a08a902d723a, ASSIGN in 343 msec 2023-07-17 12:11:45,532 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-17 12:11:45,532 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689595905532"}]},"ts":"1689595905532"} 2023-07-17 12:11:45,534 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLED in hbase:meta 2023-07-17 12:11:45,536 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_POST_OPERATION 2023-07-17 12:11:45,537 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testConsecutiveExports jenkins: RWXCA 2023-07-17 12:11:45,539 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39491] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-17 12:11:45,541 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:33685-0x10173314c9f0002, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 12:11:45,541 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:39491-0x10173314c9f0001, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 12:11:45,541 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 12:11:45,541 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:42615-0x10173314c9f0003, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 12:11:45,543 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-17 12:11:45,543 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-17 12:11:45,543 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-17 12:11:45,545 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=42, state=SUCCESS; CreateTableProcedure table=testtb-testConsecutiveExports in 438 msec 2023-07-17 12:11:45,547 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-17 12:11:45,713 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42013] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-17 12:11:45,713 INFO [Listener at jenkins-hbase4.apache.org/44127] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testConsecutiveExports, procId: 42 completed 2023-07-17 12:11:45,716 DEBUG [Listener at jenkins-hbase4.apache.org/44127] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-07-17 12:11:45,717 DEBUG [Listener at jenkins-hbase4.apache.org/44127] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1689595905104.50a68336a8ca42089e7dc50f3af53173. 2023-07-17 12:11:45,718 INFO [Listener at jenkins-hbase4.apache.org/44127] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-17 12:11:45,733 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42013] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-17 12:11:45,733 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42013] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689595905733 (current time:1689595905733). 2023-07-17 12:11:45,733 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42013] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-17 12:11:45,734 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42013] zookeeper.ReadOnlyZKClient(139): Connect 0x620b527b to 127.0.0.1:55622 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-17 12:11:45,741 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42013] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@44cdf7f9, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-17 12:11:45,743 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42013] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 12:11:45,746 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49664, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 12:11:45,748 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42013] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x620b527b to 127.0.0.1:55622 2023-07-17 12:11:45,748 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42013] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 12:11:45,748 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42013] zookeeper.ReadOnlyZKClient(139): Connect 0x3296be93 to 127.0.0.1:55622 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-17 12:11:45,754 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42013] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@ab6ba30, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-17 12:11:45,756 DEBUG [hconnection-0x21eff6a0-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 12:11:45,759 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49672, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 12:11:45,763 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42013] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 12:11:45,766 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58612, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 12:11:45,767 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42013] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3296be93 to 127.0.0.1:55622 2023-07-17 12:11:45,767 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42013] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 12:11:45,767 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42013] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-17 12:11:45,768 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42013] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-17 12:11:45,768 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42013] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-17 12:11:45,771 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42013] procedure2.ProcedureExecutor(1029): Stored pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-17 12:11:45,773 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-17 12:11:45,774 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=47, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1689596505774 2023-07-17 12:11:45,774 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-07-17 12:11:45,774 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42013] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-17 12:11:45,775 DEBUG [Listener at jenkins-hbase4.apache.org/44127] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-17 12:11:45,776 DEBUG [Listener at jenkins-hbase4.apache.org/44127] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-17 12:11:45,777 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=47, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-17 12:11:45,777 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-17 12:11:45,779 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=47, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 7 msec 2023-07-17 12:11:45,779 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-17 12:11:45,780 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1689596505780 2023-07-17 12:11:45,799 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testConsecutiveExports 2023-07-17 12:11:45,799 INFO [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testConsecutiveExports' 2023-07-17 12:11:45,799 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 12:11:45,800 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' 2023-07-17 12:11:45,800 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-07-17 12:11:45,801 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-17 12:11:45,801 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-17 12:11:45,803 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:39491-0x10173314c9f0001, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 12:11:45,803 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:42615-0x10173314c9f0003, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 12:11:45,803 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 12:11:45,803 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 12:11:45,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 12:11:45,803 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:11:45,803 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:33685-0x10173314c9f0002, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 12:11:45,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 12:11:45,803 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 12:11:45,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 12:11:45,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-17 12:11:45,804 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:11:45,804 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:11:45,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-17 12:11:45,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-17 12:11:45,804 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39491-0x10173314c9f0001, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-17 12:11:45,804 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42615-0x10173314c9f0003, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-17 12:11:45,804 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:11:45,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-17 12:11:45,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-17 12:11:45,804 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33685-0x10173314c9f0002, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-17 12:11:45,805 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-17 12:11:45,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-17 12:11:45,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-17 12:11:45,805 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-17 12:11:45,805 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-17 12:11:45,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-17 12:11:45,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-17 12:11:45,805 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-17 12:11:45,805 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-17 12:11:45,805 DEBUG [member: 'jenkins-hbase4.apache.org,39491,1689595859788' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-17 12:11:45,805 DEBUG [member: 'jenkins-hbase4.apache.org,39491,1689595859788' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 12:11:45,812 DEBUG [member: 'jenkins-hbase4.apache.org,39491,1689595859788' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-17 12:11:45,812 DEBUG [member: 'jenkins-hbase4.apache.org,39491,1689595859788' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-17 12:11:45,812 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-17 12:11:45,812 DEBUG [member: 'jenkins-hbase4.apache.org,39491,1689595859788' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39491,1689595859788' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-17 12:11:45,813 DEBUG [member: 'jenkins-hbase4.apache.org,33685,1689595859854' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-17 12:11:45,812 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-17 12:11:45,813 DEBUG [member: 'jenkins-hbase4.apache.org,33685,1689595859854' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 12:11:45,813 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-17 12:11:45,814 DEBUG [member: 'jenkins-hbase4.apache.org,33685,1689595859854' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-17 12:11:45,814 DEBUG [member: 'jenkins-hbase4.apache.org,33685,1689595859854' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-17 12:11:45,814 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 12:11:45,814 DEBUG [member: 'jenkins-hbase4.apache.org,33685,1689595859854' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33685,1689595859854' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-17 12:11:45,818 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-17 12:11:45,818 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-17 12:11:45,818 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42615,1689595859906' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-17 12:11:45,819 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:11:45,819 DEBUG [member: 'jenkins-hbase4.apache.org,39491,1689595859788' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-17 12:11:45,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:11:45,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 12:11:45,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 12:11:45,821 DEBUG [member: 'jenkins-hbase4.apache.org,33685,1689595859854' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-17 12:11:45,821 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:11:45,821 DEBUG [member: 'jenkins-hbase4.apache.org,39491,1689595859788' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39491-0x10173314c9f0001, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-17 12:11:45,821 DEBUG [member: 'jenkins-hbase4.apache.org,39491,1689595859788' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 12:11:45,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 12:11:45,821 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-17 12:11:45,821 DEBUG [member: 'jenkins-hbase4.apache.org,33685,1689595859854' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33685-0x10173314c9f0002, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-17 12:11:45,821 DEBUG [member: 'jenkins-hbase4.apache.org,33685,1689595859854' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 12:11:45,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 12:11:45,821 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42615-0x10173314c9f0003, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-17 12:11:45,822 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 12:11:45,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-17 12:11:45,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:11:45,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:11:45,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:11:45,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 12:11:45,824 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39491,1689595859788' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-07-17 12:11:45,824 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@56049627[Count = 1] remaining members to acquire global barrier 2023-07-17 12:11:45,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:11:45,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 12:11:45,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 12:11:45,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 12:11:45,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 12:11:45,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-17 12:11:45,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:11:45,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:11:45,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:11:45,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 12:11:45,830 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42615,1689595859906' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-07-17 12:11:45,830 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@56049627[Count = 0] remaining members to acquire global barrier 2023-07-17 12:11:45,830 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-07-17 12:11:45,830 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-17 12:11:45,832 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:33685-0x10173314c9f0002, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-17 12:11:45,832 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:39491-0x10173314c9f0001, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-17 12:11:45,832 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-17 12:11:45,832 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-17 12:11:45,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-17 12:11:45,832 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:42615-0x10173314c9f0003, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-17 12:11:45,832 DEBUG [member: 'jenkins-hbase4.apache.org,39491,1689595859788' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-17 12:11:45,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-17 12:11:45,832 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-17 12:11:45,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-17 12:11:45,832 DEBUG [member: 'jenkins-hbase4.apache.org,33685,1689595859854' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-17 12:11:45,832 DEBUG [member: 'jenkins-hbase4.apache.org,33685,1689595859854' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-17 12:11:45,833 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-17 12:11:45,833 DEBUG [member: 'jenkins-hbase4.apache.org,33685,1689595859854' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,33685,1689595859854' in zk 2023-07-17 12:11:45,837 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:11:45,838 DEBUG [member: 'jenkins-hbase4.apache.org,39491,1689595859788' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-17 12:11:45,839 DEBUG [member: 'jenkins-hbase4.apache.org,39491,1689595859788' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-17 12:11:45,839 DEBUG [rs(jenkins-hbase4.apache.org,39491,1689595859788)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1689595905104.50a68336a8ca42089e7dc50f3af53173. 2023-07-17 12:11:45,839 DEBUG [rs(jenkins-hbase4.apache.org,39491,1689595859788)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1689595905104.50a68336a8ca42089e7dc50f3af53173. started... 2023-07-17 12:11:45,839 DEBUG [rs(jenkins-hbase4.apache.org,39491,1689595859788)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 50a68336a8ca42089e7dc50f3af53173: 2023-07-17 12:11:45,839 DEBUG [rs(jenkins-hbase4.apache.org,39491,1689595859788)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1689595905104.50a68336a8ca42089e7dc50f3af53173.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-17 12:11:45,839 DEBUG [rs(jenkins-hbase4.apache.org,39491,1689595859788)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-17 12:11:45,839 DEBUG [rs(jenkins-hbase4.apache.org,39491,1689595859788)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-17 12:11:45,842 DEBUG [member: 'jenkins-hbase4.apache.org,33685,1689595859854' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-17 12:11:45,842 DEBUG [member: 'jenkins-hbase4.apache.org,33685,1689595859854' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 12:11:45,842 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:11:45,842 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-17 12:11:45,842 DEBUG [member: 'jenkins-hbase4.apache.org,33685,1689595859854' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-17 12:11:45,846 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-17 12:11:45,847 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-17 12:11:45,847 DEBUG [rs(jenkins-hbase4.apache.org,42615,1689595859906)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1689595905104.717e0279a7aadcbaef16a08a902d723a. 2023-07-17 12:11:45,847 DEBUG [rs(jenkins-hbase4.apache.org,42615,1689595859906)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1689595905104.717e0279a7aadcbaef16a08a902d723a. started... 2023-07-17 12:11:45,850 DEBUG [rs(jenkins-hbase4.apache.org,42615,1689595859906)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 717e0279a7aadcbaef16a08a902d723a: 2023-07-17 12:11:45,853 DEBUG [rs(jenkins-hbase4.apache.org,42615,1689595859906)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1689595905104.717e0279a7aadcbaef16a08a902d723a.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-17 12:11:45,864 DEBUG [rs(jenkins-hbase4.apache.org,42615,1689595859906)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-17 12:11:45,864 DEBUG [rs(jenkins-hbase4.apache.org,42615,1689595859906)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-17 12:11:45,876 DEBUG [Listener at jenkins-hbase4.apache.org/44127] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 12:11:45,877 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42013] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-17 12:11:45,877 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42013] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-17 12:11:45,878 DEBUG [Listener at jenkins-hbase4.apache.org/44127] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-17 12:11:45,900 DEBUG [rs(jenkins-hbase4.apache.org,39491,1689595859788)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1689595905104.50a68336a8ca42089e7dc50f3af53173. completed. 2023-07-17 12:11:45,901 DEBUG [rs(jenkins-hbase4.apache.org,39491,1689595859788)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1689595905104.50a68336a8ca42089e7dc50f3af53173. 2023-07-17 12:11:45,901 DEBUG [member: 'jenkins-hbase4.apache.org,39491,1689595859788' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-17 12:11:45,901 DEBUG [member: 'jenkins-hbase4.apache.org,39491,1689595859788' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-17 12:11:45,901 DEBUG [member: 'jenkins-hbase4.apache.org,39491,1689595859788' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:11:45,901 DEBUG [member: 'jenkins-hbase4.apache.org,39491,1689595859788' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-17 12:11:45,901 DEBUG [member: 'jenkins-hbase4.apache.org,39491,1689595859788' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,39491,1689595859788' in zk 2023-07-17 12:11:45,903 DEBUG [member: 'jenkins-hbase4.apache.org,39491,1689595859788' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-17 12:11:45,903 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:11:45,903 DEBUG [member: 'jenkins-hbase4.apache.org,39491,1689595859788' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 12:11:45,903 DEBUG [member: 'jenkins-hbase4.apache.org,39491,1689595859788' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-17 12:11:45,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:11:45,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 12:11:45,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 12:11:45,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 12:11:45,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 12:11:45,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-17 12:11:45,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:11:45,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:11:45,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:11:45,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 12:11:45,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-17 12:11:45,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:11:45,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:11:45,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,39491,1689595859788': 2023-07-17 12:11:45,913 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39491,1689595859788' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-07-17 12:11:45,938 DEBUG [rs(jenkins-hbase4.apache.org,42615,1689595859906)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1689595905104.717e0279a7aadcbaef16a08a902d723a. completed. 2023-07-17 12:11:45,938 DEBUG [rs(jenkins-hbase4.apache.org,42615,1689595859906)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1689595905104.717e0279a7aadcbaef16a08a902d723a. 2023-07-17 12:11:45,938 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-17 12:11:45,938 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-17 12:11:45,938 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:11:45,939 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-17 12:11:45,939 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,42615,1689595859906' in zk 2023-07-17 12:11:45,943 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-17 12:11:45,943 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 12:11:45,943 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-17 12:11:45,943 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:11:45,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:11:45,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 12:11:45,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 12:11:45,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 12:11:45,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 12:11:45,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-17 12:11:45,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:11:45,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:11:45,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:11:45,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 12:11:45,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-17 12:11:45,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:11:45,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:11:45,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:11:45,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,42615,1689595859906': 2023-07-17 12:11:45,977 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42615,1689595859906' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-07-17 12:11:45,977 INFO [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testConsecutiveExports' execution completed 2023-07-17 12:11:45,977 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-17 12:11:45,977 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-17 12:11:45,977 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testConsecutiveExports 2023-07-17 12:11:45,977 INFO [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-17 12:11:45,979 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:33685-0x10173314c9f0002, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-17 12:11:45,979 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:33685-0x10173314c9f0002, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 12:11:45,979 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-17 12:11:45,979 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:39491-0x10173314c9f0001, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-17 12:11:45,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-17 12:11:45,980 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:42615-0x10173314c9f0003, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-17 12:11:45,980 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:39491-0x10173314c9f0001, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 12:11:45,980 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-17 12:11:45,980 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-17 12:11:45,980 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-17 12:11:45,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-17 12:11:45,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 12:11:45,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 12:11:45,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-17 12:11:45,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-17 12:11:45,980 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:42615-0x10173314c9f0003, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 12:11:45,980 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 12:11:45,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 12:11:45,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 12:11:45,981 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:11:45,981 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 12:11:45,981 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 12:11:45,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-17 12:11:45,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-17 12:11:45,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 12:11:45,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 12:11:45,981 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:11:45,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 12:11:45,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-17 12:11:45,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-17 12:11:45,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-17 12:11:45,982 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:11:45,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:11:45,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:11:45,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:11:45,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 12:11:45,984 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:11:45,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-17 12:11:45,985 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:11:45,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:11:45,985 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:11:45,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:11:45,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:11:45,989 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:33685-0x10173314c9f0002, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 12:11:45,989 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:42615-0x10173314c9f0003, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 12:11:45,989 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 12:11:45,990 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 12:11:45,990 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:42615-0x10173314c9f0003, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 12:11:45,990 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 12:11:45,989 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:39491-0x10173314c9f0001, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 12:11:45,991 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:11:45,991 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 12:11:45,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 12:11:45,990 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testConsecutiveExports 2023-07-17 12:11:45,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 12:11:45,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 12:11:45,990 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:33685-0x10173314c9f0002, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 12:11:45,992 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-07-17 12:11:45,991 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-17 12:11:45,991 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:39491-0x10173314c9f0001, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 12:11:45,992 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-17 12:11:45,992 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:11:45,992 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:11:45,992 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-17 12:11:45,992 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:11:45,992 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-17 12:11:45,992 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-17 12:11:45,992 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 12:11:45,992 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 12:11:45,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 12:11:45,992 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:11:45,992 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:11:45,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 12:11:45,993 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-17 12:11:45,993 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-17 12:11:45,993 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 12:11:45,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 12:11:45,993 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-17 12:11:46,008 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testConsecutiveExports 2023-07-17 12:11:46,009 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-17 12:11:46,030 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports to hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.hbase-snapshot/emptySnaptb0-testConsecutiveExports 2023-07-17 12:11:46,070 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-07-17 12:11:46,070 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-17 12:11:46,071 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-17 12:11:46,071 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1689595905774Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1689595906008 (+234 ms)Consolidate snapshot: emptySnaptb0-testConsecutiveExports at 1689595906008Loading Region manifests for emptySnaptb0-testConsecutiveExports at 1689595906009 (+1 ms)Writing data manifest for emptySnaptb0-testConsecutiveExports at 1689595906012 (+3 ms)Verifying snapshot: emptySnaptb0-testConsecutiveExports at 1689595906022 (+10 ms)Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1689595906070 (+48 ms) 2023-07-17 12:11:46,076 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-17 12:11:46,078 DEBUG [Listener at jenkins-hbase4.apache.org/44127] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 12:11:46,078 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 301 msec 2023-07-17 12:11:46,079 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42013] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-17 12:11:46,079 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42013] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-17 12:11:46,082 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39491] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,,1689595905104.50a68336a8ca42089e7dc50f3af53173. with WAL disabled. Data may be lost in the event of a crash. 2023-07-17 12:11:46,085 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42615] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,1,1689595905104.717e0279a7aadcbaef16a08a902d723a. with WAL disabled. Data may be lost in the event of a crash. 2023-07-17 12:11:46,089 DEBUG [Listener at jenkins-hbase4.apache.org/44127] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-07-17 12:11:46,089 DEBUG [Listener at jenkins-hbase4.apache.org/44127] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1689595905104.50a68336a8ca42089e7dc50f3af53173. 2023-07-17 12:11:46,089 INFO [Listener at jenkins-hbase4.apache.org/44127] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-17 12:11:46,103 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42013] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-17 12:11:46,103 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42013] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689595906103 (current time:1689595906103). 2023-07-17 12:11:46,103 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42013] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-17 12:11:46,104 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42013] zookeeper.ReadOnlyZKClient(139): Connect 0x33ae06e6 to 127.0.0.1:55622 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-17 12:11:46,120 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42013] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@53a6dcde, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-17 12:11:46,126 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42013] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 12:11:46,127 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49684, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 12:11:46,128 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42013] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x33ae06e6 to 127.0.0.1:55622 2023-07-17 12:11:46,129 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42013] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 12:11:46,129 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42013] zookeeper.ReadOnlyZKClient(139): Connect 0x281bc1e1 to 127.0.0.1:55622 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-17 12:11:46,151 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42013] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6b417b32, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-17 12:11:46,154 DEBUG [hconnection-0xee41aa8-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 12:11:46,157 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49700, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 12:11:46,162 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42013] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 12:11:46,164 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58628, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 12:11:46,165 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42013] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x281bc1e1 to 127.0.0.1:55622 2023-07-17 12:11:46,165 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42013] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 12:11:46,165 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42013] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-17 12:11:46,167 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42013] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-17 12:11:46,167 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42013] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-17 12:11:46,170 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42013] procedure2.ProcedureExecutor(1029): Stored pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-17 12:11:46,172 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-17 12:11:46,173 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=49, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1689596506173 2023-07-17 12:11:46,173 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-07-17 12:11:46,173 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42013] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-17 12:11:46,175 DEBUG [Listener at jenkins-hbase4.apache.org/44127] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-17 12:11:46,175 DEBUG [Listener at jenkins-hbase4.apache.org/44127] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-17 12:11:46,177 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=49, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-17 12:11:46,177 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-17 12:11:46,178 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=49, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 8 msec 2023-07-17 12:11:46,179 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-17 12:11:46,180 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=50, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1689596506180 2023-07-17 12:11:46,196 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testConsecutiveExports 2023-07-17 12:11:46,196 INFO [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testConsecutiveExports' 2023-07-17 12:11:46,196 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 12:11:46,197 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testConsecutiveExports' starting 'acquire' 2023-07-17 12:11:46,197 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-07-17 12:11:46,198 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-17 12:11:46,198 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-17 12:11:46,199 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:42615-0x10173314c9f0003, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 12:11:46,199 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:11:46,199 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:33685-0x10173314c9f0002, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 12:11:46,200 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 12:11:46,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 12:11:46,199 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:39491-0x10173314c9f0001, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 12:11:46,200 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 12:11:46,200 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:11:46,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 12:11:46,200 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 12:11:46,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-17 12:11:46,200 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:11:46,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 12:11:46,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-17 12:11:46,200 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42615-0x10173314c9f0003, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-17 12:11:46,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-17 12:11:46,201 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:11:46,201 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-17 12:11:46,201 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33685-0x10173314c9f0002, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-17 12:11:46,201 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39491-0x10173314c9f0001, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-17 12:11:46,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-17 12:11:46,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-17 12:11:46,201 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-17 12:11:46,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-17 12:11:46,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-17 12:11:46,201 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-17 12:11:46,201 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-17 12:11:46,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-17 12:11:46,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-17 12:11:46,202 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-17 12:11:46,202 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 12:11:46,202 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-17 12:11:46,202 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-17 12:11:46,203 DEBUG [member: 'jenkins-hbase4.apache.org,39491,1689595859788' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-17 12:11:46,203 DEBUG [member: 'jenkins-hbase4.apache.org,39491,1689595859788' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 12:11:46,203 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-17 12:11:46,203 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-17 12:11:46,204 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-17 12:11:46,212 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42615,1689595859906' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-17 12:11:46,212 DEBUG [member: 'jenkins-hbase4.apache.org,33685,1689595859854' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-17 12:11:46,212 DEBUG [member: 'jenkins-hbase4.apache.org,33685,1689595859854' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 12:11:46,212 DEBUG [member: 'jenkins-hbase4.apache.org,39491,1689595859788' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-17 12:11:46,213 DEBUG [member: 'jenkins-hbase4.apache.org,39491,1689595859788' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-17 12:11:46,213 DEBUG [member: 'jenkins-hbase4.apache.org,33685,1689595859854' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-17 12:11:46,214 DEBUG [member: 'jenkins-hbase4.apache.org,33685,1689595859854' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-17 12:11:46,213 DEBUG [member: 'jenkins-hbase4.apache.org,39491,1689595859788' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39491,1689595859788' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-17 12:11:46,214 DEBUG [member: 'jenkins-hbase4.apache.org,33685,1689595859854' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33685,1689595859854' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-17 12:11:46,216 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-17 12:11:46,216 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:11:46,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:11:46,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 12:11:46,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 12:11:46,217 DEBUG [member: 'jenkins-hbase4.apache.org,33685,1689595859854' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-17 12:11:46,217 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:11:46,217 DEBUG [member: 'jenkins-hbase4.apache.org,39491,1689595859788' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-17 12:11:46,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 12:11:46,217 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42615-0x10173314c9f0003, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-17 12:11:46,217 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 12:11:46,217 DEBUG [member: 'jenkins-hbase4.apache.org,33685,1689595859854' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33685-0x10173314c9f0002, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-17 12:11:46,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 12:11:46,217 DEBUG [member: 'jenkins-hbase4.apache.org,33685,1689595859854' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 12:11:46,217 DEBUG [member: 'jenkins-hbase4.apache.org,39491,1689595859788' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39491-0x10173314c9f0001, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-17 12:11:46,217 DEBUG [member: 'jenkins-hbase4.apache.org,39491,1689595859788' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 12:11:46,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-17 12:11:46,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:11:46,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:11:46,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:11:46,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 12:11:46,219 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42615,1689595859906' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-07-17 12:11:46,219 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@62a0b6da[Count = 1] remaining members to acquire global barrier 2023-07-17 12:11:46,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:11:46,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 12:11:46,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 12:11:46,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 12:11:46,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 12:11:46,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-17 12:11:46,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:11:46,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:11:46,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:11:46,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 12:11:46,221 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39491,1689595859788' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-07-17 12:11:46,221 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@62a0b6da[Count = 0] remaining members to acquire global barrier 2023-07-17 12:11:46,221 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-07-17 12:11:46,221 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-17 12:11:46,222 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:42615-0x10173314c9f0003, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-17 12:11:46,222 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:33685-0x10173314c9f0002, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-17 12:11:46,222 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-17 12:11:46,222 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-17 12:11:46,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-17 12:11:46,222 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:39491-0x10173314c9f0001, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-17 12:11:46,223 DEBUG [member: 'jenkins-hbase4.apache.org,33685,1689595859854' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-17 12:11:46,223 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-17 12:11:46,223 DEBUG [member: 'jenkins-hbase4.apache.org,33685,1689595859854' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-17 12:11:46,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-17 12:11:46,223 DEBUG [member: 'jenkins-hbase4.apache.org,33685,1689595859854' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,33685,1689595859854' in zk 2023-07-17 12:11:46,223 DEBUG [member: 'jenkins-hbase4.apache.org,39491,1689595859788' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-17 12:11:46,223 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:11:46,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-17 12:11:46,223 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-17 12:11:46,223 DEBUG [member: 'jenkins-hbase4.apache.org,39491,1689595859788' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-17 12:11:46,223 DEBUG [member: 'jenkins-hbase4.apache.org,39491,1689595859788' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-17 12:11:46,223 DEBUG [rs(jenkins-hbase4.apache.org,39491,1689595859788)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1689595905104.50a68336a8ca42089e7dc50f3af53173. 2023-07-17 12:11:46,223 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-17 12:11:46,223 DEBUG [rs(jenkins-hbase4.apache.org,39491,1689595859788)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1689595905104.50a68336a8ca42089e7dc50f3af53173. started... 2023-07-17 12:11:46,223 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-17 12:11:46,223 DEBUG [rs(jenkins-hbase4.apache.org,42615,1689595859906)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1689595905104.717e0279a7aadcbaef16a08a902d723a. 2023-07-17 12:11:46,223 DEBUG [rs(jenkins-hbase4.apache.org,42615,1689595859906)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1689595905104.717e0279a7aadcbaef16a08a902d723a. started... 2023-07-17 12:11:46,223 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:11:46,223 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-17 12:11:46,223 INFO [rs(jenkins-hbase4.apache.org,39491,1689595859788)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 50a68336a8ca42089e7dc50f3af53173 1/1 column families, dataSize=132 B heapSize=544 B 2023-07-17 12:11:46,223 INFO [rs(jenkins-hbase4.apache.org,42615,1689595859906)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 717e0279a7aadcbaef16a08a902d723a 1/1 column families, dataSize=3.13 KB heapSize=7 KB 2023-07-17 12:11:46,225 DEBUG [member: 'jenkins-hbase4.apache.org,33685,1689595859854' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-17 12:11:46,225 DEBUG [member: 'jenkins-hbase4.apache.org,33685,1689595859854' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 12:11:46,225 DEBUG [member: 'jenkins-hbase4.apache.org,33685,1689595859854' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-17 12:11:46,243 INFO [rs(jenkins-hbase4.apache.org,42615,1689595859906)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023071717e2a0e274224d1ebb7eb3ec9ce9120b to hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b2023071717e2a0e274224d1ebb7eb3ec9ce9120b 2023-07-17 12:11:46,243 INFO [rs(jenkins-hbase4.apache.org,39491,1689595859788)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230717495ceda8b6424282b1abbb5193c2fb7e to hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230717495ceda8b6424282b1abbb5193c2fb7e 2023-07-17 12:11:46,275 DEBUG [Listener at jenkins-hbase4.apache.org/44127] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 12:11:46,277 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42013] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-17 12:11:46,277 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42013] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-17 12:11:46,277 DEBUG [Listener at jenkins-hbase4.apache.org/44127] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-17 12:11:46,477 DEBUG [Listener at jenkins-hbase4.apache.org/44127] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 12:11:46,479 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42013] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-17 12:11:46,479 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42013] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-17 12:11:46,480 DEBUG [Listener at jenkins-hbase4.apache.org/44127] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-17 12:11:46,659 INFO [rs(jenkins-hbase4.apache.org,39491,1689595859788)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=132, hasBloomFilter=true, into tmp file hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/default/testtb-testConsecutiveExports/50a68336a8ca42089e7dc50f3af53173/.tmp/cf/6e2edaa7d2b340f1b4e2c29842be1191 2023-07-17 12:11:46,659 INFO [rs(jenkins-hbase4.apache.org,42615,1689595859906)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/default/testtb-testConsecutiveExports/717e0279a7aadcbaef16a08a902d723a/.tmp/cf/035e62b5019f4c5da85900f3e546dd94 2023-07-17 12:11:46,666 DEBUG [rs(jenkins-hbase4.apache.org,42615,1689595859906)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/default/testtb-testConsecutiveExports/717e0279a7aadcbaef16a08a902d723a/.tmp/cf/035e62b5019f4c5da85900f3e546dd94 as hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/default/testtb-testConsecutiveExports/717e0279a7aadcbaef16a08a902d723a/cf/035e62b5019f4c5da85900f3e546dd94 2023-07-17 12:11:46,666 DEBUG [rs(jenkins-hbase4.apache.org,39491,1689595859788)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/default/testtb-testConsecutiveExports/50a68336a8ca42089e7dc50f3af53173/.tmp/cf/6e2edaa7d2b340f1b4e2c29842be1191 as hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/default/testtb-testConsecutiveExports/50a68336a8ca42089e7dc50f3af53173/cf/6e2edaa7d2b340f1b4e2c29842be1191 2023-07-17 12:11:46,672 INFO [rs(jenkins-hbase4.apache.org,42615,1689595859906)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/default/testtb-testConsecutiveExports/717e0279a7aadcbaef16a08a902d723a/cf/035e62b5019f4c5da85900f3e546dd94, entries=48, sequenceid=6, filesize=12.9 K 2023-07-17 12:11:46,673 INFO [rs(jenkins-hbase4.apache.org,39491,1689595859788)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/default/testtb-testConsecutiveExports/50a68336a8ca42089e7dc50f3af53173/cf/6e2edaa7d2b340f1b4e2c29842be1191, entries=2, sequenceid=6, filesize=5.2 K 2023-07-17 12:11:46,674 INFO [rs(jenkins-hbase4.apache.org,42615,1689595859906)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.13 KB/3204, heapSize ~6.98 KB/7152, currentSize=0 B/0 for 717e0279a7aadcbaef16a08a902d723a in 451ms, sequenceid=6, compaction requested=false 2023-07-17 12:11:46,674 INFO [rs(jenkins-hbase4.apache.org,39491,1689595859788)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~132 B/132, heapSize ~528 B/528, currentSize=0 B/0 for 50a68336a8ca42089e7dc50f3af53173 in 451ms, sequenceid=6, compaction requested=false 2023-07-17 12:11:46,674 DEBUG [rs(jenkins-hbase4.apache.org,42615,1689595859906)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-07-17 12:11:46,674 DEBUG [rs(jenkins-hbase4.apache.org,39491,1689595859788)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-07-17 12:11:46,676 DEBUG [rs(jenkins-hbase4.apache.org,42615,1689595859906)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 717e0279a7aadcbaef16a08a902d723a: 2023-07-17 12:11:46,676 DEBUG [rs(jenkins-hbase4.apache.org,39491,1689595859788)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 50a68336a8ca42089e7dc50f3af53173: 2023-07-17 12:11:46,677 DEBUG [rs(jenkins-hbase4.apache.org,42615,1689595859906)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1689595905104.717e0279a7aadcbaef16a08a902d723a.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-17 12:11:46,677 DEBUG [rs(jenkins-hbase4.apache.org,39491,1689595859788)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1689595905104.50a68336a8ca42089e7dc50f3af53173.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-17 12:11:46,677 DEBUG [rs(jenkins-hbase4.apache.org,39491,1689595859788)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-17 12:11:46,677 DEBUG [rs(jenkins-hbase4.apache.org,42615,1689595859906)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-17 12:11:46,677 DEBUG [rs(jenkins-hbase4.apache.org,39491,1689595859788)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/default/testtb-testConsecutiveExports/50a68336a8ca42089e7dc50f3af53173/cf/6e2edaa7d2b340f1b4e2c29842be1191] hfiles 2023-07-17 12:11:46,677 DEBUG [rs(jenkins-hbase4.apache.org,39491,1689595859788)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/default/testtb-testConsecutiveExports/50a68336a8ca42089e7dc50f3af53173/cf/6e2edaa7d2b340f1b4e2c29842be1191 for snapshot=snaptb0-testConsecutiveExports 2023-07-17 12:11:46,677 DEBUG [rs(jenkins-hbase4.apache.org,42615,1689595859906)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/default/testtb-testConsecutiveExports/717e0279a7aadcbaef16a08a902d723a/cf/035e62b5019f4c5da85900f3e546dd94] hfiles 2023-07-17 12:11:46,677 DEBUG [rs(jenkins-hbase4.apache.org,42615,1689595859906)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/default/testtb-testConsecutiveExports/717e0279a7aadcbaef16a08a902d723a/cf/035e62b5019f4c5da85900f3e546dd94 for snapshot=snaptb0-testConsecutiveExports 2023-07-17 12:11:46,701 DEBUG [rs(jenkins-hbase4.apache.org,39491,1689595859788)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1689595905104.50a68336a8ca42089e7dc50f3af53173. completed. 2023-07-17 12:11:46,701 DEBUG [rs(jenkins-hbase4.apache.org,39491,1689595859788)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1689595905104.50a68336a8ca42089e7dc50f3af53173. 2023-07-17 12:11:46,701 DEBUG [member: 'jenkins-hbase4.apache.org,39491,1689595859788' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-17 12:11:46,701 DEBUG [member: 'jenkins-hbase4.apache.org,39491,1689595859788' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-17 12:11:46,701 DEBUG [member: 'jenkins-hbase4.apache.org,39491,1689595859788' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:11:46,701 DEBUG [member: 'jenkins-hbase4.apache.org,39491,1689595859788' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-17 12:11:46,701 DEBUG [member: 'jenkins-hbase4.apache.org,39491,1689595859788' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,39491,1689595859788' in zk 2023-07-17 12:11:46,703 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:11:46,703 DEBUG [member: 'jenkins-hbase4.apache.org,39491,1689595859788' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-17 12:11:46,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:11:46,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 12:11:46,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 12:11:46,703 DEBUG [member: 'jenkins-hbase4.apache.org,39491,1689595859788' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 12:11:46,703 DEBUG [member: 'jenkins-hbase4.apache.org,39491,1689595859788' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-17 12:11:46,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 12:11:46,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 12:11:46,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-17 12:11:46,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:11:46,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:11:46,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:11:46,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 12:11:46,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-17 12:11:46,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:11:46,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:11:46,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,39491,1689595859788': 2023-07-17 12:11:46,709 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39491,1689595859788' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-07-17 12:11:46,780 DEBUG [Listener at jenkins-hbase4.apache.org/44127] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 12:11:46,781 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42013] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-17 12:11:46,782 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42013] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-17 12:11:46,782 DEBUG [Listener at jenkins-hbase4.apache.org/44127] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-17 12:11:47,102 DEBUG [rs(jenkins-hbase4.apache.org,42615,1689595859906)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1689595905104.717e0279a7aadcbaef16a08a902d723a. completed. 2023-07-17 12:11:47,102 DEBUG [rs(jenkins-hbase4.apache.org,42615,1689595859906)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1689595905104.717e0279a7aadcbaef16a08a902d723a. 2023-07-17 12:11:47,102 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-17 12:11:47,102 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-17 12:11:47,102 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:11:47,102 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-17 12:11:47,102 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,42615,1689595859906' in zk 2023-07-17 12:11:47,104 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-17 12:11:47,104 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:11:47,104 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 12:11:47,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:11:47,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 12:11:47,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 12:11:47,104 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-17 12:11:47,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 12:11:47,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 12:11:47,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-17 12:11:47,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:11:47,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:11:47,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:11:47,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 12:11:47,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-17 12:11:47,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:11:47,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:11:47,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:11:47,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,42615,1689595859906': 2023-07-17 12:11:47,109 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42615,1689595859906' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-07-17 12:11:47,109 INFO [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testConsecutiveExports' execution completed 2023-07-17 12:11:47,109 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-17 12:11:47,109 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-17 12:11:47,109 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testConsecutiveExports 2023-07-17 12:11:47,109 INFO [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-17 12:11:47,111 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-17 12:11:47,111 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:39491-0x10173314c9f0001, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-17 12:11:47,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-17 12:11:47,111 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-17 12:11:47,111 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:42615-0x10173314c9f0003, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-17 12:11:47,111 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:33685-0x10173314c9f0002, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-17 12:11:47,111 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-17 12:11:47,111 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-17 12:11:47,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-17 12:11:47,111 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:33685-0x10173314c9f0002, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 12:11:47,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-17 12:11:47,111 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:42615-0x10173314c9f0003, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 12:11:47,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-17 12:11:47,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 12:11:47,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 12:11:47,111 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:39491-0x10173314c9f0001, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 12:11:47,112 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 12:11:47,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 12:11:47,112 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 12:11:47,112 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 12:11:47,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 12:11:47,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 12:11:47,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 12:11:47,112 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:11:47,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-17 12:11:47,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-17 12:11:47,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-17 12:11:47,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-17 12:11:47,113 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:11:47,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 12:11:47,113 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:11:47,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-17 12:11:47,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:11:47,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:11:47,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:11:47,115 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:11:47,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 12:11:47,115 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:11:47,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-17 12:11:47,115 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:11:47,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:11:47,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:11:47,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:11:47,125 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:11:47,126 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:39491-0x10173314c9f0001, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 12:11:47,126 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-17 12:11:47,126 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 12:11:47,126 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 12:11:47,125 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:42615-0x10173314c9f0003, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 12:11:47,125 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:33685-0x10173314c9f0002, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 12:11:47,127 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 12:11:47,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 12:11:47,127 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:42615-0x10173314c9f0003, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 12:11:47,126 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testConsecutiveExports 2023-07-17 12:11:47,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 12:11:47,126 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:39491-0x10173314c9f0001, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 12:11:47,126 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:11:47,128 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-07-17 12:11:47,127 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 12:11:47,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 12:11:47,128 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-17 12:11:47,127 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:33685-0x10173314c9f0002, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 12:11:47,128 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-17 12:11:47,128 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:11:47,128 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 12:11:47,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 12:11:47,128 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 12:11:47,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 12:11:47,128 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-17 12:11:47,129 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 12:11:47,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 12:11:47,129 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:11:47,129 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-17 12:11:47,129 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:11:47,129 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:11:47,129 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-17 12:11:47,129 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-17 12:11:47,129 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b2023071717e2a0e274224d1ebb7eb3ec9ce9120b, hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230717495ceda8b6424282b1abbb5193c2fb7e] mob files 2023-07-17 12:11:47,129 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b2023071717e2a0e274224d1ebb7eb3ec9ce9120b 2023-07-17 12:11:47,129 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230717495ceda8b6424282b1abbb5193c2fb7e 2023-07-17 12:11:47,137 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testConsecutiveExports 2023-07-17 12:11:47,138 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-17 12:11:47,158 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports to hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-17 12:11:47,176 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-07-17 12:11:47,176 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-17 12:11:47,176 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-17 12:11:47,176 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1689595906173Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1689595907137 (+964 ms)Consolidate snapshot: snaptb0-testConsecutiveExports at 1689595907137Loading Region manifests for snaptb0-testConsecutiveExports at 1689595907137Writing data manifest for snaptb0-testConsecutiveExports at 1689595907143 (+6 ms)Verifying snapshot: snaptb0-testConsecutiveExports at 1689595907151 (+8 ms)Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1689595907176 (+25 ms) 2023-07-17 12:11:47,179 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=50, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-17 12:11:47,181 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=50, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 1.0040 sec 2023-07-17 12:11:47,282 DEBUG [Listener at jenkins-hbase4.apache.org/44127] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 12:11:47,283 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42013] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-17 12:11:47,283 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42013] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-17 12:11:47,283 INFO [Listener at jenkins-hbase4.apache.org/44127] snapshot.TestExportSnapshot(389): Local export destination path: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58af5705-0594-af5f-981c-fa1d3b267fab/local-export-1689595907283 2023-07-17 12:11:47,284 INFO [Listener at jenkins-hbase4.apache.org/44127] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58af5705-0594-af5f-981c-fa1d3b267fab/local-export-1689595907283, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58af5705-0594-af5f-981c-fa1d3b267fab/local-export-1689595907283, srcFsUri=hdfs://localhost:46215, srcDir=hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b 2023-07-17 12:11:47,311 DEBUG [Listener at jenkins-hbase4.apache.org/44127] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:46215, inputRoot=hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b 2023-07-17 12:11:47,311 DEBUG [Listener at jenkins-hbase4.apache.org/44127] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@14c5c552, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58af5705-0594-af5f-981c-fa1d3b267fab/local-export-1689595907283, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58af5705-0594-af5f-981c-fa1d3b267fab/local-export-1689595907283/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-17 12:11:47,311 INFO [Listener at jenkins-hbase4.apache.org/44127] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:46215, inputRoot=hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b, snapshotDir=hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-07-17 12:11:47,320 INFO [Listener at jenkins-hbase4.apache.org/44127] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58af5705-0594-af5f-981c-fa1d3b267fab/local-export-1689595907283/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-17 12:11:47,332 DEBUG [Listener at jenkins-hbase4.apache.org/44127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-17 12:11:47,332 DEBUG [Listener at jenkins-hbase4.apache.org/44127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-17 12:11:47,333 DEBUG [Listener at jenkins-hbase4.apache.org/44127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-17 12:11:47,333 DEBUG [Listener at jenkins-hbase4.apache.org/44127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-17 12:11:47,333 DEBUG [Listener at jenkins-hbase4.apache.org/44127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-17 12:11:47,334 DEBUG [Listener at jenkins-hbase4.apache.org/44127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-17 12:11:47,334 DEBUG [Listener at jenkins-hbase4.apache.org/44127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-17 12:11:47,403 DEBUG [Listener at jenkins-hbase4.apache.org/44127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58af5705-0594-af5f-981c-fa1d3b267fab/hadoop-6542357458160305407.jar 2023-07-17 12:11:47,404 DEBUG [Listener at jenkins-hbase4.apache.org/44127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-17 12:11:47,404 DEBUG [Listener at jenkins-hbase4.apache.org/44127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-17 12:11:47,405 DEBUG [Listener at jenkins-hbase4.apache.org/44127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-17 12:11:47,405 DEBUG [Listener at jenkins-hbase4.apache.org/44127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-17 12:11:47,405 DEBUG [Listener at jenkins-hbase4.apache.org/44127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-17 12:11:47,406 DEBUG [Listener at jenkins-hbase4.apache.org/44127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-17 12:11:47,406 DEBUG [Listener at jenkins-hbase4.apache.org/44127] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-17 12:11:47,407 DEBUG [Listener at jenkins-hbase4.apache.org/44127] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-17 12:11:47,407 DEBUG [Listener at jenkins-hbase4.apache.org/44127] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-17 12:11:47,407 DEBUG [Listener at jenkins-hbase4.apache.org/44127] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-17 12:11:47,408 DEBUG [Listener at jenkins-hbase4.apache.org/44127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-17 12:11:47,408 DEBUG [Listener at jenkins-hbase4.apache.org/44127] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-17 12:11:47,409 DEBUG [Listener at jenkins-hbase4.apache.org/44127] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-17 12:11:47,409 DEBUG [Listener at jenkins-hbase4.apache.org/44127] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-17 12:11:47,409 DEBUG [Listener at jenkins-hbase4.apache.org/44127] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-17 12:11:47,410 DEBUG [Listener at jenkins-hbase4.apache.org/44127] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-17 12:11:47,410 DEBUG [Listener at jenkins-hbase4.apache.org/44127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-17 12:11:47,411 DEBUG [Listener at jenkins-hbase4.apache.org/44127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-17 12:11:47,411 DEBUG [Listener at jenkins-hbase4.apache.org/44127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-17 12:11:47,411 DEBUG [Listener at jenkins-hbase4.apache.org/44127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-17 12:11:47,412 DEBUG [Listener at jenkins-hbase4.apache.org/44127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-17 12:11:47,412 DEBUG [Listener at jenkins-hbase4.apache.org/44127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-17 12:11:47,412 DEBUG [Listener at jenkins-hbase4.apache.org/44127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-17 12:11:47,784 WARN [Listener at jenkins-hbase4.apache.org/44127] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-17 12:11:47,787 INFO [Listener at jenkins-hbase4.apache.org/44127] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-07-17 12:11:47,789 DEBUG [Listener at jenkins-hbase4.apache.org/44127] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-07-17 12:11:49,207 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-17 12:11:49,208 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-17 12:11:49,211 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689595867847_0002_000001 (auth:SIMPLE) 2023-07-17 12:11:50,029 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689595867847_0003_000001 (auth:SIMPLE) 2023-07-17 12:11:50,432 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-17 12:11:54,427 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689595867847_0003_000001 (auth:SIMPLE) 2023-07-17 12:11:56,681 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689595867847_0003_000001 (auth:SIMPLE) 2023-07-17 12:11:59,313 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689595867847_0003_000001 (auth:SIMPLE) 2023-07-17 12:12:00,973 INFO [Listener at jenkins-hbase4.apache.org/44127] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-17 12:12:00,973 INFO [Listener at jenkins-hbase4.apache.org/44127] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-17 12:12:00,977 INFO [Listener at jenkins-hbase4.apache.org/44127] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-07-17 12:12:00,977 INFO [Listener at jenkins-hbase4.apache.org/44127] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-17 12:12:00,978 INFO [Listener at jenkins-hbase4.apache.org/44127] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-17 12:12:00,978 DEBUG [Listener at jenkins-hbase4.apache.org/44127] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1847813108_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-17 12:12:00,980 DEBUG [Listener at jenkins-hbase4.apache.org/44127] snapshot.TestExportSnapshot(367): hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-17 12:12:00,980 DEBUG [Listener at jenkins-hbase4.apache.org/44127] snapshot.TestExportSnapshot(367): hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-17 12:12:00,980 DEBUG [Listener at jenkins-hbase4.apache.org/44127] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@5e79f0a6 in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58af5705-0594-af5f-981c-fa1d3b267fab/local-export-1689595907283/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58af5705-0594-af5f-981c-fa1d3b267fab/local-export-1689595907283/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-17 12:12:00,981 DEBUG [Listener at jenkins-hbase4.apache.org/44127] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58af5705-0594-af5f-981c-fa1d3b267fab/local-export-1689595907283/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-17 12:12:00,981 DEBUG [Listener at jenkins-hbase4.apache.org/44127] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58af5705-0594-af5f-981c-fa1d3b267fab/local-export-1689595907283/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-17 12:12:00,982 INFO [Listener at jenkins-hbase4.apache.org/44127] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58af5705-0594-af5f-981c-fa1d3b267fab/local-export-1689595907283, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58af5705-0594-af5f-981c-fa1d3b267fab/local-export-1689595907283, srcFsUri=hdfs://localhost:46215, srcDir=hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b 2023-07-17 12:12:01,006 DEBUG [Listener at jenkins-hbase4.apache.org/44127] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:46215, inputRoot=hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b 2023-07-17 12:12:01,007 DEBUG [Listener at jenkins-hbase4.apache.org/44127] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@602ed1d4, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58af5705-0594-af5f-981c-fa1d3b267fab/local-export-1689595907283, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58af5705-0594-af5f-981c-fa1d3b267fab/local-export-1689595907283/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-17 12:12:01,007 INFO [Listener at jenkins-hbase4.apache.org/44127] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:46215, inputRoot=hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b, snapshotDir=hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-07-17 12:12:01,017 INFO [Listener at jenkins-hbase4.apache.org/44127] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58af5705-0594-af5f-981c-fa1d3b267fab/local-export-1689595907283/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-17 12:12:01,029 DEBUG [Listener at jenkins-hbase4.apache.org/44127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-17 12:12:01,029 DEBUG [Listener at jenkins-hbase4.apache.org/44127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-17 12:12:01,030 DEBUG [Listener at jenkins-hbase4.apache.org/44127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-17 12:12:01,030 DEBUG [Listener at jenkins-hbase4.apache.org/44127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-17 12:12:01,030 DEBUG [Listener at jenkins-hbase4.apache.org/44127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-17 12:12:01,031 DEBUG [Listener at jenkins-hbase4.apache.org/44127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-17 12:12:01,031 DEBUG [Listener at jenkins-hbase4.apache.org/44127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-17 12:12:01,099 DEBUG [Listener at jenkins-hbase4.apache.org/44127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58af5705-0594-af5f-981c-fa1d3b267fab/hadoop-2726778431450121873.jar 2023-07-17 12:12:01,100 DEBUG [Listener at jenkins-hbase4.apache.org/44127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-17 12:12:01,100 DEBUG [Listener at jenkins-hbase4.apache.org/44127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-17 12:12:01,101 DEBUG [Listener at jenkins-hbase4.apache.org/44127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-17 12:12:01,101 DEBUG [Listener at jenkins-hbase4.apache.org/44127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-17 12:12:01,101 DEBUG [Listener at jenkins-hbase4.apache.org/44127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-17 12:12:01,101 DEBUG [Listener at jenkins-hbase4.apache.org/44127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-17 12:12:01,102 DEBUG [Listener at jenkins-hbase4.apache.org/44127] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-17 12:12:01,102 DEBUG [Listener at jenkins-hbase4.apache.org/44127] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-17 12:12:01,103 DEBUG [Listener at jenkins-hbase4.apache.org/44127] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-17 12:12:01,103 DEBUG [Listener at jenkins-hbase4.apache.org/44127] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-17 12:12:01,103 DEBUG [Listener at jenkins-hbase4.apache.org/44127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-17 12:12:01,104 DEBUG [Listener at jenkins-hbase4.apache.org/44127] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-17 12:12:01,104 DEBUG [Listener at jenkins-hbase4.apache.org/44127] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-17 12:12:01,104 DEBUG [Listener at jenkins-hbase4.apache.org/44127] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-17 12:12:01,105 DEBUG [Listener at jenkins-hbase4.apache.org/44127] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-17 12:12:01,105 DEBUG [Listener at jenkins-hbase4.apache.org/44127] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-17 12:12:01,105 DEBUG [Listener at jenkins-hbase4.apache.org/44127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-17 12:12:01,106 DEBUG [Listener at jenkins-hbase4.apache.org/44127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-17 12:12:01,106 DEBUG [Listener at jenkins-hbase4.apache.org/44127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-17 12:12:01,106 DEBUG [Listener at jenkins-hbase4.apache.org/44127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-17 12:12:01,107 DEBUG [Listener at jenkins-hbase4.apache.org/44127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-17 12:12:01,107 DEBUG [Listener at jenkins-hbase4.apache.org/44127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-17 12:12:01,107 DEBUG [Listener at jenkins-hbase4.apache.org/44127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-17 12:12:01,498 WARN [Listener at jenkins-hbase4.apache.org/44127] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-17 12:12:01,501 INFO [Listener at jenkins-hbase4.apache.org/44127] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-07-17 12:12:01,503 DEBUG [Listener at jenkins-hbase4.apache.org/44127] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-07-17 12:12:05,489 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-17 12:12:05,489 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-17 12:12:05,492 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689595867847_0003_000001 (auth:SIMPLE) 2023-07-17 12:12:06,223 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689595867847_0004_000001 (auth:SIMPLE) 2023-07-17 12:12:10,987 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689595867847_0004_000001 (auth:SIMPLE) 2023-07-17 12:12:13,329 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689595867847_0004_000001 (auth:SIMPLE) 2023-07-17 12:12:17,385 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689595867847_0004_000001 (auth:SIMPLE) 2023-07-17 12:12:18,738 INFO [Listener at jenkins-hbase4.apache.org/44127] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-17 12:12:18,738 INFO [Listener at jenkins-hbase4.apache.org/44127] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-17 12:12:18,742 INFO [Listener at jenkins-hbase4.apache.org/44127] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-07-17 12:12:18,742 INFO [Listener at jenkins-hbase4.apache.org/44127] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-17 12:12:18,742 INFO [Listener at jenkins-hbase4.apache.org/44127] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-17 12:12:18,742 DEBUG [Listener at jenkins-hbase4.apache.org/44127] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1847813108_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-17 12:12:18,745 DEBUG [Listener at jenkins-hbase4.apache.org/44127] snapshot.TestExportSnapshot(367): hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-17 12:12:18,745 DEBUG [Listener at jenkins-hbase4.apache.org/44127] snapshot.TestExportSnapshot(367): hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-17 12:12:18,745 DEBUG [Listener at jenkins-hbase4.apache.org/44127] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@5e79f0a6 in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58af5705-0594-af5f-981c-fa1d3b267fab/local-export-1689595907283/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58af5705-0594-af5f-981c-fa1d3b267fab/local-export-1689595907283/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-17 12:12:18,745 DEBUG [Listener at jenkins-hbase4.apache.org/44127] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58af5705-0594-af5f-981c-fa1d3b267fab/local-export-1689595907283/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-17 12:12:18,745 DEBUG [Listener at jenkins-hbase4.apache.org/44127] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58af5705-0594-af5f-981c-fa1d3b267fab/local-export-1689595907283/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-17 12:12:18,757 INFO [Listener at jenkins-hbase4.apache.org/44127] client.HBaseAdmin$15(890): Started disable of testtb-testConsecutiveExports 2023-07-17 12:12:18,758 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42013] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testConsecutiveExports 2023-07-17 12:12:18,759 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42013] procedure2.ProcedureExecutor(1029): Stored pid=51, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testConsecutiveExports 2023-07-17 12:12:18,762 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42013] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-17 12:12:18,763 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689595938763"}]},"ts":"1689595938763"} 2023-07-17 12:12:18,765 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLING in hbase:meta 2023-07-17 12:12:18,767 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testConsecutiveExports to state=DISABLING 2023-07-17 12:12:18,768 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=50a68336a8ca42089e7dc50f3af53173, UNASSIGN}, {pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=717e0279a7aadcbaef16a08a902d723a, UNASSIGN}] 2023-07-17 12:12:18,770 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=50a68336a8ca42089e7dc50f3af53173, UNASSIGN 2023-07-17 12:12:18,771 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=717e0279a7aadcbaef16a08a902d723a, UNASSIGN 2023-07-17 12:12:18,771 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=50a68336a8ca42089e7dc50f3af53173, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:12:18,771 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=717e0279a7aadcbaef16a08a902d723a, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:12:18,772 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1689595905104.50a68336a8ca42089e7dc50f3af53173.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689595938771"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689595938771"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689595938771"}]},"ts":"1689595938771"} 2023-07-17 12:12:18,772 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1689595905104.717e0279a7aadcbaef16a08a902d723a.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689595938771"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689595938771"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689595938771"}]},"ts":"1689595938771"} 2023-07-17 12:12:18,773 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=54, ppid=52, state=RUNNABLE; CloseRegionProcedure 50a68336a8ca42089e7dc50f3af53173, server=jenkins-hbase4.apache.org,39491,1689595859788}] 2023-07-17 12:12:18,774 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=55, ppid=53, state=RUNNABLE; CloseRegionProcedure 717e0279a7aadcbaef16a08a902d723a, server=jenkins-hbase4.apache.org,42615,1689595859906}] 2023-07-17 12:12:18,864 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42013] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-17 12:12:18,926 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 717e0279a7aadcbaef16a08a902d723a 2023-07-17 12:12:18,926 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 50a68336a8ca42089e7dc50f3af53173 2023-07-17 12:12:18,926 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 717e0279a7aadcbaef16a08a902d723a, disabling compactions & flushes 2023-07-17 12:12:18,926 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 50a68336a8ca42089e7dc50f3af53173, disabling compactions & flushes 2023-07-17 12:12:18,926 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1689595905104.717e0279a7aadcbaef16a08a902d723a. 2023-07-17 12:12:18,926 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1689595905104.50a68336a8ca42089e7dc50f3af53173. 2023-07-17 12:12:18,926 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1689595905104.717e0279a7aadcbaef16a08a902d723a. 2023-07-17 12:12:18,926 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1689595905104.50a68336a8ca42089e7dc50f3af53173. 2023-07-17 12:12:18,926 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1689595905104.717e0279a7aadcbaef16a08a902d723a. after waiting 0 ms 2023-07-17 12:12:18,926 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1689595905104.50a68336a8ca42089e7dc50f3af53173. after waiting 0 ms 2023-07-17 12:12:18,926 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1689595905104.717e0279a7aadcbaef16a08a902d723a. 2023-07-17 12:12:18,926 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1689595905104.50a68336a8ca42089e7dc50f3af53173. 2023-07-17 12:12:18,978 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/default/testtb-testConsecutiveExports/50a68336a8ca42089e7dc50f3af53173/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-17 12:12:18,979 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/default/testtb-testConsecutiveExports/717e0279a7aadcbaef16a08a902d723a/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-17 12:12:18,979 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-17 12:12:18,981 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1689595905104.50a68336a8ca42089e7dc50f3af53173. 2023-07-17 12:12:18,981 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 50a68336a8ca42089e7dc50f3af53173: 2023-07-17 12:12:18,981 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-17 12:12:18,982 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1689595905104.717e0279a7aadcbaef16a08a902d723a. 2023-07-17 12:12:18,982 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 717e0279a7aadcbaef16a08a902d723a: 2023-07-17 12:12:18,985 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 50a68336a8ca42089e7dc50f3af53173 2023-07-17 12:12:18,986 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=50a68336a8ca42089e7dc50f3af53173, regionState=CLOSED 2023-07-17 12:12:18,986 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1689595905104.50a68336a8ca42089e7dc50f3af53173.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689595938985"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689595938985"}]},"ts":"1689595938985"} 2023-07-17 12:12:18,986 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 717e0279a7aadcbaef16a08a902d723a 2023-07-17 12:12:18,986 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=717e0279a7aadcbaef16a08a902d723a, regionState=CLOSED 2023-07-17 12:12:18,986 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1689595905104.717e0279a7aadcbaef16a08a902d723a.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689595938986"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689595938986"}]},"ts":"1689595938986"} 2023-07-17 12:12:18,991 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=54, resume processing ppid=52 2023-07-17 12:12:18,991 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=54, ppid=52, state=SUCCESS; CloseRegionProcedure 50a68336a8ca42089e7dc50f3af53173, server=jenkins-hbase4.apache.org,39491,1689595859788 in 215 msec 2023-07-17 12:12:18,991 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=55, resume processing ppid=53 2023-07-17 12:12:18,991 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=55, ppid=53, state=SUCCESS; CloseRegionProcedure 717e0279a7aadcbaef16a08a902d723a, server=jenkins-hbase4.apache.org,42615,1689595859906 in 214 msec 2023-07-17 12:12:18,992 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=50a68336a8ca42089e7dc50f3af53173, UNASSIGN in 223 msec 2023-07-17 12:12:18,993 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=53, resume processing ppid=51 2023-07-17 12:12:18,993 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=717e0279a7aadcbaef16a08a902d723a, UNASSIGN in 223 msec 2023-07-17 12:12:18,994 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689595938993"}]},"ts":"1689595938993"} 2023-07-17 12:12:18,995 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLED in hbase:meta 2023-07-17 12:12:18,996 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testConsecutiveExports to state=DISABLED 2023-07-17 12:12:18,998 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=51, state=SUCCESS; DisableTableProcedure table=testtb-testConsecutiveExports in 239 msec 2023-07-17 12:12:19,065 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42013] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-17 12:12:19,065 INFO [Listener at jenkins-hbase4.apache.org/44127] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testConsecutiveExports, procId: 51 completed 2023-07-17 12:12:19,066 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42013] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testConsecutiveExports 2023-07-17 12:12:19,068 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42013] procedure2.ProcedureExecutor(1029): Stored pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-17 12:12:19,071 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-17 12:12:19,071 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42013] access.PermissionStorage(259): Removing permissions of removed table testtb-testConsecutiveExports 2023-07-17 12:12:19,072 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=56, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-17 12:12:19,075 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39491] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testConsecutiveExports 2023-07-17 12:12:19,079 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-17 12:12:19,079 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:39491-0x10173314c9f0001, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-17 12:12:19,079 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:42615-0x10173314c9f0003, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-17 12:12:19,080 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:33685-0x10173314c9f0002, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-17 12:12:19,081 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-17 12:12:19,081 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-17 12:12:19,081 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-17 12:12:19,081 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-17 12:12:19,083 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.tmp/data/default/testtb-testConsecutiveExports/50a68336a8ca42089e7dc50f3af53173 2023-07-17 12:12:19,083 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:42615-0x10173314c9f0003, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-17 12:12:19,083 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:39491-0x10173314c9f0001, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-17 12:12:19,083 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:39491-0x10173314c9f0001, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 12:12:19,083 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:42615-0x10173314c9f0003, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 12:12:19,083 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:33685-0x10173314c9f0002, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-17 12:12:19,083 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-17 12:12:19,083 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 12:12:19,083 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:33685-0x10173314c9f0002, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 12:12:19,084 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42013] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-17 12:12:19,085 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.tmp/data/default/testtb-testConsecutiveExports/717e0279a7aadcbaef16a08a902d723a 2023-07-17 12:12:19,087 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.tmp/data/default/testtb-testConsecutiveExports/50a68336a8ca42089e7dc50f3af53173/cf, FileablePath, hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.tmp/data/default/testtb-testConsecutiveExports/50a68336a8ca42089e7dc50f3af53173/recovered.edits] 2023-07-17 12:12:19,099 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.tmp/data/default/testtb-testConsecutiveExports/717e0279a7aadcbaef16a08a902d723a/cf, FileablePath, hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.tmp/data/default/testtb-testConsecutiveExports/717e0279a7aadcbaef16a08a902d723a/recovered.edits] 2023-07-17 12:12:19,104 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.tmp/data/default/testtb-testConsecutiveExports/50a68336a8ca42089e7dc50f3af53173/cf/6e2edaa7d2b340f1b4e2c29842be1191 to hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/archive/data/default/testtb-testConsecutiveExports/50a68336a8ca42089e7dc50f3af53173/cf/6e2edaa7d2b340f1b4e2c29842be1191 2023-07-17 12:12:19,106 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.tmp/data/default/testtb-testConsecutiveExports/717e0279a7aadcbaef16a08a902d723a/cf/035e62b5019f4c5da85900f3e546dd94 to hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/archive/data/default/testtb-testConsecutiveExports/717e0279a7aadcbaef16a08a902d723a/cf/035e62b5019f4c5da85900f3e546dd94 2023-07-17 12:12:19,110 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.tmp/data/default/testtb-testConsecutiveExports/50a68336a8ca42089e7dc50f3af53173/recovered.edits/9.seqid to hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/archive/data/default/testtb-testConsecutiveExports/50a68336a8ca42089e7dc50f3af53173/recovered.edits/9.seqid 2023-07-17 12:12:19,111 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.tmp/data/default/testtb-testConsecutiveExports/50a68336a8ca42089e7dc50f3af53173 2023-07-17 12:12:19,113 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.tmp/data/default/testtb-testConsecutiveExports/717e0279a7aadcbaef16a08a902d723a/recovered.edits/9.seqid to hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/archive/data/default/testtb-testConsecutiveExports/717e0279a7aadcbaef16a08a902d723a/recovered.edits/9.seqid 2023-07-17 12:12:19,113 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.tmp/data/default/testtb-testConsecutiveExports/717e0279a7aadcbaef16a08a902d723a 2023-07-17 12:12:19,113 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-07-17 12:12:19,114 DEBUG [PEWorker-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-07-17 12:12:19,115 DEBUG [PEWorker-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf] 2023-07-17 12:12:19,119 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b2023071717e2a0e274224d1ebb7eb3ec9ce9120b to hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b2023071717e2a0e274224d1ebb7eb3ec9ce9120b 2023-07-17 12:12:19,123 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230717495ceda8b6424282b1abbb5193c2fb7e to hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230717495ceda8b6424282b1abbb5193c2fb7e 2023-07-17 12:12:19,124 DEBUG [PEWorker-3] backup.HFileArchiver(596): Deleted hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-07-17 12:12:19,128 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=56, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-17 12:12:19,132 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testConsecutiveExports from hbase:meta 2023-07-17 12:12:19,135 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testConsecutiveExports' descriptor. 2023-07-17 12:12:19,139 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=56, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-17 12:12:19,139 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testConsecutiveExports' from region states. 2023-07-17 12:12:19,139 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,,1689595905104.50a68336a8ca42089e7dc50f3af53173.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689595939139"}]},"ts":"9223372036854775807"} 2023-07-17 12:12:19,139 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,1,1689595905104.717e0279a7aadcbaef16a08a902d723a.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689595939139"}]},"ts":"9223372036854775807"} 2023-07-17 12:12:19,142 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-17 12:12:19,142 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 50a68336a8ca42089e7dc50f3af53173, NAME => 'testtb-testConsecutiveExports,,1689595905104.50a68336a8ca42089e7dc50f3af53173.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 717e0279a7aadcbaef16a08a902d723a, NAME => 'testtb-testConsecutiveExports,1,1689595905104.717e0279a7aadcbaef16a08a902d723a.', STARTKEY => '1', ENDKEY => ''}] 2023-07-17 12:12:19,142 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testConsecutiveExports' as deleted. 2023-07-17 12:12:19,142 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689595939142"}]},"ts":"9223372036854775807"} 2023-07-17 12:12:19,144 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testConsecutiveExports state from META 2023-07-17 12:12:19,147 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=56, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-17 12:12:19,148 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=56, state=SUCCESS; DeleteTableProcedure table=testtb-testConsecutiveExports in 81 msec 2023-07-17 12:12:19,186 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42013] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-17 12:12:19,186 INFO [Listener at jenkins-hbase4.apache.org/44127] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testConsecutiveExports, procId: 56 completed 2023-07-17 12:12:19,197 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42013] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testConsecutiveExports" 2023-07-17 12:12:19,199 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42013] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testConsecutiveExports 2023-07-17 12:12:19,201 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42013] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testConsecutiveExports" 2023-07-17 12:12:19,203 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42013] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testConsecutiveExports 2023-07-17 12:12:19,239 INFO [Listener at jenkins-hbase4.apache.org/44127] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=745 (was 759), OpenFileDescriptor=898 (was 939), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=469 (was 483), ProcessCount=183 (was 181) - ProcessCount LEAK? -, AvailableMemoryMB=2441 (was 3049) 2023-07-17 12:12:19,239 WARN [Listener at jenkins-hbase4.apache.org/44127] hbase.ResourceChecker(130): Thread=745 is superior to 500 2023-07-17 12:12:19,265 INFO [Listener at jenkins-hbase4.apache.org/44127] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=745, OpenFileDescriptor=898, MaxFileDescriptor=60000, SystemLoadAverage=469, ProcessCount=183, AvailableMemoryMB=2437 2023-07-17 12:12:19,265 WARN [Listener at jenkins-hbase4.apache.org/44127] hbase.ResourceChecker(130): Thread=745 is superior to 500 2023-07-17 12:12:19,267 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-17 12:12:19,269 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] procedure2.ProcedureExecutor(1029): Stored pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:19,272 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-07-17 12:12:19,273 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion" procId is: 57 2023-07-17 12:12:19,274 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-17 12:12:19,277 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/c7991e82dbd667a8425f93a90f84e008 2023-07-17 12:12:19,279 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-17 12:12:19,286 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/4abf4dbe2fb6991c62dd936abee2598e 2023-07-17 12:12:19,286 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/c7991e82dbd667a8425f93a90f84e008 empty. 2023-07-17 12:12:19,287 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/c7991e82dbd667a8425f93a90f84e008 2023-07-17 12:12:19,287 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/4abf4dbe2fb6991c62dd936abee2598e empty. 2023-07-17 12:12:19,287 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/4abf4dbe2fb6991c62dd936abee2598e 2023-07-17 12:12:19,287 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-07-17 12:12:19,325 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/.tabledesc/.tableinfo.0000000001 2023-07-17 12:12:19,329 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(7675): creating {ENCODED => c7991e82dbd667a8425f93a90f84e008, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689595939267.c7991e82dbd667a8425f93a90f84e008.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.tmp 2023-07-17 12:12:19,329 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(7675): creating {ENCODED => 4abf4dbe2fb6991c62dd936abee2598e, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689595939267.4abf4dbe2fb6991c62dd936abee2598e.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.tmp 2023-07-17 12:12:19,381 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-17 12:12:19,382 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1689595939267.4abf4dbe2fb6991c62dd936abee2598e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 12:12:19,382 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1604): Closing 4abf4dbe2fb6991c62dd936abee2598e, disabling compactions & flushes 2023-07-17 12:12:19,382 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1689595939267.4abf4dbe2fb6991c62dd936abee2598e. 2023-07-17 12:12:19,382 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689595939267.4abf4dbe2fb6991c62dd936abee2598e. 2023-07-17 12:12:19,382 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689595939267.4abf4dbe2fb6991c62dd936abee2598e. after waiting 0 ms 2023-07-17 12:12:19,383 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1689595939267.4abf4dbe2fb6991c62dd936abee2598e. 2023-07-17 12:12:19,383 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1689595939267.4abf4dbe2fb6991c62dd936abee2598e. 2023-07-17 12:12:19,383 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1558): Region close journal for 4abf4dbe2fb6991c62dd936abee2598e: 2023-07-17 12:12:19,385 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1689595939267.c7991e82dbd667a8425f93a90f84e008.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 12:12:19,386 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1604): Closing c7991e82dbd667a8425f93a90f84e008, disabling compactions & flushes 2023-07-17 12:12:19,386 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1689595939267.c7991e82dbd667a8425f93a90f84e008. 2023-07-17 12:12:19,386 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689595939267.c7991e82dbd667a8425f93a90f84e008. 2023-07-17 12:12:19,386 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689595939267.c7991e82dbd667a8425f93a90f84e008. after waiting 0 ms 2023-07-17 12:12:19,386 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1689595939267.c7991e82dbd667a8425f93a90f84e008. 2023-07-17 12:12:19,386 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1689595939267.c7991e82dbd667a8425f93a90f84e008. 2023-07-17 12:12:19,386 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1558): Region close journal for c7991e82dbd667a8425f93a90f84e008: 2023-07-17 12:12:19,390 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ADD_TO_META 2023-07-17 12:12:19,391 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689595939267.4abf4dbe2fb6991c62dd936abee2598e.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689595939391"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689595939391"}]},"ts":"1689595939391"} 2023-07-17 12:12:19,391 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689595939267.c7991e82dbd667a8425f93a90f84e008.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689595939391"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689595939391"}]},"ts":"1689595939391"} 2023-07-17 12:12:19,399 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-17 12:12:19,400 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-17 12:12:19,400 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689595939400"}]},"ts":"1689595939400"} 2023-07-17 12:12:19,402 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLING in hbase:meta 2023-07-17 12:12:19,409 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-17 12:12:19,411 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-17 12:12:19,411 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-17 12:12:19,411 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-17 12:12:19,411 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-17 12:12:19,411 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=c7991e82dbd667a8425f93a90f84e008, ASSIGN}, {pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=4abf4dbe2fb6991c62dd936abee2598e, ASSIGN}] 2023-07-17 12:12:19,420 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=4abf4dbe2fb6991c62dd936abee2598e, ASSIGN 2023-07-17 12:12:19,421 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=c7991e82dbd667a8425f93a90f84e008, ASSIGN 2023-07-17 12:12:19,422 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=4abf4dbe2fb6991c62dd936abee2598e, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42615,1689595859906; forceNewPlan=false, retain=false 2023-07-17 12:12:19,422 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=c7991e82dbd667a8425f93a90f84e008, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33685,1689595859854; forceNewPlan=false, retain=false 2023-07-17 12:12:19,572 INFO [jenkins-hbase4:42013] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-17 12:12:19,575 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=c7991e82dbd667a8425f93a90f84e008, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:12:19,575 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=4abf4dbe2fb6991c62dd936abee2598e, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:12:19,576 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689595939267.c7991e82dbd667a8425f93a90f84e008.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689595939575"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689595939575"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689595939575"}]},"ts":"1689595939575"} 2023-07-17 12:12:19,576 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689595939267.4abf4dbe2fb6991c62dd936abee2598e.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689595939575"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689595939575"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689595939575"}]},"ts":"1689595939575"} 2023-07-17 12:12:19,579 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=60, ppid=58, state=RUNNABLE; OpenRegionProcedure c7991e82dbd667a8425f93a90f84e008, server=jenkins-hbase4.apache.org,33685,1689595859854}] 2023-07-17 12:12:19,581 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=61, ppid=59, state=RUNNABLE; OpenRegionProcedure 4abf4dbe2fb6991c62dd936abee2598e, server=jenkins-hbase4.apache.org,42615,1689595859906}] 2023-07-17 12:12:19,582 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-17 12:12:19,741 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,1,1689595939267.4abf4dbe2fb6991c62dd936abee2598e. 2023-07-17 12:12:19,741 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,,1689595939267.c7991e82dbd667a8425f93a90f84e008. 2023-07-17 12:12:19,741 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 4abf4dbe2fb6991c62dd936abee2598e, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689595939267.4abf4dbe2fb6991c62dd936abee2598e.', STARTKEY => '1', ENDKEY => ''} 2023-07-17 12:12:19,741 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => c7991e82dbd667a8425f93a90f84e008, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689595939267.c7991e82dbd667a8425f93a90f84e008.', STARTKEY => '', ENDKEY => '1'} 2023-07-17 12:12:19,741 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,,1689595939267.c7991e82dbd667a8425f93a90f84e008. service=AccessControlService 2023-07-17 12:12:19,741 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,1,1689595939267.4abf4dbe2fb6991c62dd936abee2598e. service=AccessControlService 2023-07-17 12:12:19,742 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-17 12:12:19,742 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-17 12:12:19,742 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion c7991e82dbd667a8425f93a90f84e008 2023-07-17 12:12:19,742 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 4abf4dbe2fb6991c62dd936abee2598e 2023-07-17 12:12:19,742 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1689595939267.c7991e82dbd667a8425f93a90f84e008.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 12:12:19,742 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1689595939267.4abf4dbe2fb6991c62dd936abee2598e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 12:12:19,742 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for c7991e82dbd667a8425f93a90f84e008 2023-07-17 12:12:19,742 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 4abf4dbe2fb6991c62dd936abee2598e 2023-07-17 12:12:19,742 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for c7991e82dbd667a8425f93a90f84e008 2023-07-17 12:12:19,742 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 4abf4dbe2fb6991c62dd936abee2598e 2023-07-17 12:12:19,744 INFO [StoreOpener-c7991e82dbd667a8425f93a90f84e008-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region c7991e82dbd667a8425f93a90f84e008 2023-07-17 12:12:19,744 INFO [StoreOpener-4abf4dbe2fb6991c62dd936abee2598e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 4abf4dbe2fb6991c62dd936abee2598e 2023-07-17 12:12:19,746 DEBUG [StoreOpener-4abf4dbe2fb6991c62dd936abee2598e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/default/testtb-testExportFileSystemStateWithMergeRegion/4abf4dbe2fb6991c62dd936abee2598e/cf 2023-07-17 12:12:19,746 DEBUG [StoreOpener-4abf4dbe2fb6991c62dd936abee2598e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/default/testtb-testExportFileSystemStateWithMergeRegion/4abf4dbe2fb6991c62dd936abee2598e/cf 2023-07-17 12:12:19,746 DEBUG [StoreOpener-c7991e82dbd667a8425f93a90f84e008-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/default/testtb-testExportFileSystemStateWithMergeRegion/c7991e82dbd667a8425f93a90f84e008/cf 2023-07-17 12:12:19,746 DEBUG [StoreOpener-c7991e82dbd667a8425f93a90f84e008-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/default/testtb-testExportFileSystemStateWithMergeRegion/c7991e82dbd667a8425f93a90f84e008/cf 2023-07-17 12:12:19,747 INFO [StoreOpener-4abf4dbe2fb6991c62dd936abee2598e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4abf4dbe2fb6991c62dd936abee2598e columnFamilyName cf 2023-07-17 12:12:19,747 INFO [StoreOpener-c7991e82dbd667a8425f93a90f84e008-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c7991e82dbd667a8425f93a90f84e008 columnFamilyName cf 2023-07-17 12:12:19,752 INFO [StoreOpener-4abf4dbe2fb6991c62dd936abee2598e-1] regionserver.HStore(310): Store=4abf4dbe2fb6991c62dd936abee2598e/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-17 12:12:19,753 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/default/testtb-testExportFileSystemStateWithMergeRegion/4abf4dbe2fb6991c62dd936abee2598e 2023-07-17 12:12:19,753 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/default/testtb-testExportFileSystemStateWithMergeRegion/4abf4dbe2fb6991c62dd936abee2598e 2023-07-17 12:12:19,754 INFO [StoreOpener-c7991e82dbd667a8425f93a90f84e008-1] regionserver.HStore(310): Store=c7991e82dbd667a8425f93a90f84e008/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-17 12:12:19,756 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/default/testtb-testExportFileSystemStateWithMergeRegion/c7991e82dbd667a8425f93a90f84e008 2023-07-17 12:12:19,756 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/default/testtb-testExportFileSystemStateWithMergeRegion/c7991e82dbd667a8425f93a90f84e008 2023-07-17 12:12:19,756 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 4abf4dbe2fb6991c62dd936abee2598e 2023-07-17 12:12:19,759 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/default/testtb-testExportFileSystemStateWithMergeRegion/4abf4dbe2fb6991c62dd936abee2598e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-17 12:12:19,759 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for c7991e82dbd667a8425f93a90f84e008 2023-07-17 12:12:19,760 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 4abf4dbe2fb6991c62dd936abee2598e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68512912, jitterRate=0.020921945571899414}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-17 12:12:19,760 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 4abf4dbe2fb6991c62dd936abee2598e: 2023-07-17 12:12:19,761 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,1,1689595939267.4abf4dbe2fb6991c62dd936abee2598e., pid=61, masterSystemTime=1689595939734 2023-07-17 12:12:19,762 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/default/testtb-testExportFileSystemStateWithMergeRegion/c7991e82dbd667a8425f93a90f84e008/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-17 12:12:19,762 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened c7991e82dbd667a8425f93a90f84e008; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63593056, jitterRate=-0.05238962173461914}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-17 12:12:19,763 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for c7991e82dbd667a8425f93a90f84e008: 2023-07-17 12:12:19,763 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,1,1689595939267.4abf4dbe2fb6991c62dd936abee2598e. 2023-07-17 12:12:19,763 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,1,1689595939267.4abf4dbe2fb6991c62dd936abee2598e. 2023-07-17 12:12:19,763 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,,1689595939267.c7991e82dbd667a8425f93a90f84e008., pid=60, masterSystemTime=1689595939731 2023-07-17 12:12:19,764 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=4abf4dbe2fb6991c62dd936abee2598e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:12:19,764 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689595939267.4abf4dbe2fb6991c62dd936abee2598e.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689595939764"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689595939764"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689595939764"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689595939764"}]},"ts":"1689595939764"} 2023-07-17 12:12:19,765 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,,1689595939267.c7991e82dbd667a8425f93a90f84e008. 2023-07-17 12:12:19,765 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,,1689595939267.c7991e82dbd667a8425f93a90f84e008. 2023-07-17 12:12:19,767 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=c7991e82dbd667a8425f93a90f84e008, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:12:19,767 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689595939267.c7991e82dbd667a8425f93a90f84e008.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689595939767"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689595939767"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689595939767"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689595939767"}]},"ts":"1689595939767"} 2023-07-17 12:12:19,769 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=61, resume processing ppid=59 2023-07-17 12:12:19,769 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=61, ppid=59, state=SUCCESS; OpenRegionProcedure 4abf4dbe2fb6991c62dd936abee2598e, server=jenkins-hbase4.apache.org,42615,1689595859906 in 185 msec 2023-07-17 12:12:19,783 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=60, resume processing ppid=58 2023-07-17 12:12:19,783 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=59, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=4abf4dbe2fb6991c62dd936abee2598e, ASSIGN in 358 msec 2023-07-17 12:12:19,783 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=60, ppid=58, state=SUCCESS; OpenRegionProcedure c7991e82dbd667a8425f93a90f84e008, server=jenkins-hbase4.apache.org,33685,1689595859854 in 189 msec 2023-07-17 12:12:19,790 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=58, resume processing ppid=57 2023-07-17 12:12:19,790 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=58, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=c7991e82dbd667a8425f93a90f84e008, ASSIGN in 372 msec 2023-07-17 12:12:19,791 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-17 12:12:19,792 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689595939791"}]},"ts":"1689595939791"} 2023-07-17 12:12:19,794 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLED in hbase:meta 2023-07-17 12:12:19,796 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_POST_OPERATION 2023-07-17 12:12:19,797 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion jenkins: RWXCA 2023-07-17 12:12:19,799 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39491] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-17 12:12:19,801 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:33685-0x10173314c9f0002, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 12:12:19,801 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:42615-0x10173314c9f0003, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 12:12:19,801 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 12:12:19,801 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:39491-0x10173314c9f0001, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 12:12:19,803 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-17 12:12:19,803 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-17 12:12:19,803 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-17 12:12:19,803 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-17 12:12:19,804 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=57, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 536 msec 2023-07-17 12:12:19,884 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-17 12:12:19,884 INFO [Listener at jenkins-hbase4.apache.org/44127] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 57 completed 2023-07-17 12:12:19,887 DEBUG [Listener at jenkins-hbase4.apache.org/44127] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:19,887 DEBUG [Listener at jenkins-hbase4.apache.org/44127] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1689595939267.c7991e82dbd667a8425f93a90f84e008. 2023-07-17 12:12:19,891 INFO [Listener at jenkins-hbase4.apache.org/44127] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-17 12:12:19,904 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-17 12:12:19,904 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689595939904 (current time:1689595939904). 2023-07-17 12:12:19,904 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-17 12:12:19,905 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] zookeeper.ReadOnlyZKClient(139): Connect 0x04d576e2 to 127.0.0.1:55622 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-17 12:12:19,912 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3393fc5f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-17 12:12:19,913 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 12:12:19,917 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55702, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 12:12:19,919 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x04d576e2 to 127.0.0.1:55622 2023-07-17 12:12:19,919 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 12:12:19,919 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] zookeeper.ReadOnlyZKClient(139): Connect 0x4bb7845f to 127.0.0.1:55622 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-17 12:12:19,930 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@64fa89ad, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-17 12:12:19,932 DEBUG [hconnection-0x48a7f069-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 12:12:19,933 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55704, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 12:12:19,939 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 12:12:19,942 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34694, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 12:12:19,943 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4bb7845f to 127.0.0.1:55622 2023-07-17 12:12:19,943 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 12:12:19,943 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-17 12:12:19,944 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-17 12:12:19,944 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-17 12:12:19,947 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] procedure2.ProcedureExecutor(1029): Stored pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-17 12:12:19,948 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-17 12:12:19,949 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=62, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1689596539949 2023-07-17 12:12:19,949 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-17 12:12:19,949 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:19,951 DEBUG [Listener at jenkins-hbase4.apache.org/44127] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-17 12:12:19,951 DEBUG [Listener at jenkins-hbase4.apache.org/44127] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-17 12:12:19,953 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=62, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-17 12:12:19,953 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-17 12:12:19,958 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=62, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 7 msec 2023-07-17 12:12:19,959 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-17 12:12:19,960 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=63, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1689596539960 2023-07-17 12:12:19,986 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:19,987 INFO [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' 2023-07-17 12:12:19,987 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 12:12:19,988 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-07-17 12:12:19,988 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-07-17 12:12:19,989 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:19,989 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:19,990 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:33685-0x10173314c9f0002, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 12:12:19,990 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:42615-0x10173314c9f0003, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 12:12:19,990 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:39491-0x10173314c9f0001, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 12:12:19,990 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 12:12:19,990 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 12:12:19,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 12:12:19,990 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:12:19,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 12:12:19,990 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 12:12:19,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 12:12:19,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:19,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:19,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:19,991 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:12:19,991 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:12:19,991 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42615-0x10173314c9f0003, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:19,992 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:12:19,992 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-17 12:12:19,992 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39491-0x10173314c9f0001, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:19,992 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33685-0x10173314c9f0002, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:19,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-17 12:12:19,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:19,992 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-17 12:12:19,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-17 12:12:19,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:19,992 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:19,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-17 12:12:19,992 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-17 12:12:19,992 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 12:12:19,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:19,992 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-17 12:12:19,994 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-17 12:12:19,994 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-17 12:12:19,995 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-17 12:12:19,995 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42615,1689595859906' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-17 12:12:19,996 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:12:19,996 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:19,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:12:19,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 12:12:19,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 12:12:19,997 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42615-0x10173314c9f0003, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:19,997 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 12:12:19,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 12:12:19,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 12:12:19,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:19,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:12:19,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 12:12:20,000 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42615,1689595859906' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-17 12:12:20,000 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@310bbc5a[Count = 1] remaining members to acquire global barrier 2023-07-17 12:12:20,006 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:20,007 DEBUG [member: 'jenkins-hbase4.apache.org,39491,1689595859788' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-17 12:12:20,007 DEBUG [member: 'jenkins-hbase4.apache.org,39491,1689595859788' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 12:12:20,008 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:20,009 DEBUG [member: 'jenkins-hbase4.apache.org,39491,1689595859788' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-17 12:12:20,009 DEBUG [member: 'jenkins-hbase4.apache.org,33685,1689595859854' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-17 12:12:20,009 DEBUG [member: 'jenkins-hbase4.apache.org,39491,1689595859788' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-17 12:12:20,010 DEBUG [member: 'jenkins-hbase4.apache.org,39491,1689595859788' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39491,1689595859788' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-17 12:12:20,009 DEBUG [member: 'jenkins-hbase4.apache.org,33685,1689595859854' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 12:12:20,011 DEBUG [member: 'jenkins-hbase4.apache.org,33685,1689595859854' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-17 12:12:20,011 DEBUG [member: 'jenkins-hbase4.apache.org,33685,1689595859854' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-17 12:12:20,011 DEBUG [member: 'jenkins-hbase4.apache.org,33685,1689595859854' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33685,1689595859854' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-17 12:12:20,012 DEBUG [member: 'jenkins-hbase4.apache.org,39491,1689595859788' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:20,020 DEBUG [member: 'jenkins-hbase4.apache.org,39491,1689595859788' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39491-0x10173314c9f0001, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:20,020 DEBUG [member: 'jenkins-hbase4.apache.org,39491,1689595859788' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 12:12:20,020 DEBUG [member: 'jenkins-hbase4.apache.org,33685,1689595859854' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:20,020 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:12:20,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:12:20,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 12:12:20,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 12:12:20,021 DEBUG [member: 'jenkins-hbase4.apache.org,33685,1689595859854' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33685-0x10173314c9f0002, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:20,021 DEBUG [member: 'jenkins-hbase4.apache.org,33685,1689595859854' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 12:12:20,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 12:12:20,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 12:12:20,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:20,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:12:20,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:12:20,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:12:20,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 12:12:20,025 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33685,1689595859854' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-17 12:12:20,025 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@310bbc5a[Count = 0] remaining members to acquire global barrier 2023-07-17 12:12:20,025 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-07-17 12:12:20,025 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:20,027 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:33685-0x10173314c9f0002, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:20,027 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:39491-0x10173314c9f0001, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:20,027 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:20,027 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:42615-0x10173314c9f0003, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:20,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:20,027 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:20,027 DEBUG [member: 'jenkins-hbase4.apache.org,33685,1689595859854' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-17 12:12:20,027 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:20,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:20,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:20,027 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-17 12:12:20,027 DEBUG [member: 'jenkins-hbase4.apache.org,39491,1689595859788' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-17 12:12:20,028 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:12:20,028 DEBUG [member: 'jenkins-hbase4.apache.org,39491,1689595859788' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-17 12:12:20,028 DEBUG [member: 'jenkins-hbase4.apache.org,39491,1689595859788' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,39491,1689595859788' in zk 2023-07-17 12:12:20,028 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:12:20,028 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-17 12:12:20,032 DEBUG [member: 'jenkins-hbase4.apache.org,33685,1689595859854' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-17 12:12:20,032 DEBUG [member: 'jenkins-hbase4.apache.org,33685,1689595859854' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-17 12:12:20,032 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-17 12:12:20,032 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-17 12:12:20,032 DEBUG [member: 'jenkins-hbase4.apache.org,39491,1689595859788' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-17 12:12:20,032 DEBUG [member: 'jenkins-hbase4.apache.org,39491,1689595859788' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 12:12:20,032 DEBUG [rs(jenkins-hbase4.apache.org,33685,1689595859854)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689595939267.c7991e82dbd667a8425f93a90f84e008. 2023-07-17 12:12:20,032 DEBUG [rs(jenkins-hbase4.apache.org,42615,1689595859906)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689595939267.4abf4dbe2fb6991c62dd936abee2598e. 2023-07-17 12:12:20,034 DEBUG [rs(jenkins-hbase4.apache.org,42615,1689595859906)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689595939267.4abf4dbe2fb6991c62dd936abee2598e. started... 2023-07-17 12:12:20,033 DEBUG [rs(jenkins-hbase4.apache.org,33685,1689595859854)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689595939267.c7991e82dbd667a8425f93a90f84e008. started... 2023-07-17 12:12:20,032 DEBUG [member: 'jenkins-hbase4.apache.org,39491,1689595859788' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-17 12:12:20,036 DEBUG [rs(jenkins-hbase4.apache.org,42615,1689595859906)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 4abf4dbe2fb6991c62dd936abee2598e: 2023-07-17 12:12:20,036 DEBUG [rs(jenkins-hbase4.apache.org,42615,1689595859906)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1689595939267.4abf4dbe2fb6991c62dd936abee2598e.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:20,036 DEBUG [rs(jenkins-hbase4.apache.org,42615,1689595859906)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-17 12:12:20,036 DEBUG [rs(jenkins-hbase4.apache.org,42615,1689595859906)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-17 12:12:20,037 DEBUG [rs(jenkins-hbase4.apache.org,33685,1689595859854)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for c7991e82dbd667a8425f93a90f84e008: 2023-07-17 12:12:20,037 DEBUG [rs(jenkins-hbase4.apache.org,33685,1689595859854)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1689595939267.c7991e82dbd667a8425f93a90f84e008.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:20,037 DEBUG [rs(jenkins-hbase4.apache.org,33685,1689595859854)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-17 12:12:20,037 DEBUG [rs(jenkins-hbase4.apache.org,33685,1689595859854)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-17 12:12:20,051 DEBUG [Listener at jenkins-hbase4.apache.org/44127] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 12:12:20,052 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-17 12:12:20,053 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-17 12:12:20,053 DEBUG [Listener at jenkins-hbase4.apache.org/44127] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-17 12:12:20,135 DEBUG [rs(jenkins-hbase4.apache.org,42615,1689595859906)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689595939267.4abf4dbe2fb6991c62dd936abee2598e. completed. 2023-07-17 12:12:20,135 DEBUG [rs(jenkins-hbase4.apache.org,42615,1689595859906)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689595939267.4abf4dbe2fb6991c62dd936abee2598e. 2023-07-17 12:12:20,135 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-17 12:12:20,135 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-17 12:12:20,135 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:12:20,135 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-17 12:12:20,135 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,42615,1689595859906' in zk 2023-07-17 12:12:20,138 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:12:20,138 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-17 12:12:20,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:12:20,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 12:12:20,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 12:12:20,138 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 12:12:20,139 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-17 12:12:20,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 12:12:20,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 12:12:20,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:20,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:12:20,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:12:20,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:12:20,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 12:12:20,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:20,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:12:20,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:12:20,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,42615,1689595859906': 2023-07-17 12:12:20,145 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42615,1689595859906' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-07-17 12:12:20,148 DEBUG [rs(jenkins-hbase4.apache.org,33685,1689595859854)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689595939267.c7991e82dbd667a8425f93a90f84e008. completed. 2023-07-17 12:12:20,148 DEBUG [rs(jenkins-hbase4.apache.org,33685,1689595859854)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689595939267.c7991e82dbd667a8425f93a90f84e008. 2023-07-17 12:12:20,148 DEBUG [member: 'jenkins-hbase4.apache.org,33685,1689595859854' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-17 12:12:20,148 DEBUG [member: 'jenkins-hbase4.apache.org,33685,1689595859854' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-17 12:12:20,148 DEBUG [member: 'jenkins-hbase4.apache.org,33685,1689595859854' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:12:20,148 DEBUG [member: 'jenkins-hbase4.apache.org,33685,1689595859854' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-17 12:12:20,148 DEBUG [member: 'jenkins-hbase4.apache.org,33685,1689595859854' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,33685,1689595859854' in zk 2023-07-17 12:12:20,149 DEBUG [member: 'jenkins-hbase4.apache.org,33685,1689595859854' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-17 12:12:20,150 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:12:20,150 DEBUG [member: 'jenkins-hbase4.apache.org,33685,1689595859854' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 12:12:20,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:12:20,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 12:12:20,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 12:12:20,150 DEBUG [member: 'jenkins-hbase4.apache.org,33685,1689595859854' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-17 12:12:20,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 12:12:20,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 12:12:20,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:20,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:12:20,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:12:20,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:12:20,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 12:12:20,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:20,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:12:20,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:12:20,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:12:20,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,33685,1689595859854': 2023-07-17 12:12:20,171 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33685,1689595859854' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-07-17 12:12:20,171 INFO [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-07-17 12:12:20,171 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-17 12:12:20,171 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-17 12:12:20,171 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:20,171 INFO [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-17 12:12:20,175 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:42615-0x10173314c9f0003, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:20,175 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:39491-0x10173314c9f0001, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:20,175 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:20,175 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:20,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:20,175 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:33685-0x10173314c9f0002, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:20,175 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:33685-0x10173314c9f0002, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 12:12:20,175 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:20,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:20,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:20,175 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:39491-0x10173314c9f0001, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 12:12:20,175 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:20,175 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:42615-0x10173314c9f0003, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 12:12:20,176 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 12:12:20,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 12:12:20,176 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:12:20,176 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 12:12:20,176 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 12:12:20,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 12:12:20,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 12:12:20,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:20,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:20,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:20,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 12:12:20,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 12:12:20,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:20,178 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:12:20,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 12:12:20,182 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:12:20,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:20,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 12:12:20,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:20,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:12:20,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:12:20,184 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:12:20,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:12:20,184 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:12:20,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 12:12:20,184 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:12:20,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:20,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:12:20,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:12:20,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:12:20,188 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:39491-0x10173314c9f0001, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 12:12:20,188 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 12:12:20,188 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:33685-0x10173314c9f0002, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 12:12:20,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 12:12:20,188 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:42615-0x10173314c9f0003, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 12:12:20,189 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:42615-0x10173314c9f0003, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 12:12:20,188 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 12:12:20,188 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:33685-0x10173314c9f0002, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 12:12:20,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 12:12:20,189 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 12:12:20,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 12:12:20,189 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 12:12:20,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 12:12:20,190 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 12:12:20,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 12:12:20,191 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:39491-0x10173314c9f0001, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 12:12:20,191 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:12:20,191 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:20,191 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:12:20,191 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:12:20,191 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:20,191 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 12:12:20,191 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:12:20,192 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:20,192 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:20,192 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:12:20,192 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:20,192 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 12:12:20,192 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:12:20,192 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:20,192 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:20,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 12:12:20,195 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:20,192 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-17 12:12:20,196 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-17 12:12:20,217 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:20,218 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:20,253 DEBUG [Listener at jenkins-hbase4.apache.org/44127] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 12:12:20,254 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-17 12:12:20,254 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-17 12:12:20,255 DEBUG [Listener at jenkins-hbase4.apache.org/44127] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-17 12:12:20,258 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:20,283 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-07-17 12:12:20,283 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:20,284 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:20,284 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1689595939950Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1689595940217 (+267 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689595940217Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689595940218 (+1 ms)Writing data manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689595940228 (+10 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689595940247 (+19 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1689595940283 (+36 ms) 2023-07-17 12:12:20,287 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=63, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-17 12:12:20,288 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=63, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 336 msec 2023-07-17 12:12:20,524 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion' 2023-07-17 12:12:20,555 DEBUG [Listener at jenkins-hbase4.apache.org/44127] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 12:12:20,556 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-17 12:12:20,556 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-17 12:12:20,559 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33685] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,,1689595939267.c7991e82dbd667a8425f93a90f84e008. with WAL disabled. Data may be lost in the event of a crash. 2023-07-17 12:12:20,560 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42615] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,1,1689595939267.4abf4dbe2fb6991c62dd936abee2598e. with WAL disabled. Data may be lost in the event of a crash. 2023-07-17 12:12:20,565 DEBUG [Listener at jenkins-hbase4.apache.org/44127] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:20,565 DEBUG [Listener at jenkins-hbase4.apache.org/44127] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1689595939267.c7991e82dbd667a8425f93a90f84e008. 2023-07-17 12:12:20,566 INFO [Listener at jenkins-hbase4.apache.org/44127] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-17 12:12:20,579 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-17 12:12:20,579 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689595940579 (current time:1689595940579). 2023-07-17 12:12:20,579 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-17 12:12:20,580 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] zookeeper.ReadOnlyZKClient(139): Connect 0x17e71129 to 127.0.0.1:55622 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-17 12:12:20,588 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@399b09e0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-17 12:12:20,589 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 12:12:20,593 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49724, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 12:12:20,595 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x17e71129 to 127.0.0.1:55622 2023-07-17 12:12:20,595 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 12:12:20,595 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] zookeeper.ReadOnlyZKClient(139): Connect 0x33f479f4 to 127.0.0.1:55622 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-17 12:12:20,605 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1c3548fa, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-17 12:12:20,611 DEBUG [hconnection-0x7d808695-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 12:12:20,615 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49740, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 12:12:20,619 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 12:12:20,621 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54194, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 12:12:20,622 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x33f479f4 to 127.0.0.1:55622 2023-07-17 12:12:20,622 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 12:12:20,622 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-17 12:12:20,623 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-17 12:12:20,623 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-17 12:12:20,627 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] procedure2.ProcedureExecutor(1029): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-17 12:12:20,628 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-17 12:12:20,631 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1689596540631 2023-07-17 12:12:20,631 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-17 12:12:20,631 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:20,632 DEBUG [Listener at jenkins-hbase4.apache.org/44127] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-17 12:12:20,633 DEBUG [Listener at jenkins-hbase4.apache.org/44127] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-17 12:12:20,634 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-17 12:12:20,634 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-17 12:12:20,636 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 9 msec 2023-07-17 12:12:20,637 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-17 12:12:20,638 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=65, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1689596540637 2023-07-17 12:12:20,683 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:20,684 INFO [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' 2023-07-17 12:12:20,684 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 12:12:20,685 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-07-17 12:12:20,685 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-07-17 12:12:20,727 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:20,727 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:20,730 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:33685-0x10173314c9f0002, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 12:12:20,730 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:39491-0x10173314c9f0001, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 12:12:20,730 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 12:12:20,730 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:12:20,730 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 12:12:20,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 12:12:20,730 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:42615-0x10173314c9f0003, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 12:12:20,731 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 12:12:20,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 12:12:20,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 12:12:20,731 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:12:20,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:20,731 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:12:20,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:20,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:20,732 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39491-0x10173314c9f0001, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:20,732 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:12:20,732 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-17 12:12:20,732 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33685-0x10173314c9f0002, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:20,732 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42615-0x10173314c9f0003, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:20,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-17 12:12:20,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:20,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-17 12:12:20,733 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-17 12:12:20,733 DEBUG [Listener at jenkins-hbase4.apache.org/44127] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 12:12:20,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-17 12:12:20,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:20,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:20,734 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-17 12:12:20,734 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-17 12:12:20,734 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-17 12:12:20,734 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-17 12:12:20,734 DEBUG [Listener at jenkins-hbase4.apache.org/44127] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-17 12:12:20,734 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:20,735 DEBUG [member: 'jenkins-hbase4.apache.org,33685,1689595859854' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-17 12:12:20,735 DEBUG [member: 'jenkins-hbase4.apache.org,33685,1689595859854' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 12:12:20,738 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:20,740 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:20,740 DEBUG [member: 'jenkins-hbase4.apache.org,33685,1689595859854' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-17 12:12:20,740 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-17 12:12:20,740 DEBUG [member: 'jenkins-hbase4.apache.org,33685,1689595859854' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-17 12:12:20,740 DEBUG [member: 'jenkins-hbase4.apache.org,39491,1689595859788' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-17 12:12:20,740 DEBUG [member: 'jenkins-hbase4.apache.org,33685,1689595859854' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33685,1689595859854' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-17 12:12:20,740 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 12:12:20,740 DEBUG [member: 'jenkins-hbase4.apache.org,39491,1689595859788' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 12:12:20,742 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-17 12:12:20,742 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-17 12:12:20,742 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42615,1689595859906' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-17 12:12:20,743 DEBUG [member: 'jenkins-hbase4.apache.org,39491,1689595859788' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-17 12:12:20,743 DEBUG [member: 'jenkins-hbase4.apache.org,39491,1689595859788' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-17 12:12:20,743 DEBUG [member: 'jenkins-hbase4.apache.org,39491,1689595859788' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39491,1689595859788' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-17 12:12:20,745 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:12:20,745 DEBUG [member: 'jenkins-hbase4.apache.org,33685,1689595859854' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:20,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:12:20,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 12:12:20,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 12:12:20,746 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:20,746 DEBUG [member: 'jenkins-hbase4.apache.org,39491,1689595859788' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:20,746 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:12:20,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 12:12:20,746 DEBUG [member: 'jenkins-hbase4.apache.org,33685,1689595859854' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33685-0x10173314c9f0002, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:20,746 DEBUG [member: 'jenkins-hbase4.apache.org,33685,1689595859854' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 12:12:20,746 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42615-0x10173314c9f0003, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:20,746 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 12:12:20,746 DEBUG [member: 'jenkins-hbase4.apache.org,39491,1689595859788' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39491-0x10173314c9f0001, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:20,746 DEBUG [member: 'jenkins-hbase4.apache.org,39491,1689595859788' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 12:12:20,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 12:12:20,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:20,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:12:20,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:12:20,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:12:20,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 12:12:20,748 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33685,1689595859854' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-17 12:12:20,748 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6912bf7a[Count = 1] remaining members to acquire global barrier 2023-07-17 12:12:20,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:12:20,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 12:12:20,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 12:12:20,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 12:12:20,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 12:12:20,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:20,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:12:20,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:12:20,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:12:20,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 12:12:20,751 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42615,1689595859906' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-17 12:12:20,751 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6912bf7a[Count = 0] remaining members to acquire global barrier 2023-07-17 12:12:20,751 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-07-17 12:12:20,751 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:20,752 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:33685-0x10173314c9f0002, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:20,752 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:42615-0x10173314c9f0003, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:20,752 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:39491-0x10173314c9f0001, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:20,752 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:20,752 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:20,752 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:20,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:20,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:20,752 DEBUG [member: 'jenkins-hbase4.apache.org,39491,1689595859788' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-17 12:12:20,752 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-17 12:12:20,752 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:12:20,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:20,752 DEBUG [member: 'jenkins-hbase4.apache.org,39491,1689595859788' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-17 12:12:20,753 DEBUG [member: 'jenkins-hbase4.apache.org,33685,1689595859854' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-17 12:12:20,753 DEBUG [rs(jenkins-hbase4.apache.org,42615,1689595859906)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689595939267.4abf4dbe2fb6991c62dd936abee2598e. 2023-07-17 12:12:20,753 DEBUG [member: 'jenkins-hbase4.apache.org,39491,1689595859788' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,39491,1689595859788' in zk 2023-07-17 12:12:20,753 DEBUG [rs(jenkins-hbase4.apache.org,42615,1689595859906)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689595939267.4abf4dbe2fb6991c62dd936abee2598e. started... 2023-07-17 12:12:20,753 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-17 12:12:20,753 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-17 12:12:20,753 INFO [rs(jenkins-hbase4.apache.org,42615,1689595859906)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 4abf4dbe2fb6991c62dd936abee2598e 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-07-17 12:12:20,753 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:12:20,753 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-17 12:12:20,755 DEBUG [member: 'jenkins-hbase4.apache.org,39491,1689595859788' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-17 12:12:20,755 DEBUG [member: 'jenkins-hbase4.apache.org,39491,1689595859788' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 12:12:20,755 DEBUG [member: 'jenkins-hbase4.apache.org,39491,1689595859788' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-17 12:12:20,759 DEBUG [member: 'jenkins-hbase4.apache.org,33685,1689595859854' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-17 12:12:20,759 DEBUG [member: 'jenkins-hbase4.apache.org,33685,1689595859854' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-17 12:12:20,759 DEBUG [rs(jenkins-hbase4.apache.org,33685,1689595859854)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689595939267.c7991e82dbd667a8425f93a90f84e008. 2023-07-17 12:12:20,759 DEBUG [rs(jenkins-hbase4.apache.org,33685,1689595859854)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689595939267.c7991e82dbd667a8425f93a90f84e008. started... 2023-07-17 12:12:20,761 INFO [rs(jenkins-hbase4.apache.org,33685,1689595859854)-snapshot-pool-0] regionserver.HRegion(2745): Flushing c7991e82dbd667a8425f93a90f84e008 1/1 column families, dataSize=266 B heapSize=832 B 2023-07-17 12:12:20,807 INFO [rs(jenkins-hbase4.apache.org,42615,1689595859906)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202307175a93ead76bbc46179ac1b94ee44c23f6 to hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b202307175a93ead76bbc46179ac1b94ee44c23f6 2023-07-17 12:12:20,807 INFO [rs(jenkins-hbase4.apache.org,33685,1689595859854)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023071733e0989a86534b67bee1a12e41aea781 to hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e2023071733e0989a86534b67bee1a12e41aea781 2023-07-17 12:12:20,836 INFO [rs(jenkins-hbase4.apache.org,33685,1689595859854)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=266, hasBloomFilter=true, into tmp file hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/default/testtb-testExportFileSystemStateWithMergeRegion/c7991e82dbd667a8425f93a90f84e008/.tmp/cf/6cb2ae8005f1474083f3cc4bfc67dc79 2023-07-17 12:12:20,837 INFO [rs(jenkins-hbase4.apache.org,42615,1689595859906)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.0 K, hasBloomFilter=true, into tmp file hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/default/testtb-testExportFileSystemStateWithMergeRegion/4abf4dbe2fb6991c62dd936abee2598e/.tmp/cf/9f93c3d2b4de476d9012f8a738de6844 2023-07-17 12:12:20,843 DEBUG [rs(jenkins-hbase4.apache.org,33685,1689595859854)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/default/testtb-testExportFileSystemStateWithMergeRegion/c7991e82dbd667a8425f93a90f84e008/.tmp/cf/6cb2ae8005f1474083f3cc4bfc67dc79 as hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/default/testtb-testExportFileSystemStateWithMergeRegion/c7991e82dbd667a8425f93a90f84e008/cf/6cb2ae8005f1474083f3cc4bfc67dc79 2023-07-17 12:12:20,845 DEBUG [rs(jenkins-hbase4.apache.org,42615,1689595859906)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/default/testtb-testExportFileSystemStateWithMergeRegion/4abf4dbe2fb6991c62dd936abee2598e/.tmp/cf/9f93c3d2b4de476d9012f8a738de6844 as hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/default/testtb-testExportFileSystemStateWithMergeRegion/4abf4dbe2fb6991c62dd936abee2598e/cf/9f93c3d2b4de476d9012f8a738de6844 2023-07-17 12:12:20,850 INFO [rs(jenkins-hbase4.apache.org,33685,1689595859854)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/default/testtb-testExportFileSystemStateWithMergeRegion/c7991e82dbd667a8425f93a90f84e008/cf/6cb2ae8005f1474083f3cc4bfc67dc79, entries=4, sequenceid=6, filesize=5.6 K 2023-07-17 12:12:20,851 INFO [rs(jenkins-hbase4.apache.org,33685,1689595859854)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for c7991e82dbd667a8425f93a90f84e008 in 90ms, sequenceid=6, compaction requested=false 2023-07-17 12:12:20,853 DEBUG [rs(jenkins-hbase4.apache.org,33685,1689595859854)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for c7991e82dbd667a8425f93a90f84e008: 2023-07-17 12:12:20,853 DEBUG [rs(jenkins-hbase4.apache.org,33685,1689595859854)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1689595939267.c7991e82dbd667a8425f93a90f84e008.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:20,854 DEBUG [rs(jenkins-hbase4.apache.org,33685,1689595859854)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-17 12:12:20,854 DEBUG [rs(jenkins-hbase4.apache.org,33685,1689595859854)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/default/testtb-testExportFileSystemStateWithMergeRegion/c7991e82dbd667a8425f93a90f84e008/cf/6cb2ae8005f1474083f3cc4bfc67dc79] hfiles 2023-07-17 12:12:20,854 DEBUG [rs(jenkins-hbase4.apache.org,33685,1689595859854)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/default/testtb-testExportFileSystemStateWithMergeRegion/c7991e82dbd667a8425f93a90f84e008/cf/6cb2ae8005f1474083f3cc4bfc67dc79 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:20,859 INFO [rs(jenkins-hbase4.apache.org,42615,1689595859906)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/default/testtb-testExportFileSystemStateWithMergeRegion/4abf4dbe2fb6991c62dd936abee2598e/cf/9f93c3d2b4de476d9012f8a738de6844, entries=46, sequenceid=6, filesize=13.4 K 2023-07-17 12:12:20,860 INFO [rs(jenkins-hbase4.apache.org,42615,1689595859906)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for 4abf4dbe2fb6991c62dd936abee2598e in 107ms, sequenceid=6, compaction requested=false 2023-07-17 12:12:20,860 DEBUG [rs(jenkins-hbase4.apache.org,42615,1689595859906)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 4abf4dbe2fb6991c62dd936abee2598e: 2023-07-17 12:12:20,860 DEBUG [rs(jenkins-hbase4.apache.org,42615,1689595859906)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1689595939267.4abf4dbe2fb6991c62dd936abee2598e.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:20,860 DEBUG [rs(jenkins-hbase4.apache.org,42615,1689595859906)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-17 12:12:20,860 DEBUG [rs(jenkins-hbase4.apache.org,42615,1689595859906)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/default/testtb-testExportFileSystemStateWithMergeRegion/4abf4dbe2fb6991c62dd936abee2598e/cf/9f93c3d2b4de476d9012f8a738de6844] hfiles 2023-07-17 12:12:20,860 DEBUG [rs(jenkins-hbase4.apache.org,42615,1689595859906)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/default/testtb-testExportFileSystemStateWithMergeRegion/4abf4dbe2fb6991c62dd936abee2598e/cf/9f93c3d2b4de476d9012f8a738de6844 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:20,879 DEBUG [rs(jenkins-hbase4.apache.org,33685,1689595859854)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689595939267.c7991e82dbd667a8425f93a90f84e008. completed. 2023-07-17 12:12:20,879 DEBUG [rs(jenkins-hbase4.apache.org,33685,1689595859854)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689595939267.c7991e82dbd667a8425f93a90f84e008. 2023-07-17 12:12:20,879 DEBUG [member: 'jenkins-hbase4.apache.org,33685,1689595859854' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-17 12:12:20,879 DEBUG [member: 'jenkins-hbase4.apache.org,33685,1689595859854' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-17 12:12:20,879 DEBUG [member: 'jenkins-hbase4.apache.org,33685,1689595859854' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:12:20,882 DEBUG [member: 'jenkins-hbase4.apache.org,33685,1689595859854' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-17 12:12:20,883 DEBUG [member: 'jenkins-hbase4.apache.org,33685,1689595859854' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,33685,1689595859854' in zk 2023-07-17 12:12:20,884 DEBUG [member: 'jenkins-hbase4.apache.org,33685,1689595859854' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-17 12:12:20,884 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:12:20,884 DEBUG [member: 'jenkins-hbase4.apache.org,33685,1689595859854' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 12:12:20,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:12:20,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 12:12:20,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 12:12:20,885 DEBUG [member: 'jenkins-hbase4.apache.org,33685,1689595859854' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-17 12:12:20,890 DEBUG [rs(jenkins-hbase4.apache.org,42615,1689595859906)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689595939267.4abf4dbe2fb6991c62dd936abee2598e. completed. 2023-07-17 12:12:20,890 DEBUG [rs(jenkins-hbase4.apache.org,42615,1689595859906)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689595939267.4abf4dbe2fb6991c62dd936abee2598e. 2023-07-17 12:12:20,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 12:12:20,890 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-17 12:12:20,890 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-17 12:12:20,890 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:12:20,890 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-17 12:12:20,890 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,42615,1689595859906' in zk 2023-07-17 12:12:20,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 12:12:20,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:20,892 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-17 12:12:20,892 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:12:20,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:12:20,892 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 12:12:20,892 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-17 12:12:20,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:12:20,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:12:20,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 12:12:20,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:20,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:12:20,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:12:20,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:12:20,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,33685,1689595859854': 2023-07-17 12:12:20,896 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33685,1689595859854' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-07-17 12:12:20,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:12:20,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 12:12:20,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 12:12:20,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 12:12:20,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 12:12:20,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:20,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:12:20,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:12:20,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:12:20,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 12:12:20,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:20,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:12:20,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:12:20,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:12:20,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,42615,1689595859906': 2023-07-17 12:12:20,900 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42615,1689595859906' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-07-17 12:12:20,900 INFO [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-07-17 12:12:20,900 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-17 12:12:20,900 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-17 12:12:20,900 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:20,900 INFO [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-17 12:12:20,905 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:42615-0x10173314c9f0003, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:20,905 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:39491-0x10173314c9f0001, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:20,905 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:20,905 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:20,905 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:39491-0x10173314c9f0001, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 12:12:20,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:20,905 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:42615-0x10173314c9f0003, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 12:12:20,905 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:20,905 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:33685-0x10173314c9f0002, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:20,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:20,905 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:20,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 12:12:20,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 12:12:20,906 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 12:12:20,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 12:12:20,905 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:33685-0x10173314c9f0002, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 12:12:20,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:20,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:20,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 12:12:20,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:20,906 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:12:20,906 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 12:12:20,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 12:12:20,906 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 12:12:20,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 12:12:20,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:20,907 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:12:20,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 12:12:20,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:20,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:20,907 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:12:20,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:20,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:12:20,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:12:20,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:12:20,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 12:12:20,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:20,909 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:12:20,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:12:20,909 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:12:20,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:12:20,910 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:12:20,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:12:20,913 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:12:20,913 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:42615-0x10173314c9f0003, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 12:12:20,913 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:39491-0x10173314c9f0001, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 12:12:20,913 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 12:12:20,913 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:33685-0x10173314c9f0002, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 12:12:20,913 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 12:12:20,913 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:39491-0x10173314c9f0001, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 12:12:20,913 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:42615-0x10173314c9f0003, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 12:12:20,913 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:20,913 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 12:12:20,913 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:12:20,913 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:20,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 12:12:20,913 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 12:12:20,913 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:33685-0x10173314c9f0002, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 12:12:20,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 12:12:20,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 12:12:20,919 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:20,913 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:12:20,919 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:20,919 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:20,919 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-17 12:12:20,919 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:12:20,919 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 12:12:20,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 12:12:20,919 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:20,919 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:12:20,919 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:12:20,920 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:20,920 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:20,920 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b202307175a93ead76bbc46179ac1b94ee44c23f6, hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e2023071733e0989a86534b67bee1a12e41aea781] mob files 2023-07-17 12:12:20,920 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b202307175a93ead76bbc46179ac1b94ee44c23f6 2023-07-17 12:12:20,920 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e2023071733e0989a86534b67bee1a12e41aea781 2023-07-17 12:12:20,926 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 12:12:20,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 12:12:20,926 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 12:12:20,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 12:12:20,934 DEBUG [Listener at jenkins-hbase4.apache.org/44127] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 12:12:20,936 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-17 12:12:20,936 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-17 12:12:20,936 DEBUG [Listener at jenkins-hbase4.apache.org/44127] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-17 12:12:20,939 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:20,939 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:20,978 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:21,022 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-07-17 12:12:21,023 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:21,023 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:21,023 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1689595940631Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1689595940939 (+308 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1689595940939Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion at 1689595940939Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion at 1689595940944 (+5 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1689595940962 (+18 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1689595941022 (+60 ms) 2023-07-17 12:12:21,027 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=65, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-17 12:12:21,032 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=65, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 395 msec 2023-07-17 12:12:21,236 DEBUG [Listener at jenkins-hbase4.apache.org/44127] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 12:12:21,237 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-17 12:12:21,237 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-17 12:12:21,272 DEBUG [Listener at jenkins-hbase4.apache.org/44127] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-17 12:12:21,276 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49742, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-17 12:12:21,278 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33685] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-17 12:12:21,278 DEBUG [Listener at jenkins-hbase4.apache.org/44127] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-17 12:12:21,281 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54210, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-17 12:12:21,281 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39491] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-17 12:12:21,282 DEBUG [Listener at jenkins-hbase4.apache.org/44127] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-17 12:12:21,285 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36354, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-17 12:12:21,285 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42615] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-17 12:12:21,288 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-17 12:12:21,289 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] procedure2.ProcedureExecutor(1029): Stored pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-17 12:12:21,291 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_PRE_OPERATION 2023-07-17 12:12:21,292 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion-1" procId is: 66 2023-07-17 12:12:21,292 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-17 12:12:21,293 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-17 12:12:21,295 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7d2dc555dc1876ee5be41eb233310de8 2023-07-17 12:12:21,295 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/be6ddc25fe0c2580cd461b6f25054c8a 2023-07-17 12:12:21,298 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7d2dc555dc1876ee5be41eb233310de8 empty. 2023-07-17 12:12:21,298 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/be6ddc25fe0c2580cd461b6f25054c8a empty. 2023-07-17 12:12:21,298 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7d2dc555dc1876ee5be41eb233310de8 2023-07-17 12:12:21,299 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/be6ddc25fe0c2580cd461b6f25054c8a 2023-07-17 12:12:21,299 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-07-17 12:12:21,331 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/.tabledesc/.tableinfo.0000000001 2023-07-17 12:12:21,332 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(7675): creating {ENCODED => 7d2dc555dc1876ee5be41eb233310de8, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689595941287.7d2dc555dc1876ee5be41eb233310de8.', STARTKEY => '', ENDKEY => '2'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.tmp 2023-07-17 12:12:21,333 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(7675): creating {ENCODED => be6ddc25fe0c2580cd461b6f25054c8a, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1689595941287.be6ddc25fe0c2580cd461b6f25054c8a.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.tmp 2023-07-17 12:12:21,347 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689595941287.7d2dc555dc1876ee5be41eb233310de8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 12:12:21,347 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1604): Closing 7d2dc555dc1876ee5be41eb233310de8, disabling compactions & flushes 2023-07-17 12:12:21,347 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689595941287.7d2dc555dc1876ee5be41eb233310de8. 2023-07-17 12:12:21,347 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689595941287.7d2dc555dc1876ee5be41eb233310de8. 2023-07-17 12:12:21,347 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689595941287.7d2dc555dc1876ee5be41eb233310de8. after waiting 0 ms 2023-07-17 12:12:21,347 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689595941287.7d2dc555dc1876ee5be41eb233310de8. 2023-07-17 12:12:21,347 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689595941287.7d2dc555dc1876ee5be41eb233310de8. 2023-07-17 12:12:21,347 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1558): Region close journal for 7d2dc555dc1876ee5be41eb233310de8: 2023-07-17 12:12:21,353 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1689595941287.be6ddc25fe0c2580cd461b6f25054c8a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 12:12:21,353 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1604): Closing be6ddc25fe0c2580cd461b6f25054c8a, disabling compactions & flushes 2023-07-17 12:12:21,353 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689595941287.be6ddc25fe0c2580cd461b6f25054c8a. 2023-07-17 12:12:21,353 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689595941287.be6ddc25fe0c2580cd461b6f25054c8a. 2023-07-17 12:12:21,353 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689595941287.be6ddc25fe0c2580cd461b6f25054c8a. after waiting 0 ms 2023-07-17 12:12:21,353 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689595941287.be6ddc25fe0c2580cd461b6f25054c8a. 2023-07-17 12:12:21,353 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1689595941287.be6ddc25fe0c2580cd461b6f25054c8a. 2023-07-17 12:12:21,353 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1558): Region close journal for be6ddc25fe0c2580cd461b6f25054c8a: 2023-07-17 12:12:21,356 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ADD_TO_META 2023-07-17 12:12:21,357 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689595941287.7d2dc555dc1876ee5be41eb233310de8.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689595941357"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689595941357"}]},"ts":"1689595941357"} 2023-07-17 12:12:21,357 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689595941287.be6ddc25fe0c2580cd461b6f25054c8a.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689595941357"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689595941357"}]},"ts":"1689595941357"} 2023-07-17 12:12:21,359 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-17 12:12:21,360 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-17 12:12:21,360 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689595941360"}]},"ts":"1689595941360"} 2023-07-17 12:12:21,362 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLING in hbase:meta 2023-07-17 12:12:21,365 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-17 12:12:21,366 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-17 12:12:21,366 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-17 12:12:21,366 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-17 12:12:21,366 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-17 12:12:21,366 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=7d2dc555dc1876ee5be41eb233310de8, ASSIGN}, {pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=be6ddc25fe0c2580cd461b6f25054c8a, ASSIGN}] 2023-07-17 12:12:21,370 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=be6ddc25fe0c2580cd461b6f25054c8a, ASSIGN 2023-07-17 12:12:21,370 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=7d2dc555dc1876ee5be41eb233310de8, ASSIGN 2023-07-17 12:12:21,371 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=be6ddc25fe0c2580cd461b6f25054c8a, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39491,1689595859788; forceNewPlan=false, retain=false 2023-07-17 12:12:21,371 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=7d2dc555dc1876ee5be41eb233310de8, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33685,1689595859854; forceNewPlan=false, retain=false 2023-07-17 12:12:21,394 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-17 12:12:21,521 INFO [jenkins-hbase4:42013] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-17 12:12:21,524 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=be6ddc25fe0c2580cd461b6f25054c8a, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:12:21,525 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689595941287.be6ddc25fe0c2580cd461b6f25054c8a.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689595941524"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689595941524"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689595941524"}]},"ts":"1689595941524"} 2023-07-17 12:12:21,525 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=7d2dc555dc1876ee5be41eb233310de8, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:12:21,525 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689595941287.7d2dc555dc1876ee5be41eb233310de8.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689595941525"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689595941525"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689595941525"}]},"ts":"1689595941525"} 2023-07-17 12:12:21,530 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=69, ppid=68, state=RUNNABLE; OpenRegionProcedure be6ddc25fe0c2580cd461b6f25054c8a, server=jenkins-hbase4.apache.org,39491,1689595859788}] 2023-07-17 12:12:21,531 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=70, ppid=67, state=RUNNABLE; OpenRegionProcedure 7d2dc555dc1876ee5be41eb233310de8, server=jenkins-hbase4.apache.org,33685,1689595859854}] 2023-07-17 12:12:21,595 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-17 12:12:21,689 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1689595941287.7d2dc555dc1876ee5be41eb233310de8. 2023-07-17 12:12:21,689 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,2,1689595941287.be6ddc25fe0c2580cd461b6f25054c8a. 2023-07-17 12:12:21,689 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 7d2dc555dc1876ee5be41eb233310de8, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689595941287.7d2dc555dc1876ee5be41eb233310de8.', STARTKEY => '', ENDKEY => '2'} 2023-07-17 12:12:21,689 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => be6ddc25fe0c2580cd461b6f25054c8a, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1689595941287.be6ddc25fe0c2580cd461b6f25054c8a.', STARTKEY => '2', ENDKEY => ''} 2023-07-17 12:12:21,689 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1689595941287.7d2dc555dc1876ee5be41eb233310de8. service=AccessControlService 2023-07-17 12:12:21,689 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,2,1689595941287.be6ddc25fe0c2580cd461b6f25054c8a. service=AccessControlService 2023-07-17 12:12:21,690 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-17 12:12:21,690 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-17 12:12:21,690 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 7d2dc555dc1876ee5be41eb233310de8 2023-07-17 12:12:21,690 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 be6ddc25fe0c2580cd461b6f25054c8a 2023-07-17 12:12:21,690 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689595941287.7d2dc555dc1876ee5be41eb233310de8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 12:12:21,690 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 7d2dc555dc1876ee5be41eb233310de8 2023-07-17 12:12:21,690 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 7d2dc555dc1876ee5be41eb233310de8 2023-07-17 12:12:21,690 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1689595941287.be6ddc25fe0c2580cd461b6f25054c8a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 12:12:21,690 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for be6ddc25fe0c2580cd461b6f25054c8a 2023-07-17 12:12:21,690 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for be6ddc25fe0c2580cd461b6f25054c8a 2023-07-17 12:12:21,695 INFO [StoreOpener-be6ddc25fe0c2580cd461b6f25054c8a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region be6ddc25fe0c2580cd461b6f25054c8a 2023-07-17 12:12:21,695 INFO [StoreOpener-7d2dc555dc1876ee5be41eb233310de8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 7d2dc555dc1876ee5be41eb233310de8 2023-07-17 12:12:21,697 DEBUG [StoreOpener-be6ddc25fe0c2580cd461b6f25054c8a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/be6ddc25fe0c2580cd461b6f25054c8a/cf 2023-07-17 12:12:21,697 DEBUG [StoreOpener-be6ddc25fe0c2580cd461b6f25054c8a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/be6ddc25fe0c2580cd461b6f25054c8a/cf 2023-07-17 12:12:21,697 DEBUG [StoreOpener-7d2dc555dc1876ee5be41eb233310de8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7d2dc555dc1876ee5be41eb233310de8/cf 2023-07-17 12:12:21,697 DEBUG [StoreOpener-7d2dc555dc1876ee5be41eb233310de8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7d2dc555dc1876ee5be41eb233310de8/cf 2023-07-17 12:12:21,698 INFO [StoreOpener-be6ddc25fe0c2580cd461b6f25054c8a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region be6ddc25fe0c2580cd461b6f25054c8a columnFamilyName cf 2023-07-17 12:12:21,698 INFO [StoreOpener-7d2dc555dc1876ee5be41eb233310de8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7d2dc555dc1876ee5be41eb233310de8 columnFamilyName cf 2023-07-17 12:12:21,698 INFO [StoreOpener-7d2dc555dc1876ee5be41eb233310de8-1] regionserver.HStore(310): Store=7d2dc555dc1876ee5be41eb233310de8/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-17 12:12:21,698 INFO [StoreOpener-be6ddc25fe0c2580cd461b6f25054c8a-1] regionserver.HStore(310): Store=be6ddc25fe0c2580cd461b6f25054c8a/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-17 12:12:21,700 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7d2dc555dc1876ee5be41eb233310de8 2023-07-17 12:12:21,700 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/be6ddc25fe0c2580cd461b6f25054c8a 2023-07-17 12:12:21,700 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7d2dc555dc1876ee5be41eb233310de8 2023-07-17 12:12:21,701 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/be6ddc25fe0c2580cd461b6f25054c8a 2023-07-17 12:12:21,703 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 7d2dc555dc1876ee5be41eb233310de8 2023-07-17 12:12:21,704 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for be6ddc25fe0c2580cd461b6f25054c8a 2023-07-17 12:12:21,707 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7d2dc555dc1876ee5be41eb233310de8/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-17 12:12:21,707 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/be6ddc25fe0c2580cd461b6f25054c8a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-17 12:12:21,707 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 7d2dc555dc1876ee5be41eb233310de8; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71635116, jitterRate=0.06744641065597534}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-17 12:12:21,707 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 7d2dc555dc1876ee5be41eb233310de8: 2023-07-17 12:12:21,708 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened be6ddc25fe0c2580cd461b6f25054c8a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63130496, jitterRate=-0.05928230285644531}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-17 12:12:21,708 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for be6ddc25fe0c2580cd461b6f25054c8a: 2023-07-17 12:12:21,709 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,2,1689595941287.be6ddc25fe0c2580cd461b6f25054c8a., pid=69, masterSystemTime=1689595941685 2023-07-17 12:12:21,712 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1689595941287.7d2dc555dc1876ee5be41eb233310de8., pid=70, masterSystemTime=1689595941685 2023-07-17 12:12:21,715 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,2,1689595941287.be6ddc25fe0c2580cd461b6f25054c8a. 2023-07-17 12:12:21,715 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,2,1689595941287.be6ddc25fe0c2580cd461b6f25054c8a. 2023-07-17 12:12:21,716 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=be6ddc25fe0c2580cd461b6f25054c8a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:12:21,716 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689595941287.be6ddc25fe0c2580cd461b6f25054c8a.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689595941716"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689595941716"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689595941716"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689595941716"}]},"ts":"1689595941716"} 2023-07-17 12:12:21,717 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1689595941287.7d2dc555dc1876ee5be41eb233310de8. 2023-07-17 12:12:21,717 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1689595941287.7d2dc555dc1876ee5be41eb233310de8. 2023-07-17 12:12:21,718 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=7d2dc555dc1876ee5be41eb233310de8, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:12:21,718 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689595941287.7d2dc555dc1876ee5be41eb233310de8.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689595941718"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689595941718"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689595941718"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689595941718"}]},"ts":"1689595941718"} 2023-07-17 12:12:21,725 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=69, resume processing ppid=68 2023-07-17 12:12:21,725 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=69, ppid=68, state=SUCCESS; OpenRegionProcedure be6ddc25fe0c2580cd461b6f25054c8a, server=jenkins-hbase4.apache.org,39491,1689595859788 in 190 msec 2023-07-17 12:12:21,726 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=70, resume processing ppid=67 2023-07-17 12:12:21,726 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=70, ppid=67, state=SUCCESS; OpenRegionProcedure 7d2dc555dc1876ee5be41eb233310de8, server=jenkins-hbase4.apache.org,33685,1689595859854 in 190 msec 2023-07-17 12:12:21,727 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=68, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=be6ddc25fe0c2580cd461b6f25054c8a, ASSIGN in 359 msec 2023-07-17 12:12:21,728 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=67, resume processing ppid=66 2023-07-17 12:12:21,728 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=7d2dc555dc1876ee5be41eb233310de8, ASSIGN in 360 msec 2023-07-17 12:12:21,729 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-17 12:12:21,729 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689595941729"}]},"ts":"1689595941729"} 2023-07-17 12:12:21,730 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLED in hbase:meta 2023-07-17 12:12:21,733 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_POST_OPERATION 2023-07-17 12:12:21,733 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion-1 jenkins: RWXCA 2023-07-17 12:12:21,735 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39491] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-07-17 12:12:21,738 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 12:12:21,738 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:39491-0x10173314c9f0001, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 12:12:21,738 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:42615-0x10173314c9f0003, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 12:12:21,738 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:33685-0x10173314c9f0002, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 12:12:21,740 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-17 12:12:21,740 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-17 12:12:21,740 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-17 12:12:21,740 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-17 12:12:21,741 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-17 12:12:21,741 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-17 12:12:21,741 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-17 12:12:21,741 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-17 12:12:21,751 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=66, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 452 msec 2023-07-17 12:12:21,897 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-17 12:12:21,898 INFO [Listener at jenkins-hbase4.apache.org/44127] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 66 completed 2023-07-17 12:12:21,928 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] master.HMaster$2(1952): Client=jenkins//172.31.14.131 merge regions 7d2dc555dc1876ee5be41eb233310de8, be6ddc25fe0c2580cd461b6f25054c8a 2023-07-17 12:12:21,943 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] procedure2.ProcedureExecutor(1029): Stored pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[7d2dc555dc1876ee5be41eb233310de8, be6ddc25fe0c2580cd461b6f25054c8a], force=true 2023-07-17 12:12:21,945 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[7d2dc555dc1876ee5be41eb233310de8, be6ddc25fe0c2580cd461b6f25054c8a], force=true 2023-07-17 12:12:21,945 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[7d2dc555dc1876ee5be41eb233310de8, be6ddc25fe0c2580cd461b6f25054c8a], force=true 2023-07-17 12:12:21,945 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[7d2dc555dc1876ee5be41eb233310de8, be6ddc25fe0c2580cd461b6f25054c8a], force=true 2023-07-17 12:12:21,948 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-17 12:12:21,972 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=7d2dc555dc1876ee5be41eb233310de8, UNASSIGN}, {pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=be6ddc25fe0c2580cd461b6f25054c8a, UNASSIGN}] 2023-07-17 12:12:21,974 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=7d2dc555dc1876ee5be41eb233310de8, UNASSIGN 2023-07-17 12:12:21,974 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=be6ddc25fe0c2580cd461b6f25054c8a, UNASSIGN 2023-07-17 12:12:21,975 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=7d2dc555dc1876ee5be41eb233310de8, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:12:21,975 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=be6ddc25fe0c2580cd461b6f25054c8a, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:12:21,975 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689595941287.7d2dc555dc1876ee5be41eb233310de8.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689595941975"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689595941975"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689595941975"}]},"ts":"1689595941975"} 2023-07-17 12:12:21,975 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689595941287.be6ddc25fe0c2580cd461b6f25054c8a.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689595941975"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689595941975"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689595941975"}]},"ts":"1689595941975"} 2023-07-17 12:12:21,978 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=74, ppid=72, state=RUNNABLE; CloseRegionProcedure 7d2dc555dc1876ee5be41eb233310de8, server=jenkins-hbase4.apache.org,33685,1689595859854}] 2023-07-17 12:12:21,980 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=75, ppid=73, state=RUNNABLE; CloseRegionProcedure be6ddc25fe0c2580cd461b6f25054c8a, server=jenkins-hbase4.apache.org,39491,1689595859788}] 2023-07-17 12:12:22,050 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-17 12:12:22,130 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 7d2dc555dc1876ee5be41eb233310de8 2023-07-17 12:12:22,133 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 7d2dc555dc1876ee5be41eb233310de8, disabling compactions & flushes 2023-07-17 12:12:22,133 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689595941287.7d2dc555dc1876ee5be41eb233310de8. 2023-07-17 12:12:22,133 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689595941287.7d2dc555dc1876ee5be41eb233310de8. 2023-07-17 12:12:22,133 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689595941287.7d2dc555dc1876ee5be41eb233310de8. after waiting 0 ms 2023-07-17 12:12:22,133 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689595941287.7d2dc555dc1876ee5be41eb233310de8. 2023-07-17 12:12:22,133 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 7d2dc555dc1876ee5be41eb233310de8 1/1 column families, dataSize=24 B heapSize=352 B 2023-07-17 12:12:22,133 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close be6ddc25fe0c2580cd461b6f25054c8a 2023-07-17 12:12:22,134 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing be6ddc25fe0c2580cd461b6f25054c8a, disabling compactions & flushes 2023-07-17 12:12:22,135 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689595941287.be6ddc25fe0c2580cd461b6f25054c8a. 2023-07-17 12:12:22,135 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689595941287.be6ddc25fe0c2580cd461b6f25054c8a. 2023-07-17 12:12:22,135 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689595941287.be6ddc25fe0c2580cd461b6f25054c8a. after waiting 0 ms 2023-07-17 12:12:22,135 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689595941287.be6ddc25fe0c2580cd461b6f25054c8a. 2023-07-17 12:12:22,135 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing be6ddc25fe0c2580cd461b6f25054c8a 1/1 column families, dataSize=24 B heapSize=352 B 2023-07-17 12:12:22,152 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/be6ddc25fe0c2580cd461b6f25054c8a/.tmp/cf/8216710c157c41469b264cf6535cadce 2023-07-17 12:12:22,158 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/be6ddc25fe0c2580cd461b6f25054c8a/.tmp/cf/8216710c157c41469b264cf6535cadce as hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/be6ddc25fe0c2580cd461b6f25054c8a/cf/8216710c157c41469b264cf6535cadce 2023-07-17 12:12:22,164 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/be6ddc25fe0c2580cd461b6f25054c8a/cf/8216710c157c41469b264cf6535cadce, entries=1, sequenceid=5, filesize=4.7 K 2023-07-17 12:12:22,164 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for be6ddc25fe0c2580cd461b6f25054c8a in 29ms, sequenceid=5, compaction requested=false 2023-07-17 12:12:22,165 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion-1' 2023-07-17 12:12:22,176 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/be6ddc25fe0c2580cd461b6f25054c8a/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-17 12:12:22,176 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-17 12:12:22,177 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1689595941287.be6ddc25fe0c2580cd461b6f25054c8a. 2023-07-17 12:12:22,177 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for be6ddc25fe0c2580cd461b6f25054c8a: 2023-07-17 12:12:22,178 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed be6ddc25fe0c2580cd461b6f25054c8a 2023-07-17 12:12:22,179 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=be6ddc25fe0c2580cd461b6f25054c8a, regionState=CLOSED 2023-07-17 12:12:22,179 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689595941287.be6ddc25fe0c2580cd461b6f25054c8a.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689595942179"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689595942179"}]},"ts":"1689595942179"} 2023-07-17 12:12:22,182 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=75, resume processing ppid=73 2023-07-17 12:12:22,182 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=75, ppid=73, state=SUCCESS; CloseRegionProcedure be6ddc25fe0c2580cd461b6f25054c8a, server=jenkins-hbase4.apache.org,39491,1689595859788 in 200 msec 2023-07-17 12:12:22,183 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=73, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=be6ddc25fe0c2580cd461b6f25054c8a, UNASSIGN in 210 msec 2023-07-17 12:12:22,251 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-17 12:12:22,551 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7d2dc555dc1876ee5be41eb233310de8/.tmp/cf/ade59b8e3a35440192d4677fc9384cf6 2023-07-17 12:12:22,553 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-17 12:12:22,569 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7d2dc555dc1876ee5be41eb233310de8/.tmp/cf/ade59b8e3a35440192d4677fc9384cf6 as hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7d2dc555dc1876ee5be41eb233310de8/cf/ade59b8e3a35440192d4677fc9384cf6 2023-07-17 12:12:22,577 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7d2dc555dc1876ee5be41eb233310de8/cf/ade59b8e3a35440192d4677fc9384cf6, entries=1, sequenceid=5, filesize=4.7 K 2023-07-17 12:12:22,578 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for 7d2dc555dc1876ee5be41eb233310de8 in 445ms, sequenceid=5, compaction requested=false 2023-07-17 12:12:22,588 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7d2dc555dc1876ee5be41eb233310de8/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-17 12:12:22,588 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-17 12:12:22,588 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689595941287.7d2dc555dc1876ee5be41eb233310de8. 2023-07-17 12:12:22,588 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 7d2dc555dc1876ee5be41eb233310de8: 2023-07-17 12:12:22,590 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 7d2dc555dc1876ee5be41eb233310de8 2023-07-17 12:12:22,591 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=7d2dc555dc1876ee5be41eb233310de8, regionState=CLOSED 2023-07-17 12:12:22,591 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689595941287.7d2dc555dc1876ee5be41eb233310de8.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689595942591"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689595942591"}]},"ts":"1689595942591"} 2023-07-17 12:12:22,595 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=74, resume processing ppid=72 2023-07-17 12:12:22,595 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=74, ppid=72, state=SUCCESS; CloseRegionProcedure 7d2dc555dc1876ee5be41eb233310de8, server=jenkins-hbase4.apache.org,33685,1689595859854 in 614 msec 2023-07-17 12:12:22,601 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=72, resume processing ppid=71 2023-07-17 12:12:22,601 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=7d2dc555dc1876ee5be41eb233310de8, UNASSIGN in 627 msec 2023-07-17 12:12:22,680 DEBUG [PEWorker-2] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/62c137d8d0280be16e85eda100b9f4f2/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=-1 2023-07-17 12:12:22,682 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689595941287.7d2dc555dc1876ee5be41eb233310de8.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-17 12:12:22,683 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689595941287.be6ddc25fe0c2580cd461b6f25054c8a.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-17 12:12:22,683 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":7,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689595941288.62c137d8d0280be16e85eda100b9f4f2.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0000","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0001","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-17 12:12:22,749 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=62c137d8d0280be16e85eda100b9f4f2, ASSIGN}] 2023-07-17 12:12:22,750 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=62c137d8d0280be16e85eda100b9f4f2, ASSIGN 2023-07-17 12:12:22,751 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=62c137d8d0280be16e85eda100b9f4f2, ASSIGN; state=MERGED, location=jenkins-hbase4.apache.org,33685,1689595859854; forceNewPlan=false, retain=false 2023-07-17 12:12:22,902 INFO [jenkins-hbase4:42013] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-17 12:12:22,904 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=62c137d8d0280be16e85eda100b9f4f2, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:12:22,904 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689595941288.62c137d8d0280be16e85eda100b9f4f2.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689595942904"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689595942904"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689595942904"}]},"ts":"1689595942904"} 2023-07-17 12:12:22,907 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; OpenRegionProcedure 62c137d8d0280be16e85eda100b9f4f2, server=jenkins-hbase4.apache.org,33685,1689595859854}] 2023-07-17 12:12:23,054 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-17 12:12:23,066 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1689595941288.62c137d8d0280be16e85eda100b9f4f2. 2023-07-17 12:12:23,066 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 62c137d8d0280be16e85eda100b9f4f2, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689595941288.62c137d8d0280be16e85eda100b9f4f2.', STARTKEY => '', ENDKEY => ''} 2023-07-17 12:12:23,066 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1689595941288.62c137d8d0280be16e85eda100b9f4f2. service=AccessControlService 2023-07-17 12:12:23,067 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-17 12:12:23,067 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 62c137d8d0280be16e85eda100b9f4f2 2023-07-17 12:12:23,067 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689595941288.62c137d8d0280be16e85eda100b9f4f2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 12:12:23,067 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 62c137d8d0280be16e85eda100b9f4f2 2023-07-17 12:12:23,067 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 62c137d8d0280be16e85eda100b9f4f2 2023-07-17 12:12:23,068 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(950): Rewriting .regioninfo file at: hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/62c137d8d0280be16e85eda100b9f4f2/.regioninfo 2023-07-17 12:12:23,080 INFO [StoreOpener-62c137d8d0280be16e85eda100b9f4f2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 62c137d8d0280be16e85eda100b9f4f2 2023-07-17 12:12:23,081 DEBUG [StoreOpener-62c137d8d0280be16e85eda100b9f4f2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/62c137d8d0280be16e85eda100b9f4f2/cf 2023-07-17 12:12:23,081 DEBUG [StoreOpener-62c137d8d0280be16e85eda100b9f4f2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/62c137d8d0280be16e85eda100b9f4f2/cf 2023-07-17 12:12:23,082 INFO [StoreOpener-62c137d8d0280be16e85eda100b9f4f2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 62c137d8d0280be16e85eda100b9f4f2 columnFamilyName cf 2023-07-17 12:12:23,119 DEBUG [StoreOpener-62c137d8d0280be16e85eda100b9f4f2-1] regionserver.HStore(539): loaded hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/62c137d8d0280be16e85eda100b9f4f2/cf/8216710c157c41469b264cf6535cadce.be6ddc25fe0c2580cd461b6f25054c8a->hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/be6ddc25fe0c2580cd461b6f25054c8a/cf/8216710c157c41469b264cf6535cadce-top 2023-07-17 12:12:23,126 DEBUG [StoreOpener-62c137d8d0280be16e85eda100b9f4f2-1] regionserver.HStore(539): loaded hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/62c137d8d0280be16e85eda100b9f4f2/cf/ade59b8e3a35440192d4677fc9384cf6.7d2dc555dc1876ee5be41eb233310de8->hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7d2dc555dc1876ee5be41eb233310de8/cf/ade59b8e3a35440192d4677fc9384cf6-top 2023-07-17 12:12:23,126 INFO [StoreOpener-62c137d8d0280be16e85eda100b9f4f2-1] regionserver.HStore(310): Store=62c137d8d0280be16e85eda100b9f4f2/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-17 12:12:23,127 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/62c137d8d0280be16e85eda100b9f4f2 2023-07-17 12:12:23,129 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/62c137d8d0280be16e85eda100b9f4f2 2023-07-17 12:12:23,133 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 62c137d8d0280be16e85eda100b9f4f2 2023-07-17 12:12:23,134 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 62c137d8d0280be16e85eda100b9f4f2; next sequenceid=9; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69915811, jitterRate=0.0418267697095871}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-17 12:12:23,135 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 62c137d8d0280be16e85eda100b9f4f2: 2023-07-17 12:12:23,137 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1689595941288.62c137d8d0280be16e85eda100b9f4f2., pid=77, masterSystemTime=1689595943063 2023-07-17 12:12:23,138 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(328): Ignoring compaction request for testtb-testExportFileSystemStateWithMergeRegion-1,,1689595941288.62c137d8d0280be16e85eda100b9f4f2.,because compaction is disabled. 2023-07-17 12:12:23,139 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1689595941288.62c137d8d0280be16e85eda100b9f4f2. 2023-07-17 12:12:23,140 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1689595941288.62c137d8d0280be16e85eda100b9f4f2. 2023-07-17 12:12:23,141 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=62c137d8d0280be16e85eda100b9f4f2, regionState=OPEN, openSeqNum=9, regionLocation=jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:12:23,141 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689595941288.62c137d8d0280be16e85eda100b9f4f2.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689595943140"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689595943140"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689595943140"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689595943140"}]},"ts":"1689595943140"} 2023-07-17 12:12:23,144 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=77, resume processing ppid=76 2023-07-17 12:12:23,145 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=77, ppid=76, state=SUCCESS; OpenRegionProcedure 62c137d8d0280be16e85eda100b9f4f2, server=jenkins-hbase4.apache.org,33685,1689595859854 in 235 msec 2023-07-17 12:12:23,146 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=76, resume processing ppid=71 2023-07-17 12:12:23,147 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=76, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=62c137d8d0280be16e85eda100b9f4f2, ASSIGN in 396 msec 2023-07-17 12:12:23,148 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=71, state=SUCCESS; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[7d2dc555dc1876ee5be41eb233310de8, be6ddc25fe0c2580cd461b6f25054c8a], force=true in 1.2150 sec 2023-07-17 12:12:23,668 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689595867847_0004_000001 (auth:SIMPLE) 2023-07-17 12:12:24,056 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-17 12:12:24,056 INFO [Listener at jenkins-hbase4.apache.org/44127] client.HBaseAdmin$TableFuture(3541): Operation: MERGE_REGIONS, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 71 completed 2023-07-17 12:12:24,057 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-17 12:12:24,057 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689595944057 (current time:1689595944057). 2023-07-17 12:12:24,057 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-17 12:12:24,058 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] zookeeper.ReadOnlyZKClient(139): Connect 0x6b9a0e72 to 127.0.0.1:55622 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-17 12:12:24,065 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2832f17a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-17 12:12:24,070 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 12:12:24,074 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49754, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 12:12:24,075 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6b9a0e72 to 127.0.0.1:55622 2023-07-17 12:12:24,075 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 12:12:24,076 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] zookeeper.ReadOnlyZKClient(139): Connect 0x50be9a80 to 127.0.0.1:55622 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-17 12:12:24,096 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6becf77b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-17 12:12:24,098 DEBUG [hconnection-0x54ea625d-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 12:12:24,103 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49758, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 12:12:24,111 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 12:12:24,114 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54224, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 12:12:24,115 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x50be9a80 to 127.0.0.1:55622 2023-07-17 12:12:24,115 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 12:12:24,116 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-07-17 12:12:24,116 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-17 12:12:24,117 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-17 12:12:24,119 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] procedure2.ProcedureExecutor(1029): Stored pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-17 12:12:24,120 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-17 12:12:24,121 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=78, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE; timeout=600000, timestamp=1689596544121 2023-07-17 12:12:24,121 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-17 12:12:24,121 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-17 12:12:24,127 DEBUG [Listener at jenkins-hbase4.apache.org/44127] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-17 12:12:24,127 DEBUG [Listener at jenkins-hbase4.apache.org/44127] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-17 12:12:24,135 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-17 12:12:24,143 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=78, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-17 12:12:24,144 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=78, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE in 25 msec 2023-07-17 12:12:24,146 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-17 12:12:24,147 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=79, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED; timeout=600000, timestamp=1689596544147 2023-07-17 12:12:24,171 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 12:12:24,171 INFO [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' 2023-07-17 12:12:24,171 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 12:12:24,173 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' 2023-07-17 12:12:24,173 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1', kicking off acquire phase on members. 2023-07-17 12:12:24,223 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 12:12:24,224 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 12:12:24,225 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:33685-0x10173314c9f0002, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 12:12:24,225 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:39491-0x10173314c9f0001, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 12:12:24,225 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 12:12:24,225 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:42615-0x10173314c9f0003, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 12:12:24,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 12:12:24,225 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 12:12:24,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 12:12:24,225 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:12:24,225 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 12:12:24,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 12:12:24,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 12:12:24,226 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:12:24,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 12:12:24,226 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-17 12:12:24,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 12:12:24,226 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33685-0x10173314c9f0002, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 12:12:24,226 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39491-0x10173314c9f0001, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 12:12:24,226 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42615-0x10173314c9f0003, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 12:12:24,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-17 12:12:24,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 12:12:24,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-17 12:12:24,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 12:12:24,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-17 12:12:24,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 12:12:24,227 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-17 12:12:24,227 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-17 12:12:24,227 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-17 12:12:24,228 DEBUG [Listener at jenkins-hbase4.apache.org/44127] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 12:12:24,229 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-17 12:12:24,229 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' is still in progress! 2023-07-17 12:12:24,229 DEBUG [Listener at jenkins-hbase4.apache.org/44127] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-17 12:12:24,230 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 12:12:24,231 DEBUG [member: 'jenkins-hbase4.apache.org,39491,1689595859788' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-17 12:12:24,231 DEBUG [member: 'jenkins-hbase4.apache.org,39491,1689595859788' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 12:12:24,234 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 12:12:24,235 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-17 12:12:24,235 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 12:12:24,237 DEBUG [member: 'jenkins-hbase4.apache.org,39491,1689595859788' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-17 12:12:24,237 DEBUG [member: 'jenkins-hbase4.apache.org,39491,1689595859788' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-17 12:12:24,237 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 12:12:24,237 DEBUG [member: 'jenkins-hbase4.apache.org,33685,1689595859854' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-17 12:12:24,237 DEBUG [member: 'jenkins-hbase4.apache.org,33685,1689595859854' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 12:12:24,237 DEBUG [member: 'jenkins-hbase4.apache.org,39491,1689595859788' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39491,1689595859788' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-17 12:12:24,239 DEBUG [member: 'jenkins-hbase4.apache.org,33685,1689595859854' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-17 12:12:24,239 DEBUG [member: 'jenkins-hbase4.apache.org,33685,1689595859854' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-17 12:12:24,239 DEBUG [member: 'jenkins-hbase4.apache.org,33685,1689595859854' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33685,1689595859854' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-17 12:12:24,239 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-17 12:12:24,239 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-17 12:12:24,239 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42615,1689595859906' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-17 12:12:24,241 DEBUG [member: 'jenkins-hbase4.apache.org,39491,1689595859788' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 12:12:24,243 DEBUG [member: 'jenkins-hbase4.apache.org,39491,1689595859788' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39491-0x10173314c9f0001, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 12:12:24,243 DEBUG [member: 'jenkins-hbase4.apache.org,39491,1689595859788' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 12:12:24,243 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 12:12:24,245 DEBUG [member: 'jenkins-hbase4.apache.org,33685,1689595859854' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 12:12:24,245 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42615-0x10173314c9f0003, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 12:12:24,245 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 12:12:24,245 DEBUG [member: 'jenkins-hbase4.apache.org,33685,1689595859854' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33685-0x10173314c9f0002, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 12:12:24,245 DEBUG [member: 'jenkins-hbase4.apache.org,33685,1689595859854' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 12:12:24,250 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:12:24,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:12:24,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 12:12:24,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 12:12:24,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 12:12:24,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 12:12:24,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 12:12:24,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:12:24,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:12:24,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:12:24,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 12:12:24,254 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33685,1689595859854' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' on coordinator 2023-07-17 12:12:24,254 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1bd5a9d1[Count = 0] remaining members to acquire global barrier 2023-07-17 12:12:24,254 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'in-barrier' execution. 2023-07-17 12:12:24,254 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 12:12:24,256 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:39491-0x10173314c9f0001, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 12:12:24,256 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 12:12:24,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 12:12:24,256 DEBUG [member: 'jenkins-hbase4.apache.org,39491,1689595859788' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-17 12:12:24,256 DEBUG [member: 'jenkins-hbase4.apache.org,39491,1689595859788' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-17 12:12:24,256 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:12:24,256 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-17 12:12:24,256 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:42615-0x10173314c9f0003, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 12:12:24,256 DEBUG [member: 'jenkins-hbase4.apache.org,39491,1689595859788' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,39491,1689595859788' in zk 2023-07-17 12:12:24,256 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 12:12:24,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 12:12:24,256 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:33685-0x10173314c9f0002, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 12:12:24,257 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-17 12:12:24,257 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 12:12:24,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 12:12:24,257 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-17 12:12:24,257 DEBUG [member: 'jenkins-hbase4.apache.org,33685,1689595859854' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-17 12:12:24,257 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,42615,1689595859906' in zk 2023-07-17 12:12:24,258 DEBUG [member: 'jenkins-hbase4.apache.org,39491,1689595859788' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-17 12:12:24,258 DEBUG [member: 'jenkins-hbase4.apache.org,39491,1689595859788' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 12:12:24,258 DEBUG [member: 'jenkins-hbase4.apache.org,39491,1689595859788' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-17 12:12:24,260 DEBUG [member: 'jenkins-hbase4.apache.org,33685,1689595859854' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-17 12:12:24,260 DEBUG [member: 'jenkins-hbase4.apache.org,33685,1689595859854' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-17 12:12:24,260 DEBUG [rs(jenkins-hbase4.apache.org,33685,1689595859854)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1689595941288.62c137d8d0280be16e85eda100b9f4f2. 2023-07-17 12:12:24,260 DEBUG [rs(jenkins-hbase4.apache.org,33685,1689595859854)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1689595941288.62c137d8d0280be16e85eda100b9f4f2. started... 2023-07-17 12:12:24,262 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-17 12:12:24,262 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 12:12:24,262 DEBUG [rs(jenkins-hbase4.apache.org,33685,1689595859854)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 62c137d8d0280be16e85eda100b9f4f2: 2023-07-17 12:12:24,262 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-17 12:12:24,267 DEBUG [rs(jenkins-hbase4.apache.org,33685,1689595859854)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689595941288.62c137d8d0280be16e85eda100b9f4f2.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 12:12:24,267 DEBUG [rs(jenkins-hbase4.apache.org,33685,1689595859854)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-17 12:12:24,268 DEBUG [rs(jenkins-hbase4.apache.org,33685,1689595859854)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/62c137d8d0280be16e85eda100b9f4f2/cf/8216710c157c41469b264cf6535cadce.be6ddc25fe0c2580cd461b6f25054c8a->hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/be6ddc25fe0c2580cd461b6f25054c8a/cf/8216710c157c41469b264cf6535cadce-top, hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/62c137d8d0280be16e85eda100b9f4f2/cf/ade59b8e3a35440192d4677fc9384cf6.7d2dc555dc1876ee5be41eb233310de8->hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7d2dc555dc1876ee5be41eb233310de8/cf/ade59b8e3a35440192d4677fc9384cf6-top] hfiles 2023-07-17 12:12:24,268 DEBUG [rs(jenkins-hbase4.apache.org,33685,1689595859854)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/2): hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/62c137d8d0280be16e85eda100b9f4f2/cf/8216710c157c41469b264cf6535cadce.be6ddc25fe0c2580cd461b6f25054c8a for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 12:12:24,269 DEBUG [rs(jenkins-hbase4.apache.org,33685,1689595859854)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/2): hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/62c137d8d0280be16e85eda100b9f4f2/cf/ade59b8e3a35440192d4677fc9384cf6.7d2dc555dc1876ee5be41eb233310de8 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 12:12:24,297 DEBUG [rs(jenkins-hbase4.apache.org,33685,1689595859854)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1689595941288.62c137d8d0280be16e85eda100b9f4f2. completed. 2023-07-17 12:12:24,297 DEBUG [rs(jenkins-hbase4.apache.org,33685,1689595859854)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1689595941288.62c137d8d0280be16e85eda100b9f4f2. 2023-07-17 12:12:24,297 DEBUG [member: 'jenkins-hbase4.apache.org,33685,1689595859854' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-17 12:12:24,297 DEBUG [member: 'jenkins-hbase4.apache.org,33685,1689595859854' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-17 12:12:24,297 DEBUG [member: 'jenkins-hbase4.apache.org,33685,1689595859854' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:12:24,297 DEBUG [member: 'jenkins-hbase4.apache.org,33685,1689595859854' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-17 12:12:24,297 DEBUG [member: 'jenkins-hbase4.apache.org,33685,1689595859854' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,33685,1689595859854' in zk 2023-07-17 12:12:24,303 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:12:24,303 DEBUG [member: 'jenkins-hbase4.apache.org,33685,1689595859854' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-17 12:12:24,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:12:24,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 12:12:24,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 12:12:24,303 DEBUG [member: 'jenkins-hbase4.apache.org,33685,1689595859854' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 12:12:24,304 DEBUG [member: 'jenkins-hbase4.apache.org,33685,1689595859854' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-17 12:12:24,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 12:12:24,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 12:12:24,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 12:12:24,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:12:24,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:12:24,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:12:24,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 12:12:24,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 12:12:24,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:12:24,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:12:24,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:12:24,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' member 'jenkins-hbase4.apache.org,33685,1689595859854': 2023-07-17 12:12:24,308 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33685,1689595859854' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion-1', counting down latch. Waiting for 0 more 2023-07-17 12:12:24,308 INFO [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' execution completed 2023-07-17 12:12:24,308 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-17 12:12:24,308 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-17 12:12:24,308 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 12:12:24,308 INFO [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegion-1including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-17 12:12:24,310 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:42615-0x10173314c9f0003, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 12:12:24,310 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:39491-0x10173314c9f0001, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 12:12:24,310 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 12:12:24,310 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 12:12:24,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 12:12:24,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 12:12:24,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 12:12:24,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 12:12:24,310 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 12:12:24,310 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:39491-0x10173314c9f0001, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 12:12:24,310 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:42615-0x10173314c9f0003, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 12:12:24,310 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:33685-0x10173314c9f0002, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 12:12:24,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 12:12:24,311 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 12:12:24,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 12:12:24,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 12:12:24,311 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:33685-0x10173314c9f0002, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 12:12:24,311 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 12:12:24,311 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:12:24,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 12:12:24,315 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 12:12:24,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 12:12:24,315 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:12:24,315 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 12:12:24,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 12:12:24,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 12:12:24,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 12:12:24,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 12:12:24,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 12:12:24,317 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:12:24,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 12:12:24,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 12:12:24,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:12:24,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:12:24,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:12:24,320 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:12:24,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 12:12:24,321 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:12:24,321 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:12:24,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 12:12:24,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:12:24,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:12:24,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:12:24,329 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:42615-0x10173314c9f0003, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 12:12:24,329 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:39491-0x10173314c9f0001, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 12:12:24,329 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:42615-0x10173314c9f0003, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 12:12:24,329 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 12:12:24,329 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:39491-0x10173314c9f0001, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 12:12:24,329 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:12:24,329 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:33685-0x10173314c9f0002, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 12:12:24,329 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 12:12:24,329 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:12:24,329 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:12:24,329 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 12:12:24,329 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 12:12:24,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 12:12:24,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 12:12:24,329 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 12:12:24,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 12:12:24,330 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:12:24,330 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 12:12:24,330 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 12:12:24,330 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 12:12:24,330 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 12:12:24,330 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:12:24,330 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:12:24,330 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 12:12:24,330 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 12:12:24,331 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 12:12:24,331 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 12:12:24,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 12:12:24,331 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 12:12:24,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 12:12:24,335 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:33685-0x10173314c9f0002, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 12:12:24,338 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 12:12:24,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 12:12:24,416 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 12:12:24,429 DEBUG [Listener at jenkins-hbase4.apache.org/44127] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 12:12:24,431 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-17 12:12:24,431 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' is still in progress! 2023-07-17 12:12:24,431 DEBUG [Listener at jenkins-hbase4.apache.org/44127] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-17 12:12:24,539 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed 2023-07-17 12:12:24,539 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 12:12:24,540 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 12:12:24,540 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 at 1689595944121Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689595944330 (+209 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689595944330Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689595944349 (+19 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689595944397 (+48 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed at 1689595944539 (+142 ms) 2023-07-17 12:12:24,543 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=79, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-17 12:12:24,545 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=79, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED in 416 msec 2023-07-17 12:12:24,572 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-17 12:12:24,731 DEBUG [Listener at jenkins-hbase4.apache.org/44127] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 12:12:24,734 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-17 12:12:24,734 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-17 12:12:24,734 INFO [Listener at jenkins-hbase4.apache.org/44127] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/export-test/export-1689595944734 2023-07-17 12:12:24,735 INFO [Listener at jenkins-hbase4.apache.org/44127] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:46215, tgtDir=hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/export-test/export-1689595944734, rawTgtDir=hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/export-test/export-1689595944734, srcFsUri=hdfs://localhost:46215, srcDir=hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b 2023-07-17 12:12:24,769 DEBUG [Listener at jenkins-hbase4.apache.org/44127] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:46215, inputRoot=hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b 2023-07-17 12:12:24,769 DEBUG [Listener at jenkins-hbase4.apache.org/44127] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_83393892_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/export-test/export-1689595944734, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/export-test/export-1689595944734/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 12:12:24,769 INFO [Listener at jenkins-hbase4.apache.org/44127] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:46215, inputRoot=hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b, snapshotDir=hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1. 2023-07-17 12:12:24,780 INFO [Listener at jenkins-hbase4.apache.org/44127] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/export-test/export-1689595944734/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 12:12:24,832 DEBUG [Listener at jenkins-hbase4.apache.org/44127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-17 12:12:24,833 DEBUG [Listener at jenkins-hbase4.apache.org/44127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-17 12:12:24,833 DEBUG [Listener at jenkins-hbase4.apache.org/44127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-17 12:12:24,834 DEBUG [Listener at jenkins-hbase4.apache.org/44127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-17 12:12:24,834 DEBUG [Listener at jenkins-hbase4.apache.org/44127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-17 12:12:24,835 DEBUG [Listener at jenkins-hbase4.apache.org/44127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-17 12:12:24,835 DEBUG [Listener at jenkins-hbase4.apache.org/44127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-17 12:12:24,928 DEBUG [Listener at jenkins-hbase4.apache.org/44127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58af5705-0594-af5f-981c-fa1d3b267fab/hadoop-9198124165899555037.jar 2023-07-17 12:12:24,929 DEBUG [Listener at jenkins-hbase4.apache.org/44127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-17 12:12:24,929 DEBUG [Listener at jenkins-hbase4.apache.org/44127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-17 12:12:24,930 DEBUG [Listener at jenkins-hbase4.apache.org/44127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-17 12:12:24,930 DEBUG [Listener at jenkins-hbase4.apache.org/44127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-17 12:12:24,931 DEBUG [Listener at jenkins-hbase4.apache.org/44127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-17 12:12:24,931 DEBUG [Listener at jenkins-hbase4.apache.org/44127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-17 12:12:24,932 DEBUG [Listener at jenkins-hbase4.apache.org/44127] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-17 12:12:24,933 DEBUG [Listener at jenkins-hbase4.apache.org/44127] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-17 12:12:24,933 DEBUG [Listener at jenkins-hbase4.apache.org/44127] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-17 12:12:24,934 DEBUG [Listener at jenkins-hbase4.apache.org/44127] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-17 12:12:24,935 DEBUG [Listener at jenkins-hbase4.apache.org/44127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-17 12:12:24,936 DEBUG [Listener at jenkins-hbase4.apache.org/44127] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-17 12:12:24,936 DEBUG [Listener at jenkins-hbase4.apache.org/44127] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-17 12:12:24,937 DEBUG [Listener at jenkins-hbase4.apache.org/44127] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-17 12:12:24,937 DEBUG [Listener at jenkins-hbase4.apache.org/44127] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-17 12:12:24,938 DEBUG [Listener at jenkins-hbase4.apache.org/44127] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-17 12:12:24,938 DEBUG [Listener at jenkins-hbase4.apache.org/44127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-17 12:12:24,939 DEBUG [Listener at jenkins-hbase4.apache.org/44127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-17 12:12:24,939 DEBUG [Listener at jenkins-hbase4.apache.org/44127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-17 12:12:24,940 DEBUG [Listener at jenkins-hbase4.apache.org/44127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-17 12:12:24,940 DEBUG [Listener at jenkins-hbase4.apache.org/44127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-17 12:12:24,941 DEBUG [Listener at jenkins-hbase4.apache.org/44127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-17 12:12:24,941 DEBUG [Listener at jenkins-hbase4.apache.org/44127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-17 12:12:25,839 WARN [Listener at jenkins-hbase4.apache.org/44127] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-17 12:12:25,844 INFO [Listener at jenkins-hbase4.apache.org/44127] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithMergeRegion-1' hfile list 2023-07-17 12:12:25,846 DEBUG [Listener at jenkins-hbase4.apache.org/44127] snapshot.ExportSnapshot(671): export split=0 size=9.5 K 2023-07-17 12:12:25,949 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-17 12:12:25,949 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-17 12:12:26,508 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689595867847_0005_000001 (auth:SIMPLE) 2023-07-17 12:12:32,764 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689595867847_0005_000001 (auth:SIMPLE) 2023-07-17 12:12:35,167 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689595867847_0005_000001 (auth:SIMPLE) 2023-07-17 12:12:39,155 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689595867847_0005_000001 (auth:SIMPLE) 2023-07-17 12:12:41,165 INFO [Listener at jenkins-hbase4.apache.org/44127] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-17 12:12:41,169 INFO [Listener at jenkins-hbase4.apache.org/44127] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-17 12:12:41,180 INFO [Listener at jenkins-hbase4.apache.org/44127] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 12:12:41,180 INFO [Listener at jenkins-hbase4.apache.org/44127] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-17 12:12:41,181 INFO [Listener at jenkins-hbase4.apache.org/44127] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-17 12:12:41,181 DEBUG [Listener at jenkins-hbase4.apache.org/44127] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1847813108_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 12:12:41,182 DEBUG [Listener at jenkins-hbase4.apache.org/44127] snapshot.TestExportSnapshot(367): hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-07-17 12:12:41,182 DEBUG [Listener at jenkins-hbase4.apache.org/44127] snapshot.TestExportSnapshot(367): hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-07-17 12:12:41,182 DEBUG [Listener at jenkins-hbase4.apache.org/44127] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1847813108_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/export-test/export-1689595944734/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/export-test/export-1689595944734/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 12:12:41,183 DEBUG [Listener at jenkins-hbase4.apache.org/44127] snapshot.TestExportSnapshot(367): hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/export-test/export-1689595944734/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-07-17 12:12:41,183 DEBUG [Listener at jenkins-hbase4.apache.org/44127] snapshot.TestExportSnapshot(367): hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/export-test/export-1689595944734/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-07-17 12:12:41,198 INFO [Listener at jenkins-hbase4.apache.org/44127] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-17 12:12:41,198 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-17 12:12:41,201 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] procedure2.ProcedureExecutor(1029): Stored pid=80, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-17 12:12:41,205 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-17 12:12:41,206 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689595961206"}]},"ts":"1689595961206"} 2023-07-17 12:12:41,215 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLING in hbase:meta 2023-07-17 12:12:41,217 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLING 2023-07-17 12:12:41,218 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=62c137d8d0280be16e85eda100b9f4f2, UNASSIGN}] 2023-07-17 12:12:41,220 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=62c137d8d0280be16e85eda100b9f4f2, UNASSIGN 2023-07-17 12:12:41,221 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=62c137d8d0280be16e85eda100b9f4f2, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:12:41,221 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689595941288.62c137d8d0280be16e85eda100b9f4f2.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689595961221"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689595961221"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689595961221"}]},"ts":"1689595961221"} 2023-07-17 12:12:41,223 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=82, ppid=81, state=RUNNABLE; CloseRegionProcedure 62c137d8d0280be16e85eda100b9f4f2, server=jenkins-hbase4.apache.org,33685,1689595859854}] 2023-07-17 12:12:41,306 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-17 12:12:41,375 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 62c137d8d0280be16e85eda100b9f4f2 2023-07-17 12:12:41,375 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 62c137d8d0280be16e85eda100b9f4f2, disabling compactions & flushes 2023-07-17 12:12:41,375 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689595941288.62c137d8d0280be16e85eda100b9f4f2. 2023-07-17 12:12:41,375 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689595941288.62c137d8d0280be16e85eda100b9f4f2. 2023-07-17 12:12:41,375 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689595941288.62c137d8d0280be16e85eda100b9f4f2. after waiting 0 ms 2023-07-17 12:12:41,375 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689595941288.62c137d8d0280be16e85eda100b9f4f2. 2023-07-17 12:12:41,387 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/62c137d8d0280be16e85eda100b9f4f2/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=8 2023-07-17 12:12:41,387 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-17 12:12:41,388 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689595941288.62c137d8d0280be16e85eda100b9f4f2. 2023-07-17 12:12:41,388 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 62c137d8d0280be16e85eda100b9f4f2: 2023-07-17 12:12:41,390 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 62c137d8d0280be16e85eda100b9f4f2 2023-07-17 12:12:41,390 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=62c137d8d0280be16e85eda100b9f4f2, regionState=CLOSED 2023-07-17 12:12:41,390 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689595941288.62c137d8d0280be16e85eda100b9f4f2.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689595961390"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689595961390"}]},"ts":"1689595961390"} 2023-07-17 12:12:41,393 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=82, resume processing ppid=81 2023-07-17 12:12:41,393 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=82, ppid=81, state=SUCCESS; CloseRegionProcedure 62c137d8d0280be16e85eda100b9f4f2, server=jenkins-hbase4.apache.org,33685,1689595859854 in 169 msec 2023-07-17 12:12:41,395 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=81, resume processing ppid=80 2023-07-17 12:12:41,395 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=81, ppid=80, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=62c137d8d0280be16e85eda100b9f4f2, UNASSIGN in 175 msec 2023-07-17 12:12:41,395 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689595961395"}]},"ts":"1689595961395"} 2023-07-17 12:12:41,397 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLED in hbase:meta 2023-07-17 12:12:41,398 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLED 2023-07-17 12:12:41,404 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=80, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 204 msec 2023-07-17 12:12:41,507 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-17 12:12:41,508 INFO [Listener at jenkins-hbase4.apache.org/44127] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 80 completed 2023-07-17 12:12:41,508 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-17 12:12:41,509 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] procedure2.ProcedureExecutor(1029): Stored pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-17 12:12:41,512 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-17 12:12:41,512 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-17 12:12:41,513 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=83, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-17 12:12:41,514 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39491] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-17 12:12:41,517 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-17 12:12:41,517 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:33685-0x10173314c9f0002, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-17 12:12:41,517 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:39491-0x10173314c9f0001, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-17 12:12:41,518 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-17 12:12:41,518 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-17 12:12:41,518 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:42615-0x10173314c9f0003, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-17 12:12:41,520 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-17 12:12:41,520 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 12:12:41,520 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data null 2023-07-17 12:12:41,520 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/62c137d8d0280be16e85eda100b9f4f2 2023-07-17 12:12:41,520 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:39491-0x10173314c9f0001, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-17 12:12:41,520 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-17 12:12:41,520 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:33685-0x10173314c9f0002, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 12:12:41,520 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:39491-0x10173314c9f0001, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 12:12:41,523 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-17 12:12:41,523 DEBUG [HFileArchiver-19] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/62c137d8d0280be16e85eda100b9f4f2/cf, FileablePath, hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/62c137d8d0280be16e85eda100b9f4f2/recovered.edits] 2023-07-17 12:12:41,523 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-17 12:12:41,523 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-17 12:12:41,523 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-17 12:12:41,527 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:42615-0x10173314c9f0003, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 12:12:41,527 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data null 2023-07-17 12:12:41,527 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-17 12:12:41,528 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-17 12:12:41,543 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/be6ddc25fe0c2580cd461b6f25054c8a 2023-07-17 12:12:41,543 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7d2dc555dc1876ee5be41eb233310de8 2023-07-17 12:12:41,548 DEBUG [HFileArchiver-20] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7d2dc555dc1876ee5be41eb233310de8/cf, FileablePath, hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7d2dc555dc1876ee5be41eb233310de8/recovered.edits] 2023-07-17 12:12:41,548 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/be6ddc25fe0c2580cd461b6f25054c8a/cf, FileablePath, hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/be6ddc25fe0c2580cd461b6f25054c8a/recovered.edits] 2023-07-17 12:12:41,552 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/62c137d8d0280be16e85eda100b9f4f2/cf/8216710c157c41469b264cf6535cadce.be6ddc25fe0c2580cd461b6f25054c8a to hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/62c137d8d0280be16e85eda100b9f4f2/cf/8216710c157c41469b264cf6535cadce.be6ddc25fe0c2580cd461b6f25054c8a 2023-07-17 12:12:41,555 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/62c137d8d0280be16e85eda100b9f4f2/cf/ade59b8e3a35440192d4677fc9384cf6.7d2dc555dc1876ee5be41eb233310de8 to hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/62c137d8d0280be16e85eda100b9f4f2/cf/ade59b8e3a35440192d4677fc9384cf6.7d2dc555dc1876ee5be41eb233310de8 2023-07-17 12:12:41,560 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7d2dc555dc1876ee5be41eb233310de8/cf/ade59b8e3a35440192d4677fc9384cf6 to hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7d2dc555dc1876ee5be41eb233310de8/cf/ade59b8e3a35440192d4677fc9384cf6 2023-07-17 12:12:41,562 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/be6ddc25fe0c2580cd461b6f25054c8a/cf/8216710c157c41469b264cf6535cadce to hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/be6ddc25fe0c2580cd461b6f25054c8a/cf/8216710c157c41469b264cf6535cadce 2023-07-17 12:12:41,564 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/62c137d8d0280be16e85eda100b9f4f2/recovered.edits/12.seqid to hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/62c137d8d0280be16e85eda100b9f4f2/recovered.edits/12.seqid 2023-07-17 12:12:41,565 DEBUG [HFileArchiver-19] backup.HFileArchiver(596): Deleted hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/62c137d8d0280be16e85eda100b9f4f2 2023-07-17 12:12:41,566 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7d2dc555dc1876ee5be41eb233310de8/recovered.edits/8.seqid to hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7d2dc555dc1876ee5be41eb233310de8/recovered.edits/8.seqid 2023-07-17 12:12:41,567 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/be6ddc25fe0c2580cd461b6f25054c8a/recovered.edits/8.seqid to hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/be6ddc25fe0c2580cd461b6f25054c8a/recovered.edits/8.seqid 2023-07-17 12:12:41,568 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/be6ddc25fe0c2580cd461b6f25054c8a 2023-07-17 12:12:41,569 DEBUG [HFileArchiver-20] backup.HFileArchiver(596): Deleted hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7d2dc555dc1876ee5be41eb233310de8 2023-07-17 12:12:41,569 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-07-17 12:12:41,573 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=83, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-17 12:12:41,576 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testtb-testExportFileSystemStateWithMergeRegion-1 from hbase:meta 2023-07-17 12:12:41,582 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' descriptor. 2023-07-17 12:12:41,584 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=83, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-17 12:12:41,584 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' from region states. 2023-07-17 12:12:41,585 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689595941288.62c137d8d0280be16e85eda100b9f4f2.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689595961584"}]},"ts":"9223372036854775807"} 2023-07-17 12:12:41,587 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-07-17 12:12:41,588 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 62c137d8d0280be16e85eda100b9f4f2, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689595941288.62c137d8d0280be16e85eda100b9f4f2.', STARTKEY => '', ENDKEY => ''}] 2023-07-17 12:12:41,588 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion-1' as deleted. 2023-07-17 12:12:41,588 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689595961588"}]},"ts":"9223372036854775807"} 2023-07-17 12:12:41,590 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion-1 state from META 2023-07-17 12:12:41,592 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=83, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-17 12:12:41,594 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=83, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 83 msec 2023-07-17 12:12:41,624 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-17 12:12:41,624 INFO [Listener at jenkins-hbase4.apache.org/44127] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 83 completed 2023-07-17 12:12:41,625 INFO [Listener at jenkins-hbase4.apache.org/44127] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:41,625 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:41,626 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] procedure2.ProcedureExecutor(1029): Stored pid=84, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:41,630 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-17 12:12:41,630 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689595961630"}]},"ts":"1689595961630"} 2023-07-17 12:12:41,632 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLING in hbase:meta 2023-07-17 12:12:41,639 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLING 2023-07-17 12:12:41,639 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=c7991e82dbd667a8425f93a90f84e008, UNASSIGN}, {pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=4abf4dbe2fb6991c62dd936abee2598e, UNASSIGN}] 2023-07-17 12:12:41,642 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=4abf4dbe2fb6991c62dd936abee2598e, UNASSIGN 2023-07-17 12:12:41,642 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=c7991e82dbd667a8425f93a90f84e008, UNASSIGN 2023-07-17 12:12:41,643 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=4abf4dbe2fb6991c62dd936abee2598e, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:12:41,643 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689595939267.4abf4dbe2fb6991c62dd936abee2598e.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689595961642"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689595961642"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689595961642"}]},"ts":"1689595961642"} 2023-07-17 12:12:41,643 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=c7991e82dbd667a8425f93a90f84e008, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:12:41,644 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689595939267.c7991e82dbd667a8425f93a90f84e008.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689595961643"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689595961643"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689595961643"}]},"ts":"1689595961643"} 2023-07-17 12:12:41,644 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=87, ppid=86, state=RUNNABLE; CloseRegionProcedure 4abf4dbe2fb6991c62dd936abee2598e, server=jenkins-hbase4.apache.org,42615,1689595859906}] 2023-07-17 12:12:41,645 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=88, ppid=85, state=RUNNABLE; CloseRegionProcedure c7991e82dbd667a8425f93a90f84e008, server=jenkins-hbase4.apache.org,33685,1689595859854}] 2023-07-17 12:12:41,733 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-17 12:12:41,801 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close c7991e82dbd667a8425f93a90f84e008 2023-07-17 12:12:41,801 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 4abf4dbe2fb6991c62dd936abee2598e 2023-07-17 12:12:41,801 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing c7991e82dbd667a8425f93a90f84e008, disabling compactions & flushes 2023-07-17 12:12:41,801 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1689595939267.c7991e82dbd667a8425f93a90f84e008. 2023-07-17 12:12:41,801 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 4abf4dbe2fb6991c62dd936abee2598e, disabling compactions & flushes 2023-07-17 12:12:41,801 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1689595939267.4abf4dbe2fb6991c62dd936abee2598e. 2023-07-17 12:12:41,801 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689595939267.4abf4dbe2fb6991c62dd936abee2598e. 2023-07-17 12:12:41,801 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689595939267.4abf4dbe2fb6991c62dd936abee2598e. after waiting 0 ms 2023-07-17 12:12:41,802 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1689595939267.4abf4dbe2fb6991c62dd936abee2598e. 2023-07-17 12:12:41,801 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689595939267.c7991e82dbd667a8425f93a90f84e008. 2023-07-17 12:12:41,802 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689595939267.c7991e82dbd667a8425f93a90f84e008. after waiting 0 ms 2023-07-17 12:12:41,802 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1689595939267.c7991e82dbd667a8425f93a90f84e008. 2023-07-17 12:12:41,852 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/default/testtb-testExportFileSystemStateWithMergeRegion/4abf4dbe2fb6991c62dd936abee2598e/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-17 12:12:41,853 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-17 12:12:41,856 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1689595939267.4abf4dbe2fb6991c62dd936abee2598e. 2023-07-17 12:12:41,856 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 4abf4dbe2fb6991c62dd936abee2598e: 2023-07-17 12:12:41,860 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 4abf4dbe2fb6991c62dd936abee2598e 2023-07-17 12:12:41,861 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=4abf4dbe2fb6991c62dd936abee2598e, regionState=CLOSED 2023-07-17 12:12:41,861 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689595939267.4abf4dbe2fb6991c62dd936abee2598e.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689595961861"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689595961861"}]},"ts":"1689595961861"} 2023-07-17 12:12:41,869 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=87, resume processing ppid=86 2023-07-17 12:12:41,869 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=87, ppid=86, state=SUCCESS; CloseRegionProcedure 4abf4dbe2fb6991c62dd936abee2598e, server=jenkins-hbase4.apache.org,42615,1689595859906 in 219 msec 2023-07-17 12:12:41,871 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=86, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=4abf4dbe2fb6991c62dd936abee2598e, UNASSIGN in 230 msec 2023-07-17 12:12:41,876 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/default/testtb-testExportFileSystemStateWithMergeRegion/c7991e82dbd667a8425f93a90f84e008/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-17 12:12:41,877 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-17 12:12:41,879 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1689595939267.c7991e82dbd667a8425f93a90f84e008. 2023-07-17 12:12:41,879 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for c7991e82dbd667a8425f93a90f84e008: 2023-07-17 12:12:41,881 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=c7991e82dbd667a8425f93a90f84e008, regionState=CLOSED 2023-07-17 12:12:41,882 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689595939267.c7991e82dbd667a8425f93a90f84e008.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689595961881"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689595961881"}]},"ts":"1689595961881"} 2023-07-17 12:12:41,884 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed c7991e82dbd667a8425f93a90f84e008 2023-07-17 12:12:41,895 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=88, resume processing ppid=85 2023-07-17 12:12:41,896 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=88, ppid=85, state=SUCCESS; CloseRegionProcedure c7991e82dbd667a8425f93a90f84e008, server=jenkins-hbase4.apache.org,33685,1689595859854 in 247 msec 2023-07-17 12:12:41,898 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=85, resume processing ppid=84 2023-07-17 12:12:41,898 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=85, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=c7991e82dbd667a8425f93a90f84e008, UNASSIGN in 255 msec 2023-07-17 12:12:41,899 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689595961899"}]},"ts":"1689595961899"} 2023-07-17 12:12:41,907 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLED in hbase:meta 2023-07-17 12:12:41,908 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLED 2023-07-17 12:12:41,913 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=84, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 286 msec 2023-07-17 12:12:41,936 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-17 12:12:41,937 INFO [Listener at jenkins-hbase4.apache.org/44127] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 84 completed 2023-07-17 12:12:41,939 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:41,940 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] procedure2.ProcedureExecutor(1029): Stored pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:41,947 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:41,948 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:41,950 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=89, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:41,954 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39491] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:41,956 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/c7991e82dbd667a8425f93a90f84e008 2023-07-17 12:12:41,956 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/4abf4dbe2fb6991c62dd936abee2598e 2023-07-17 12:12:41,959 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:33685-0x10173314c9f0002, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:41,959 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:39491-0x10173314c9f0001, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:41,959 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:41,959 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:42615-0x10173314c9f0003, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:41,960 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-17 12:12:41,960 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-17 12:12:41,960 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-17 12:12:41,960 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-17 12:12:41,961 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/c7991e82dbd667a8425f93a90f84e008/cf, FileablePath, hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/c7991e82dbd667a8425f93a90f84e008/recovered.edits] 2023-07-17 12:12:41,961 DEBUG [HFileArchiver-15] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/4abf4dbe2fb6991c62dd936abee2598e/cf, FileablePath, hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/4abf4dbe2fb6991c62dd936abee2598e/recovered.edits] 2023-07-17 12:12:41,962 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:33685-0x10173314c9f0002, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:41,962 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:33685-0x10173314c9f0002, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 12:12:41,962 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:41,962 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:42615-0x10173314c9f0003, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:41,962 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:39491-0x10173314c9f0001, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:41,962 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 12:12:41,962 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:39491-0x10173314c9f0001, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 12:12:41,962 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:42615-0x10173314c9f0003, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 12:12:41,964 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-17 12:12:41,977 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/c7991e82dbd667a8425f93a90f84e008/cf/6cb2ae8005f1474083f3cc4bfc67dc79 to hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/c7991e82dbd667a8425f93a90f84e008/cf/6cb2ae8005f1474083f3cc4bfc67dc79 2023-07-17 12:12:41,977 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/4abf4dbe2fb6991c62dd936abee2598e/cf/9f93c3d2b4de476d9012f8a738de6844 to hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/4abf4dbe2fb6991c62dd936abee2598e/cf/9f93c3d2b4de476d9012f8a738de6844 2023-07-17 12:12:41,982 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/c7991e82dbd667a8425f93a90f84e008/recovered.edits/9.seqid to hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/c7991e82dbd667a8425f93a90f84e008/recovered.edits/9.seqid 2023-07-17 12:12:41,983 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/c7991e82dbd667a8425f93a90f84e008 2023-07-17 12:12:41,984 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/4abf4dbe2fb6991c62dd936abee2598e/recovered.edits/9.seqid to hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/4abf4dbe2fb6991c62dd936abee2598e/recovered.edits/9.seqid 2023-07-17 12:12:41,984 DEBUG [HFileArchiver-15] backup.HFileArchiver(596): Deleted hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/4abf4dbe2fb6991c62dd936abee2598e 2023-07-17 12:12:41,984 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-07-17 12:12:41,985 DEBUG [PEWorker-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-07-17 12:12:41,986 DEBUG [PEWorker-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf] 2023-07-17 12:12:41,990 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b202307175a93ead76bbc46179ac1b94ee44c23f6 to hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b202307175a93ead76bbc46179ac1b94ee44c23f6 2023-07-17 12:12:41,992 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e2023071733e0989a86534b67bee1a12e41aea781 to hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e2023071733e0989a86534b67bee1a12e41aea781 2023-07-17 12:12:41,993 DEBUG [PEWorker-4] backup.HFileArchiver(596): Deleted hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-07-17 12:12:41,996 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=89, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:42,002 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithMergeRegion from hbase:meta 2023-07-17 12:12:42,006 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion' descriptor. 2023-07-17 12:12:42,007 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=89, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:42,007 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion' from region states. 2023-07-17 12:12:42,008 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689595939267.c7991e82dbd667a8425f93a90f84e008.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689595962007"}]},"ts":"9223372036854775807"} 2023-07-17 12:12:42,008 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689595939267.4abf4dbe2fb6991c62dd936abee2598e.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689595962007"}]},"ts":"9223372036854775807"} 2023-07-17 12:12:42,009 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-17 12:12:42,009 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => c7991e82dbd667a8425f93a90f84e008, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689595939267.c7991e82dbd667a8425f93a90f84e008.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 4abf4dbe2fb6991c62dd936abee2598e, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689595939267.4abf4dbe2fb6991c62dd936abee2598e.', STARTKEY => '1', ENDKEY => ''}] 2023-07-17 12:12:42,009 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion' as deleted. 2023-07-17 12:12:42,009 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689595962009"}]},"ts":"9223372036854775807"} 2023-07-17 12:12:42,011 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion state from META 2023-07-17 12:12:42,013 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=89, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:42,015 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=89, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 74 msec 2023-07-17 12:12:42,065 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-17 12:12:42,065 INFO [Listener at jenkins-hbase4.apache.org/44127] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 89 completed 2023-07-17 12:12:42,078 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithMergeRegion" 2023-07-17 12:12:42,080 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:42,082 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion" 2023-07-17 12:12:42,084 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:42,085 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion-1" 2023-07-17 12:12:42,088 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 12:12:42,119 INFO [Listener at jenkins-hbase4.apache.org/44127] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=756 (was 745) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1847813108_17 at /127.0.0.1:36994 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1abcf153-shared-pool-30 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1abcf153-shared-pool-32 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-4101 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1847813108_17 at /127.0.0.1:51868 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1abcf153-shared-pool-34 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-38843522_1 at /127.0.0.1:46438 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1abcf153-shared-pool-35 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (232395425) connection to jenkins-hbase4.apache.org/172.31.14.131:36999 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x1abcf153-shared-pool-33 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-19 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1abcf153-shared-pool-31 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-20 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1847813108_17 at /127.0.0.1:40304 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=903 (was 898) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=560 (was 469) - SystemLoadAverage LEAK? -, ProcessCount=183 (was 183), AvailableMemoryMB=2317 (was 2437) 2023-07-17 12:12:42,119 WARN [Listener at jenkins-hbase4.apache.org/44127] hbase.ResourceChecker(130): Thread=756 is superior to 500 2023-07-17 12:12:42,145 INFO [Listener at jenkins-hbase4.apache.org/44127] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=756, OpenFileDescriptor=903, MaxFileDescriptor=60000, SystemLoadAverage=560, ProcessCount=183, AvailableMemoryMB=2316 2023-07-17 12:12:42,145 WARN [Listener at jenkins-hbase4.apache.org/44127] hbase.ResourceChecker(130): Thread=756 is superior to 500 2023-07-17 12:12:42,147 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-17 12:12:42,148 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] procedure2.ProcedureExecutor(1029): Stored pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-17 12:12:42,151 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-07-17 12:12:42,151 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testEmptyExportFileSystemState" procId is: 90 2023-07-17 12:12:42,152 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-17 12:12:42,152 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-17 12:12:42,154 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.tmp/data/default/testtb-testEmptyExportFileSystemState/f349335016d00f26499a212280dc535c 2023-07-17 12:12:42,154 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.tmp/data/default/testtb-testEmptyExportFileSystemState/d610b9ff636d6929793263b2d7f98e7b 2023-07-17 12:12:42,155 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.tmp/data/default/testtb-testEmptyExportFileSystemState/f349335016d00f26499a212280dc535c empty. 2023-07-17 12:12:42,155 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.tmp/data/default/testtb-testEmptyExportFileSystemState/d610b9ff636d6929793263b2d7f98e7b empty. 2023-07-17 12:12:42,155 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.tmp/data/default/testtb-testEmptyExportFileSystemState/f349335016d00f26499a212280dc535c 2023-07-17 12:12:42,161 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.tmp/data/default/testtb-testEmptyExportFileSystemState/d610b9ff636d6929793263b2d7f98e7b 2023-07-17 12:12:42,161 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-07-17 12:12:42,176 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.tmp/data/default/testtb-testEmptyExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-07-17 12:12:42,178 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => f349335016d00f26499a212280dc535c, NAME => 'testtb-testEmptyExportFileSystemState,,1689595962147.f349335016d00f26499a212280dc535c.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.tmp 2023-07-17 12:12:42,180 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => d610b9ff636d6929793263b2d7f98e7b, NAME => 'testtb-testEmptyExportFileSystemState,1,1689595962147.d610b9ff636d6929793263b2d7f98e7b.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.tmp 2023-07-17 12:12:42,247 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1689595962147.d610b9ff636d6929793263b2d7f98e7b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 12:12:42,248 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing d610b9ff636d6929793263b2d7f98e7b, disabling compactions & flushes 2023-07-17 12:12:42,248 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1689595962147.d610b9ff636d6929793263b2d7f98e7b. 2023-07-17 12:12:42,248 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1689595962147.d610b9ff636d6929793263b2d7f98e7b. 2023-07-17 12:12:42,248 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1689595962147.f349335016d00f26499a212280dc535c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 12:12:42,248 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing f349335016d00f26499a212280dc535c, disabling compactions & flushes 2023-07-17 12:12:42,248 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1689595962147.f349335016d00f26499a212280dc535c. 2023-07-17 12:12:42,248 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1689595962147.f349335016d00f26499a212280dc535c. 2023-07-17 12:12:42,248 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1689595962147.f349335016d00f26499a212280dc535c. after waiting 0 ms 2023-07-17 12:12:42,248 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1689595962147.f349335016d00f26499a212280dc535c. 2023-07-17 12:12:42,248 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1689595962147.f349335016d00f26499a212280dc535c. 2023-07-17 12:12:42,248 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for f349335016d00f26499a212280dc535c: 2023-07-17 12:12:42,248 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1689595962147.d610b9ff636d6929793263b2d7f98e7b. after waiting 0 ms 2023-07-17 12:12:42,248 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1689595962147.d610b9ff636d6929793263b2d7f98e7b. 2023-07-17 12:12:42,248 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1689595962147.d610b9ff636d6929793263b2d7f98e7b. 2023-07-17 12:12:42,248 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for d610b9ff636d6929793263b2d7f98e7b: 2023-07-17 12:12:42,253 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-07-17 12:12:42,253 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-17 12:12:42,254 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1689595962147.f349335016d00f26499a212280dc535c.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689595962254"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689595962254"}]},"ts":"1689595962254"} 2023-07-17 12:12:42,254 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1689595962147.d610b9ff636d6929793263b2d7f98e7b.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689595962254"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689595962254"}]},"ts":"1689595962254"} 2023-07-17 12:12:42,256 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-17 12:12:42,257 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-17 12:12:42,257 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689595962257"}]},"ts":"1689595962257"} 2023-07-17 12:12:42,259 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLING in hbase:meta 2023-07-17 12:12:42,265 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-17 12:12:42,266 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-17 12:12:42,266 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-17 12:12:42,266 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-17 12:12:42,266 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-17 12:12:42,267 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=f349335016d00f26499a212280dc535c, ASSIGN}, {pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=d610b9ff636d6929793263b2d7f98e7b, ASSIGN}] 2023-07-17 12:12:42,271 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=d610b9ff636d6929793263b2d7f98e7b, ASSIGN 2023-07-17 12:12:42,271 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=f349335016d00f26499a212280dc535c, ASSIGN 2023-07-17 12:12:42,275 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=f349335016d00f26499a212280dc535c, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42615,1689595859906; forceNewPlan=false, retain=false 2023-07-17 12:12:42,275 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=d610b9ff636d6929793263b2d7f98e7b, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33685,1689595859854; forceNewPlan=false, retain=false 2023-07-17 12:12:42,425 INFO [jenkins-hbase4:42013] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-17 12:12:42,429 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=f349335016d00f26499a212280dc535c, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:12:42,429 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=d610b9ff636d6929793263b2d7f98e7b, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:12:42,429 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1689595962147.f349335016d00f26499a212280dc535c.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689595962429"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689595962429"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689595962429"}]},"ts":"1689595962429"} 2023-07-17 12:12:42,429 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1689595962147.d610b9ff636d6929793263b2d7f98e7b.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689595962429"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689595962429"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689595962429"}]},"ts":"1689595962429"} 2023-07-17 12:12:42,432 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=93, ppid=91, state=RUNNABLE; OpenRegionProcedure f349335016d00f26499a212280dc535c, server=jenkins-hbase4.apache.org,42615,1689595859906}] 2023-07-17 12:12:42,433 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=94, ppid=92, state=RUNNABLE; OpenRegionProcedure d610b9ff636d6929793263b2d7f98e7b, server=jenkins-hbase4.apache.org,33685,1689595859854}] 2023-07-17 12:12:42,455 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-17 12:12:42,589 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,1,1689595962147.d610b9ff636d6929793263b2d7f98e7b. 2023-07-17 12:12:42,589 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => d610b9ff636d6929793263b2d7f98e7b, NAME => 'testtb-testEmptyExportFileSystemState,1,1689595962147.d610b9ff636d6929793263b2d7f98e7b.', STARTKEY => '1', ENDKEY => ''} 2023-07-17 12:12:42,590 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,1,1689595962147.d610b9ff636d6929793263b2d7f98e7b. service=AccessControlService 2023-07-17 12:12:42,590 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-17 12:12:42,590 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState d610b9ff636d6929793263b2d7f98e7b 2023-07-17 12:12:42,590 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1689595962147.d610b9ff636d6929793263b2d7f98e7b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 12:12:42,590 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for d610b9ff636d6929793263b2d7f98e7b 2023-07-17 12:12:42,590 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for d610b9ff636d6929793263b2d7f98e7b 2023-07-17 12:12:42,594 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,,1689595962147.f349335016d00f26499a212280dc535c. 2023-07-17 12:12:42,595 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => f349335016d00f26499a212280dc535c, NAME => 'testtb-testEmptyExportFileSystemState,,1689595962147.f349335016d00f26499a212280dc535c.', STARTKEY => '', ENDKEY => '1'} 2023-07-17 12:12:42,595 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,,1689595962147.f349335016d00f26499a212280dc535c. service=AccessControlService 2023-07-17 12:12:42,595 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-17 12:12:42,595 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState f349335016d00f26499a212280dc535c 2023-07-17 12:12:42,595 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1689595962147.f349335016d00f26499a212280dc535c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 12:12:42,596 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for f349335016d00f26499a212280dc535c 2023-07-17 12:12:42,596 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for f349335016d00f26499a212280dc535c 2023-07-17 12:12:42,597 INFO [StoreOpener-d610b9ff636d6929793263b2d7f98e7b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region d610b9ff636d6929793263b2d7f98e7b 2023-07-17 12:12:42,600 DEBUG [StoreOpener-d610b9ff636d6929793263b2d7f98e7b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/default/testtb-testEmptyExportFileSystemState/d610b9ff636d6929793263b2d7f98e7b/cf 2023-07-17 12:12:42,600 DEBUG [StoreOpener-d610b9ff636d6929793263b2d7f98e7b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/default/testtb-testEmptyExportFileSystemState/d610b9ff636d6929793263b2d7f98e7b/cf 2023-07-17 12:12:42,600 INFO [StoreOpener-d610b9ff636d6929793263b2d7f98e7b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d610b9ff636d6929793263b2d7f98e7b columnFamilyName cf 2023-07-17 12:12:42,608 INFO [StoreOpener-f349335016d00f26499a212280dc535c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region f349335016d00f26499a212280dc535c 2023-07-17 12:12:42,615 INFO [StoreOpener-d610b9ff636d6929793263b2d7f98e7b-1] regionserver.HStore(310): Store=d610b9ff636d6929793263b2d7f98e7b/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-17 12:12:42,615 DEBUG [StoreOpener-f349335016d00f26499a212280dc535c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/default/testtb-testEmptyExportFileSystemState/f349335016d00f26499a212280dc535c/cf 2023-07-17 12:12:42,615 DEBUG [StoreOpener-f349335016d00f26499a212280dc535c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/default/testtb-testEmptyExportFileSystemState/f349335016d00f26499a212280dc535c/cf 2023-07-17 12:12:42,616 INFO [StoreOpener-f349335016d00f26499a212280dc535c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f349335016d00f26499a212280dc535c columnFamilyName cf 2023-07-17 12:12:42,617 INFO [StoreOpener-f349335016d00f26499a212280dc535c-1] regionserver.HStore(310): Store=f349335016d00f26499a212280dc535c/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-17 12:12:42,618 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/default/testtb-testEmptyExportFileSystemState/f349335016d00f26499a212280dc535c 2023-07-17 12:12:42,618 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/default/testtb-testEmptyExportFileSystemState/f349335016d00f26499a212280dc535c 2023-07-17 12:12:42,619 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/default/testtb-testEmptyExportFileSystemState/d610b9ff636d6929793263b2d7f98e7b 2023-07-17 12:12:42,619 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/default/testtb-testEmptyExportFileSystemState/d610b9ff636d6929793263b2d7f98e7b 2023-07-17 12:12:42,621 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for f349335016d00f26499a212280dc535c 2023-07-17 12:12:42,622 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for d610b9ff636d6929793263b2d7f98e7b 2023-07-17 12:12:42,627 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/default/testtb-testEmptyExportFileSystemState/d610b9ff636d6929793263b2d7f98e7b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-17 12:12:42,627 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/default/testtb-testEmptyExportFileSystemState/f349335016d00f26499a212280dc535c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-17 12:12:42,627 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened d610b9ff636d6929793263b2d7f98e7b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70632197, jitterRate=0.052501752972602844}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-17 12:12:42,627 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for d610b9ff636d6929793263b2d7f98e7b: 2023-07-17 12:12:42,628 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened f349335016d00f26499a212280dc535c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70058624, jitterRate=0.04395484924316406}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-17 12:12:42,628 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for f349335016d00f26499a212280dc535c: 2023-07-17 12:12:42,629 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,,1689595962147.f349335016d00f26499a212280dc535c., pid=93, masterSystemTime=1689595962584 2023-07-17 12:12:42,631 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,,1689595962147.f349335016d00f26499a212280dc535c. 2023-07-17 12:12:42,631 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,,1689595962147.f349335016d00f26499a212280dc535c. 2023-07-17 12:12:42,631 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,1,1689595962147.d610b9ff636d6929793263b2d7f98e7b., pid=94, masterSystemTime=1689595962585 2023-07-17 12:12:42,632 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=f349335016d00f26499a212280dc535c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:12:42,632 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,,1689595962147.f349335016d00f26499a212280dc535c.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689595962632"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689595962632"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689595962632"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689595962632"}]},"ts":"1689595962632"} 2023-07-17 12:12:42,635 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,1,1689595962147.d610b9ff636d6929793263b2d7f98e7b. 2023-07-17 12:12:42,635 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,1,1689595962147.d610b9ff636d6929793263b2d7f98e7b. 2023-07-17 12:12:42,640 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=d610b9ff636d6929793263b2d7f98e7b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:12:42,640 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,1,1689595962147.d610b9ff636d6929793263b2d7f98e7b.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689595962640"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689595962640"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689595962640"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689595962640"}]},"ts":"1689595962640"} 2023-07-17 12:12:42,644 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=93, resume processing ppid=91 2023-07-17 12:12:42,644 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=93, ppid=91, state=SUCCESS; OpenRegionProcedure f349335016d00f26499a212280dc535c, server=jenkins-hbase4.apache.org,42615,1689595859906 in 207 msec 2023-07-17 12:12:42,646 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=94, resume processing ppid=92 2023-07-17 12:12:42,646 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=94, ppid=92, state=SUCCESS; OpenRegionProcedure d610b9ff636d6929793263b2d7f98e7b, server=jenkins-hbase4.apache.org,33685,1689595859854 in 209 msec 2023-07-17 12:12:42,646 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=91, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=f349335016d00f26499a212280dc535c, ASSIGN in 378 msec 2023-07-17 12:12:42,650 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=92, resume processing ppid=90 2023-07-17 12:12:42,650 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=92, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=d610b9ff636d6929793263b2d7f98e7b, ASSIGN in 379 msec 2023-07-17 12:12:42,650 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-17 12:12:42,651 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689595962650"}]},"ts":"1689595962650"} 2023-07-17 12:12:42,652 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLED in hbase:meta 2023-07-17 12:12:42,656 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-07-17 12:12:42,656 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testEmptyExportFileSystemState jenkins: RWXCA 2023-07-17 12:12:42,658 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39491] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-17 12:12:42,660 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 12:12:42,660 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:39491-0x10173314c9f0001, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 12:12:42,660 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:33685-0x10173314c9f0002, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 12:12:42,660 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:42615-0x10173314c9f0003, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 12:12:42,662 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-17 12:12:42,662 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-17 12:12:42,663 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-17 12:12:42,663 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-17 12:12:42,667 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=90, state=SUCCESS; CreateTableProcedure table=testtb-testEmptyExportFileSystemState in 515 msec 2023-07-17 12:12:42,756 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-17 12:12:42,756 INFO [Listener at jenkins-hbase4.apache.org/44127] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 90 completed 2023-07-17 12:12:42,763 DEBUG [Listener at jenkins-hbase4.apache.org/44127] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-07-17 12:12:42,763 DEBUG [Listener at jenkins-hbase4.apache.org/44127] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1689595962147.f349335016d00f26499a212280dc535c. 2023-07-17 12:12:42,765 INFO [Listener at jenkins-hbase4.apache.org/44127] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-17 12:12:42,789 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-17 12:12:42,790 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689595962790 (current time:1689595962790). 2023-07-17 12:12:42,790 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-17 12:12:42,790 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] zookeeper.ReadOnlyZKClient(139): Connect 0x7ecf4f55 to 127.0.0.1:55622 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-17 12:12:42,800 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@69f9001f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-17 12:12:42,810 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 12:12:42,811 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37496, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 12:12:42,813 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7ecf4f55 to 127.0.0.1:55622 2023-07-17 12:12:42,813 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 12:12:42,814 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] zookeeper.ReadOnlyZKClient(139): Connect 0x4dd4579d to 127.0.0.1:55622 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-17 12:12:42,849 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@75c57248, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-17 12:12:42,855 DEBUG [hconnection-0x75da175a-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 12:12:42,861 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37504, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 12:12:42,865 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 12:12:42,868 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58858, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 12:12:42,876 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4dd4579d to 127.0.0.1:55622 2023-07-17 12:12:42,877 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 12:12:42,877 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-17 12:12:42,878 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-17 12:12:42,878 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-17 12:12:42,880 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] procedure2.ProcedureExecutor(1029): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-17 12:12:42,882 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-17 12:12:42,884 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689596562884 2023-07-17 12:12:42,884 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-07-17 12:12:42,884 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-17 12:12:42,886 DEBUG [Listener at jenkins-hbase4.apache.org/44127] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-17 12:12:42,886 DEBUG [Listener at jenkins-hbase4.apache.org/44127] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-17 12:12:42,886 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-17 12:12:42,888 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-17 12:12:42,890 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 9 msec 2023-07-17 12:12:42,895 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-17 12:12:42,896 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=96, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689596562896 2023-07-17 12:12:42,983 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:42,983 INFO [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState' 2023-07-17 12:12:42,983 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 12:12:42,985 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-07-17 12:12:42,985 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-07-17 12:12:42,986 DEBUG [Listener at jenkins-hbase4.apache.org/44127] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 12:12:42,989 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:42,989 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:42,989 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-17 12:12:42,989 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-17 12:12:42,989 DEBUG [Listener at jenkins-hbase4.apache.org/44127] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-17 12:12:42,995 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:39491-0x10173314c9f0001, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 12:12:42,995 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:12:42,995 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 12:12:42,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 12:12:42,995 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:42615-0x10173314c9f0003, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 12:12:42,995 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 12:12:42,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 12:12:42,997 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:33685-0x10173314c9f0002, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 12:12:42,997 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 12:12:42,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 12:12:42,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:42,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:42,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:42,998 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:12:42,998 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:12:42,998 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39491-0x10173314c9f0001, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:42,998 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42615-0x10173314c9f0003, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:42,999 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:12:42,999 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-17 12:12:42,999 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33685-0x10173314c9f0002, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:42,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-17 12:12:42,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:42,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-17 12:12:42,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:42,999 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-17 12:12:42,999 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-17 12:12:42,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-17 12:12:42,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:42,999 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-17 12:12:43,002 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:43,003 DEBUG [member: 'jenkins-hbase4.apache.org,39491,1689595859788' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-17 12:12:43,003 DEBUG [member: 'jenkins-hbase4.apache.org,39491,1689595859788' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 12:12:43,011 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:43,013 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:43,014 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-17 12:12:43,014 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 12:12:43,013 DEBUG [member: 'jenkins-hbase4.apache.org,39491,1689595859788' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-17 12:12:43,014 DEBUG [member: 'jenkins-hbase4.apache.org,39491,1689595859788' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-17 12:12:43,016 DEBUG [member: 'jenkins-hbase4.apache.org,39491,1689595859788' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39491,1689595859788' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-17 12:12:43,018 DEBUG [member: 'jenkins-hbase4.apache.org,39491,1689595859788' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:43,018 DEBUG [member: 'jenkins-hbase4.apache.org,39491,1689595859788' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39491-0x10173314c9f0001, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:43,018 DEBUG [member: 'jenkins-hbase4.apache.org,39491,1689595859788' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 12:12:43,014 DEBUG [member: 'jenkins-hbase4.apache.org,33685,1689595859854' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-17 12:12:43,016 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-17 12:12:43,022 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-17 12:12:43,022 DEBUG [member: 'jenkins-hbase4.apache.org,33685,1689595859854' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 12:12:43,023 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42615,1689595859906' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-17 12:12:43,024 DEBUG [member: 'jenkins-hbase4.apache.org,33685,1689595859854' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-17 12:12:43,024 DEBUG [member: 'jenkins-hbase4.apache.org,33685,1689595859854' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-17 12:12:43,024 DEBUG [member: 'jenkins-hbase4.apache.org,33685,1689595859854' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33685,1689595859854' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-17 12:12:43,026 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:12:43,026 DEBUG [member: 'jenkins-hbase4.apache.org,33685,1689595859854' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:43,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:12:43,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 12:12:43,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 12:12:43,027 DEBUG [member: 'jenkins-hbase4.apache.org,33685,1689595859854' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33685-0x10173314c9f0002, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:43,027 DEBUG [member: 'jenkins-hbase4.apache.org,33685,1689595859854' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 12:12:43,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 12:12:43,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 12:12:43,028 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:12:43,028 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:43,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:43,029 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42615-0x10173314c9f0003, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:43,029 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 12:12:43,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:12:43,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:12:43,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:12:43,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 12:12:43,030 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33685,1689595859854' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-17 12:12:43,030 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7c24da17[Count = 1] remaining members to acquire global barrier 2023-07-17 12:12:43,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:12:43,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 12:12:43,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 12:12:43,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 12:12:43,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 12:12:43,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:43,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:12:43,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:12:43,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:12:43,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 12:12:43,034 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42615,1689595859906' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-17 12:12:43,034 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7c24da17[Count = 0] remaining members to acquire global barrier 2023-07-17 12:12:43,034 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-07-17 12:12:43,034 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:43,036 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:42615-0x10173314c9f0003, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:43,036 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:39491-0x10173314c9f0001, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:43,036 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:33685-0x10173314c9f0002, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:43,036 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:43,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:43,036 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:43,036 DEBUG [member: 'jenkins-hbase4.apache.org,39491,1689595859788' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-17 12:12:43,036 DEBUG [member: 'jenkins-hbase4.apache.org,39491,1689595859788' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-17 12:12:43,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:43,036 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:43,037 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-17 12:12:43,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:43,037 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:12:43,037 DEBUG [member: 'jenkins-hbase4.apache.org,39491,1689595859788' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,39491,1689595859788' in zk 2023-07-17 12:12:43,037 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-17 12:12:43,037 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-17 12:12:43,037 DEBUG [member: 'jenkins-hbase4.apache.org,33685,1689595859854' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-17 12:12:43,037 DEBUG [rs(jenkins-hbase4.apache.org,42615,1689595859906)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1689595962147.f349335016d00f26499a212280dc535c. 2023-07-17 12:12:43,037 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:12:43,037 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-17 12:12:43,037 DEBUG [rs(jenkins-hbase4.apache.org,42615,1689595859906)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689595962147.f349335016d00f26499a212280dc535c. started... 2023-07-17 12:12:43,038 DEBUG [rs(jenkins-hbase4.apache.org,42615,1689595859906)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for f349335016d00f26499a212280dc535c: 2023-07-17 12:12:43,038 DEBUG [rs(jenkins-hbase4.apache.org,42615,1689595859906)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1689595962147.f349335016d00f26499a212280dc535c.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:43,038 DEBUG [rs(jenkins-hbase4.apache.org,42615,1689595859906)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-17 12:12:43,038 DEBUG [rs(jenkins-hbase4.apache.org,42615,1689595859906)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-17 12:12:43,039 DEBUG [member: 'jenkins-hbase4.apache.org,39491,1689595859788' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-17 12:12:43,039 DEBUG [member: 'jenkins-hbase4.apache.org,39491,1689595859788' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 12:12:43,039 DEBUG [member: 'jenkins-hbase4.apache.org,39491,1689595859788' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-17 12:12:43,042 DEBUG [member: 'jenkins-hbase4.apache.org,33685,1689595859854' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-17 12:12:43,045 DEBUG [member: 'jenkins-hbase4.apache.org,33685,1689595859854' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-17 12:12:43,045 DEBUG [rs(jenkins-hbase4.apache.org,33685,1689595859854)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1689595962147.d610b9ff636d6929793263b2d7f98e7b. 2023-07-17 12:12:43,045 DEBUG [rs(jenkins-hbase4.apache.org,33685,1689595859854)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689595962147.d610b9ff636d6929793263b2d7f98e7b. started... 2023-07-17 12:12:43,068 DEBUG [rs(jenkins-hbase4.apache.org,33685,1689595859854)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for d610b9ff636d6929793263b2d7f98e7b: 2023-07-17 12:12:43,069 DEBUG [rs(jenkins-hbase4.apache.org,33685,1689595859854)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1689595962147.d610b9ff636d6929793263b2d7f98e7b.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:43,069 DEBUG [rs(jenkins-hbase4.apache.org,33685,1689595859854)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-17 12:12:43,069 DEBUG [rs(jenkins-hbase4.apache.org,33685,1689595859854)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-17 12:12:43,093 DEBUG [rs(jenkins-hbase4.apache.org,42615,1689595859906)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689595962147.f349335016d00f26499a212280dc535c. completed. 2023-07-17 12:12:43,093 DEBUG [rs(jenkins-hbase4.apache.org,42615,1689595859906)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1689595962147.f349335016d00f26499a212280dc535c. 2023-07-17 12:12:43,094 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-17 12:12:43,094 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-17 12:12:43,094 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:12:43,094 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-17 12:12:43,094 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,42615,1689595859906' in zk 2023-07-17 12:12:43,099 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-17 12:12:43,099 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:12:43,099 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 12:12:43,099 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-17 12:12:43,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:12:43,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 12:12:43,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 12:12:43,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 12:12:43,102 DEBUG [rs(jenkins-hbase4.apache.org,33685,1689595859854)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689595962147.d610b9ff636d6929793263b2d7f98e7b. completed. 2023-07-17 12:12:43,102 DEBUG [rs(jenkins-hbase4.apache.org,33685,1689595859854)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1689595962147.d610b9ff636d6929793263b2d7f98e7b. 2023-07-17 12:12:43,102 DEBUG [member: 'jenkins-hbase4.apache.org,33685,1689595859854' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-17 12:12:43,102 DEBUG [member: 'jenkins-hbase4.apache.org,33685,1689595859854' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-17 12:12:43,102 DEBUG [member: 'jenkins-hbase4.apache.org,33685,1689595859854' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:12:43,102 DEBUG [member: 'jenkins-hbase4.apache.org,33685,1689595859854' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-17 12:12:43,102 DEBUG [member: 'jenkins-hbase4.apache.org,33685,1689595859854' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,33685,1689595859854' in zk 2023-07-17 12:12:43,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 12:12:43,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:43,104 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:12:43,104 DEBUG [member: 'jenkins-hbase4.apache.org,33685,1689595859854' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-17 12:12:43,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:12:43,104 DEBUG [member: 'jenkins-hbase4.apache.org,33685,1689595859854' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 12:12:43,104 DEBUG [member: 'jenkins-hbase4.apache.org,33685,1689595859854' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-17 12:12:43,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:12:43,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:12:43,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 12:12:43,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:43,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:12:43,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:12:43,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:12:43,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,42615,1689595859906': 2023-07-17 12:12:43,111 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42615,1689595859906' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-17 12:12:43,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:12:43,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 12:12:43,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 12:12:43,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 12:12:43,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 12:12:43,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:43,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:12:43,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:12:43,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:12:43,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 12:12:43,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:43,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:12:43,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:12:43,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:12:43,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,33685,1689595859854': 2023-07-17 12:12:43,116 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33685,1689595859854' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-17 12:12:43,116 INFO [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' execution completed 2023-07-17 12:12:43,117 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-17 12:12:43,117 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-17 12:12:43,117 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:43,117 INFO [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-17 12:12:43,120 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:33685-0x10173314c9f0002, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:43,120 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:33685-0x10173314c9f0002, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 12:12:43,120 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:42615-0x10173314c9f0003, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:43,120 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:43,120 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:43,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:43,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 12:12:43,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 12:12:43,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:43,120 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:42615-0x10173314c9f0003, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 12:12:43,120 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:39491-0x10173314c9f0001, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:43,121 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:39491-0x10173314c9f0001, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 12:12:43,121 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:43,120 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:43,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:43,121 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 12:12:43,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:43,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 12:12:43,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 12:12:43,122 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:12:43,122 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 12:12:43,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 12:12:43,122 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 12:12:43,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:43,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 12:12:43,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:43,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:43,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:43,123 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:12:43,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 12:12:43,125 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:12:43,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:43,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:12:43,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:12:43,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:12:43,128 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:12:43,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 12:12:43,128 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:12:43,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:43,128 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:12:43,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:12:43,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:12:43,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:12:43,132 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:12:43,132 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:33685-0x10173314c9f0002, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 12:12:43,132 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:42615-0x10173314c9f0003, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 12:12:43,132 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:39491-0x10173314c9f0001, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 12:12:43,132 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 12:12:43,132 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 12:12:43,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 12:12:43,132 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:33685-0x10173314c9f0002, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 12:12:43,132 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 12:12:43,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 12:12:43,132 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 12:12:43,132 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:43,132 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:12:43,132 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:43,134 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 12:12:43,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 12:12:43,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 12:12:43,132 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:39491-0x10173314c9f0001, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 12:12:43,132 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:42615-0x10173314c9f0003, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 12:12:43,134 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 12:12:43,134 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-07-17 12:12:43,132 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:12:43,135 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:43,135 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:12:43,135 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:43,135 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:12:43,135 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:12:43,135 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:43,135 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 12:12:43,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 12:12:43,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 12:12:43,135 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:43,135 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:43,135 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-17 12:12:43,136 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-17 12:12:43,190 DEBUG [Listener at jenkins-hbase4.apache.org/44127] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 12:12:43,191 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-17 12:12:43,191 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-17 12:12:43,191 DEBUG [Listener at jenkins-hbase4.apache.org/44127] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-17 12:12:43,491 DEBUG [Listener at jenkins-hbase4.apache.org/44127] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 12:12:43,494 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-17 12:12:43,494 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-17 12:12:43,494 DEBUG [Listener at jenkins-hbase4.apache.org/44127] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-17 12:12:43,555 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:43,556 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:43,590 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:43,995 DEBUG [Listener at jenkins-hbase4.apache.org/44127] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 12:12:43,996 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-17 12:12:43,996 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-17 12:12:43,996 DEBUG [Listener at jenkins-hbase4.apache.org/44127] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-07-17 12:12:44,047 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-07-17 12:12:44,048 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:44,048 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:44,048 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1689595962884Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1689595963555 (+671 ms)Consolidate snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1689595963555Loading Region manifests for emptySnaptb0-testEmptyExportFileSystemState at 1689595963555Writing data manifest for emptySnaptb0-testEmptyExportFileSystemState at 1689595963563 (+8 ms)Verifying snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1689595963582 (+19 ms)Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1689595964047 (+465 ms) 2023-07-17 12:12:44,053 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=96, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-17 12:12:44,055 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=96, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 1.1670 sec 2023-07-17 12:12:44,526 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testEmptyExportFileSystemState' 2023-07-17 12:12:44,997 DEBUG [Listener at jenkins-hbase4.apache.org/44127] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 12:12:44,999 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-17 12:12:44,999 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-17 12:12:45,002 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42615] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,,1689595962147.f349335016d00f26499a212280dc535c. with WAL disabled. Data may be lost in the event of a crash. 2023-07-17 12:12:45,003 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33685] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,1,1689595962147.d610b9ff636d6929793263b2d7f98e7b. with WAL disabled. Data may be lost in the event of a crash. 2023-07-17 12:12:45,008 DEBUG [Listener at jenkins-hbase4.apache.org/44127] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-07-17 12:12:45,008 DEBUG [Listener at jenkins-hbase4.apache.org/44127] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1689595962147.f349335016d00f26499a212280dc535c. 2023-07-17 12:12:45,008 INFO [Listener at jenkins-hbase4.apache.org/44127] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-17 12:12:45,025 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-17 12:12:45,025 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689595965025 (current time:1689595965025). 2023-07-17 12:12:45,025 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-17 12:12:45,025 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] zookeeper.ReadOnlyZKClient(139): Connect 0x4a89f631 to 127.0.0.1:55622 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-17 12:12:45,051 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6fcc58fd, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-17 12:12:45,052 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 12:12:45,064 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37520, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 12:12:45,065 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4a89f631 to 127.0.0.1:55622 2023-07-17 12:12:45,066 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 12:12:45,066 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] zookeeper.ReadOnlyZKClient(139): Connect 0x3ed85d46 to 127.0.0.1:55622 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-17 12:12:45,098 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3be50cd2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-17 12:12:45,104 DEBUG [hconnection-0x36e3a0e3-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 12:12:45,105 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37534, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 12:12:45,119 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 12:12:45,120 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58874, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 12:12:45,125 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3ed85d46 to 127.0.0.1:55622 2023-07-17 12:12:45,126 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 12:12:45,126 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-17 12:12:45,127 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-17 12:12:45,127 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-17 12:12:45,130 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] procedure2.ProcedureExecutor(1029): Stored pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-17 12:12:45,132 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-17 12:12:45,133 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=97, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689596565133 2023-07-17 12:12:45,133 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-17 12:12:45,133 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-07-17 12:12:45,134 DEBUG [Listener at jenkins-hbase4.apache.org/44127] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-17 12:12:45,134 DEBUG [Listener at jenkins-hbase4.apache.org/44127] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-17 12:12:45,139 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=97, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-17 12:12:45,141 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=97, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 10 msec 2023-07-17 12:12:45,143 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-17 12:12:45,144 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-17 12:12:45,150 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=98, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689596565150 2023-07-17 12:12:45,234 DEBUG [Listener at jenkins-hbase4.apache.org/44127] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 12:12:45,235 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-17 12:12:45,236 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-17 12:12:45,236 DEBUG [Listener at jenkins-hbase4.apache.org/44127] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-17 12:12:45,255 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:45,255 INFO [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testEmptyExportFileSystemState' 2023-07-17 12:12:45,255 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 12:12:45,255 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-07-17 12:12:45,255 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-07-17 12:12:45,255 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:45,256 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:45,258 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:39491-0x10173314c9f0001, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 12:12:45,258 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:42615-0x10173314c9f0003, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 12:12:45,259 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 12:12:45,259 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:12:45,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 12:12:45,259 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 12:12:45,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 12:12:45,259 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:33685-0x10173314c9f0002, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 12:12:45,259 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 12:12:45,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 12:12:45,259 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:12:45,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:45,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:45,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:45,260 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42615-0x10173314c9f0003, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:45,259 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:12:45,260 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39491-0x10173314c9f0001, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:45,260 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33685-0x10173314c9f0002, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:45,261 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:12:45,261 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-17 12:12:45,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-17 12:12:45,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:45,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-17 12:12:45,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:45,261 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-17 12:12:45,261 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-17 12:12:45,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-17 12:12:45,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:45,262 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-17 12:12:45,262 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:45,262 DEBUG [member: 'jenkins-hbase4.apache.org,39491,1689595859788' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-17 12:12:45,262 DEBUG [member: 'jenkins-hbase4.apache.org,39491,1689595859788' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 12:12:45,262 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:45,264 DEBUG [member: 'jenkins-hbase4.apache.org,39491,1689595859788' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-17 12:12:45,264 DEBUG [member: 'jenkins-hbase4.apache.org,39491,1689595859788' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-17 12:12:45,264 DEBUG [member: 'jenkins-hbase4.apache.org,39491,1689595859788' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39491,1689595859788' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-17 12:12:45,266 DEBUG [member: 'jenkins-hbase4.apache.org,39491,1689595859788' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:45,266 DEBUG [member: 'jenkins-hbase4.apache.org,39491,1689595859788' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39491-0x10173314c9f0001, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:45,266 DEBUG [member: 'jenkins-hbase4.apache.org,39491,1689595859788' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 12:12:45,270 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:45,271 DEBUG [member: 'jenkins-hbase4.apache.org,33685,1689595859854' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-17 12:12:45,271 DEBUG [member: 'jenkins-hbase4.apache.org,33685,1689595859854' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 12:12:45,272 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-17 12:12:45,272 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 12:12:45,279 DEBUG [member: 'jenkins-hbase4.apache.org,33685,1689595859854' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-17 12:12:45,279 DEBUG [member: 'jenkins-hbase4.apache.org,33685,1689595859854' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-17 12:12:45,279 DEBUG [member: 'jenkins-hbase4.apache.org,33685,1689595859854' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33685,1689595859854' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-17 12:12:45,279 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-17 12:12:45,279 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-17 12:12:45,279 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42615,1689595859906' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-17 12:12:45,282 DEBUG [member: 'jenkins-hbase4.apache.org,33685,1689595859854' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:45,282 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:12:45,282 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:12:45,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:12:45,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 12:12:45,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 12:12:45,287 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:45,287 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42615-0x10173314c9f0003, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:45,287 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 12:12:45,291 DEBUG [member: 'jenkins-hbase4.apache.org,33685,1689595859854' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33685-0x10173314c9f0002, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:45,291 DEBUG [member: 'jenkins-hbase4.apache.org,33685,1689595859854' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 12:12:45,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 12:12:45,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 12:12:45,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:45,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:12:45,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:12:45,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:12:45,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 12:12:45,299 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33685,1689595859854' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-17 12:12:45,299 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@102140a5[Count = 1] remaining members to acquire global barrier 2023-07-17 12:12:45,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:12:45,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 12:12:45,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 12:12:45,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 12:12:45,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 12:12:45,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:45,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:12:45,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:12:45,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:12:45,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 12:12:45,308 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42615,1689595859906' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-17 12:12:45,309 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@102140a5[Count = 0] remaining members to acquire global barrier 2023-07-17 12:12:45,309 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-07-17 12:12:45,309 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:45,313 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:39491-0x10173314c9f0001, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:45,314 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:33685-0x10173314c9f0002, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:45,314 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:42615-0x10173314c9f0003, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:45,314 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:45,314 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:45,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:45,314 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:45,314 DEBUG [member: 'jenkins-hbase4.apache.org,33685,1689595859854' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-17 12:12:45,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:45,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:45,314 DEBUG [member: 'jenkins-hbase4.apache.org,39491,1689595859788' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-17 12:12:45,314 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-17 12:12:45,314 DEBUG [member: 'jenkins-hbase4.apache.org,39491,1689595859788' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-17 12:12:45,314 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:12:45,314 DEBUG [member: 'jenkins-hbase4.apache.org,33685,1689595859854' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-17 12:12:45,314 DEBUG [member: 'jenkins-hbase4.apache.org,33685,1689595859854' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-17 12:12:45,314 DEBUG [member: 'jenkins-hbase4.apache.org,39491,1689595859788' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,39491,1689595859788' in zk 2023-07-17 12:12:45,314 DEBUG [rs(jenkins-hbase4.apache.org,33685,1689595859854)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1689595962147.d610b9ff636d6929793263b2d7f98e7b. 2023-07-17 12:12:45,315 DEBUG [rs(jenkins-hbase4.apache.org,33685,1689595859854)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689595962147.d610b9ff636d6929793263b2d7f98e7b. started... 2023-07-17 12:12:45,315 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:12:45,315 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-17 12:12:45,315 INFO [rs(jenkins-hbase4.apache.org,33685,1689595859854)-snapshot-pool-0] regionserver.HRegion(2745): Flushing d610b9ff636d6929793263b2d7f98e7b 1/1 column families, dataSize=3.19 KB heapSize=7.14 KB 2023-07-17 12:12:45,316 DEBUG [member: 'jenkins-hbase4.apache.org,39491,1689595859788' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-17 12:12:45,316 DEBUG [member: 'jenkins-hbase4.apache.org,39491,1689595859788' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 12:12:45,316 DEBUG [member: 'jenkins-hbase4.apache.org,39491,1689595859788' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-17 12:12:45,320 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-17 12:12:45,320 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-17 12:12:45,320 DEBUG [rs(jenkins-hbase4.apache.org,42615,1689595859906)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1689595962147.f349335016d00f26499a212280dc535c. 2023-07-17 12:12:45,320 DEBUG [rs(jenkins-hbase4.apache.org,42615,1689595859906)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689595962147.f349335016d00f26499a212280dc535c. started... 2023-07-17 12:12:45,321 INFO [rs(jenkins-hbase4.apache.org,42615,1689595859906)-snapshot-pool-0] regionserver.HRegion(2745): Flushing f349335016d00f26499a212280dc535c 1/1 column families, dataSize=65 B heapSize=400 B 2023-07-17 12:12:45,401 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689595867847_0005_000001 (auth:SIMPLE) 2023-07-17 12:12:45,436 DEBUG [Listener at jenkins-hbase4.apache.org/44127] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 12:12:45,441 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-17 12:12:45,441 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-17 12:12:45,441 DEBUG [Listener at jenkins-hbase4.apache.org/44127] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-17 12:12:45,442 INFO [rs(jenkins-hbase4.apache.org,42615,1689595859906)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023071725b88645fdfe4daeb3c50a171c2b4bfe to hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e2023071725b88645fdfe4daeb3c50a171c2b4bfe 2023-07-17 12:12:45,453 INFO [rs(jenkins-hbase4.apache.org,42615,1689595859906)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=65, hasBloomFilter=true, into tmp file hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/default/testtb-testEmptyExportFileSystemState/f349335016d00f26499a212280dc535c/.tmp/cf/25b66c4574b94fe19f1817771a4aa502 2023-07-17 12:12:45,458 DEBUG [rs(jenkins-hbase4.apache.org,42615,1689595859906)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/default/testtb-testEmptyExportFileSystemState/f349335016d00f26499a212280dc535c/.tmp/cf/25b66c4574b94fe19f1817771a4aa502 as hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/default/testtb-testEmptyExportFileSystemState/f349335016d00f26499a212280dc535c/cf/25b66c4574b94fe19f1817771a4aa502 2023-07-17 12:12:45,463 INFO [rs(jenkins-hbase4.apache.org,42615,1689595859906)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/default/testtb-testEmptyExportFileSystemState/f349335016d00f26499a212280dc535c/cf/25b66c4574b94fe19f1817771a4aa502, entries=1, sequenceid=6, filesize=5.1 K 2023-07-17 12:12:45,464 INFO [rs(jenkins-hbase4.apache.org,42615,1689595859906)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~65 B/65, heapSize ~384 B/384, currentSize=0 B/0 for f349335016d00f26499a212280dc535c in 143ms, sequenceid=6, compaction requested=false 2023-07-17 12:12:45,466 DEBUG [rs(jenkins-hbase4.apache.org,42615,1689595859906)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for f349335016d00f26499a212280dc535c: 2023-07-17 12:12:45,467 DEBUG [rs(jenkins-hbase4.apache.org,42615,1689595859906)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1689595962147.f349335016d00f26499a212280dc535c.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:45,468 DEBUG [rs(jenkins-hbase4.apache.org,42615,1689595859906)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-17 12:12:45,468 DEBUG [rs(jenkins-hbase4.apache.org,42615,1689595859906)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/default/testtb-testEmptyExportFileSystemState/f349335016d00f26499a212280dc535c/cf/25b66c4574b94fe19f1817771a4aa502] hfiles 2023-07-17 12:12:45,468 DEBUG [rs(jenkins-hbase4.apache.org,42615,1689595859906)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/default/testtb-testEmptyExportFileSystemState/f349335016d00f26499a212280dc535c/cf/25b66c4574b94fe19f1817771a4aa502 for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:45,480 DEBUG [rs(jenkins-hbase4.apache.org,42615,1689595859906)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689595962147.f349335016d00f26499a212280dc535c. completed. 2023-07-17 12:12:45,480 DEBUG [rs(jenkins-hbase4.apache.org,42615,1689595859906)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1689595962147.f349335016d00f26499a212280dc535c. 2023-07-17 12:12:45,480 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-17 12:12:45,480 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-17 12:12:45,480 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:12:45,480 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-17 12:12:45,480 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,42615,1689595859906' in zk 2023-07-17 12:12:45,483 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:12:45,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:12:45,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 12:12:45,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 12:12:45,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 12:12:45,484 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-17 12:12:45,484 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 12:12:45,484 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-17 12:12:45,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 12:12:45,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:45,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:12:45,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:12:45,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:12:45,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 12:12:45,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:45,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:12:45,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:12:45,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,42615,1689595859906': 2023-07-17 12:12:45,489 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42615,1689595859906' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-17 12:12:45,741 DEBUG [Listener at jenkins-hbase4.apache.org/44127] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 12:12:45,743 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-17 12:12:45,743 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-17 12:12:45,744 DEBUG [Listener at jenkins-hbase4.apache.org/44127] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-17 12:12:45,813 INFO [rs(jenkins-hbase4.apache.org,33685,1689595859854)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023071795b317e1031a4e76a8a76ffaf632d420 to hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b2023071795b317e1031a4e76a8a76ffaf632d420 2023-07-17 12:12:45,889 INFO [rs(jenkins-hbase4.apache.org,33685,1689595859854)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.2 K, hasBloomFilter=true, into tmp file hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/default/testtb-testEmptyExportFileSystemState/d610b9ff636d6929793263b2d7f98e7b/.tmp/cf/172ed957ccb744adb0330fb52d0dff42 2023-07-17 12:12:45,896 DEBUG [rs(jenkins-hbase4.apache.org,33685,1689595859854)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/default/testtb-testEmptyExportFileSystemState/d610b9ff636d6929793263b2d7f98e7b/.tmp/cf/172ed957ccb744adb0330fb52d0dff42 as hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/default/testtb-testEmptyExportFileSystemState/d610b9ff636d6929793263b2d7f98e7b/cf/172ed957ccb744adb0330fb52d0dff42 2023-07-17 12:12:45,906 INFO [rs(jenkins-hbase4.apache.org,33685,1689595859854)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/default/testtb-testEmptyExportFileSystemState/d610b9ff636d6929793263b2d7f98e7b/cf/172ed957ccb744adb0330fb52d0dff42, entries=49, sequenceid=6, filesize=13.4 K 2023-07-17 12:12:45,907 INFO [rs(jenkins-hbase4.apache.org,33685,1689595859854)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.19 KB/3271, heapSize ~7.13 KB/7296, currentSize=0 B/0 for d610b9ff636d6929793263b2d7f98e7b in 592ms, sequenceid=6, compaction requested=false 2023-07-17 12:12:45,907 DEBUG [rs(jenkins-hbase4.apache.org,33685,1689595859854)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for d610b9ff636d6929793263b2d7f98e7b: 2023-07-17 12:12:45,907 DEBUG [rs(jenkins-hbase4.apache.org,33685,1689595859854)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1689595962147.d610b9ff636d6929793263b2d7f98e7b.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:45,907 DEBUG [rs(jenkins-hbase4.apache.org,33685,1689595859854)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-17 12:12:45,907 DEBUG [rs(jenkins-hbase4.apache.org,33685,1689595859854)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/default/testtb-testEmptyExportFileSystemState/d610b9ff636d6929793263b2d7f98e7b/cf/172ed957ccb744adb0330fb52d0dff42] hfiles 2023-07-17 12:12:45,907 DEBUG [rs(jenkins-hbase4.apache.org,33685,1689595859854)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/default/testtb-testEmptyExportFileSystemState/d610b9ff636d6929793263b2d7f98e7b/cf/172ed957ccb744adb0330fb52d0dff42 for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:45,939 DEBUG [rs(jenkins-hbase4.apache.org,33685,1689595859854)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689595962147.d610b9ff636d6929793263b2d7f98e7b. completed. 2023-07-17 12:12:45,939 DEBUG [rs(jenkins-hbase4.apache.org,33685,1689595859854)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1689595962147.d610b9ff636d6929793263b2d7f98e7b. 2023-07-17 12:12:45,940 DEBUG [member: 'jenkins-hbase4.apache.org,33685,1689595859854' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-17 12:12:45,940 DEBUG [member: 'jenkins-hbase4.apache.org,33685,1689595859854' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-17 12:12:45,940 DEBUG [member: 'jenkins-hbase4.apache.org,33685,1689595859854' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:12:45,940 DEBUG [member: 'jenkins-hbase4.apache.org,33685,1689595859854' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-17 12:12:45,940 DEBUG [member: 'jenkins-hbase4.apache.org,33685,1689595859854' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,33685,1689595859854' in zk 2023-07-17 12:12:45,942 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:12:45,942 DEBUG [member: 'jenkins-hbase4.apache.org,33685,1689595859854' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-17 12:12:45,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:12:45,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 12:12:45,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 12:12:45,942 DEBUG [member: 'jenkins-hbase4.apache.org,33685,1689595859854' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 12:12:45,942 DEBUG [member: 'jenkins-hbase4.apache.org,33685,1689595859854' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-17 12:12:45,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 12:12:45,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 12:12:45,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:45,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:12:45,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:12:45,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:12:45,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 12:12:45,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:45,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:12:45,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:12:45,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:12:45,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,33685,1689595859854': 2023-07-17 12:12:45,952 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33685,1689595859854' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-17 12:12:45,952 INFO [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testEmptyExportFileSystemState' execution completed 2023-07-17 12:12:45,953 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-17 12:12:45,953 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-17 12:12:45,953 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:45,953 INFO [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-17 12:12:45,954 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:45,954 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:33685-0x10173314c9f0002, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:45,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:45,955 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:33685-0x10173314c9f0002, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 12:12:45,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 12:12:45,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 12:12:45,955 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:45,955 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:39491-0x10173314c9f0001, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:45,955 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:42615-0x10173314c9f0003, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:45,955 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:45,955 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:39491-0x10173314c9f0001, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 12:12:45,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:45,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:45,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 12:12:45,955 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:45,955 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:42615-0x10173314c9f0003, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 12:12:45,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:45,955 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:12:45,956 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 12:12:45,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 12:12:45,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:45,956 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 12:12:45,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 12:12:45,956 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 12:12:45,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 12:12:45,956 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:12:45,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:45,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:45,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 12:12:45,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:45,956 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:12:45,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:45,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:12:45,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:12:45,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:12:45,958 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:12:45,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 12:12:45,959 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:12:45,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:45,959 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:12:45,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:12:45,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:12:45,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:12:45,962 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:12:45,962 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:33685-0x10173314c9f0002, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 12:12:45,962 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:45,962 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 12:12:45,962 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:42615-0x10173314c9f0003, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 12:12:45,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 12:12:45,962 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:12:45,962 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 12:12:45,962 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:42615-0x10173314c9f0003, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 12:12:45,962 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:45,964 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-07-17 12:12:45,962 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:12:45,964 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:45,964 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-17 12:12:45,964 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:45,964 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:12:45,964 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:33685-0x10173314c9f0002, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 12:12:45,964 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 12:12:45,964 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:39491-0x10173314c9f0001, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 12:12:45,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 12:12:45,965 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 12:12:45,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 12:12:45,964 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:45,965 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:12:45,965 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:12:45,965 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:45,965 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:45,965 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 12:12:45,965 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b2023071795b317e1031a4e76a8a76ffaf632d420, hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e2023071725b88645fdfe4daeb3c50a171c2b4bfe] mob files 2023-07-17 12:12:45,965 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:39491-0x10173314c9f0001, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 12:12:45,965 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b2023071795b317e1031a4e76a8a76ffaf632d420 2023-07-17 12:12:45,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 12:12:45,965 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e2023071725b88645fdfe4daeb3c50a171c2b4bfe 2023-07-17 12:12:45,965 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 12:12:45,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 12:12:45,966 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 12:12:45,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 12:12:45,981 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:45,984 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:46,122 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState to hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.hbase-snapshot/snaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:46,166 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-07-17 12:12:46,166 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:46,166 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:46,167 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1689595965134Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1689595965981 (+847 ms)Consolidate snapshot: snaptb0-testEmptyExportFileSystemState at 1689595965981Loading Region manifests for snaptb0-testEmptyExportFileSystemState at 1689595965981Writing data manifest for snaptb0-testEmptyExportFileSystemState at 1689595965996 (+15 ms)Verifying snapshot: snaptb0-testEmptyExportFileSystemState at 1689595966088 (+92 ms)Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1689595966166 (+78 ms) 2023-07-17 12:12:46,172 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=98, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-17 12:12:46,175 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=98, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 1.0340 sec 2023-07-17 12:12:46,244 DEBUG [Listener at jenkins-hbase4.apache.org/44127] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 12:12:46,245 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-17 12:12:46,245 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-17 12:12:46,246 INFO [Listener at jenkins-hbase4.apache.org/44127] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/export-test/export-1689595966246 2023-07-17 12:12:46,246 INFO [Listener at jenkins-hbase4.apache.org/44127] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:46215, tgtDir=hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/export-test/export-1689595966246, rawTgtDir=hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/export-test/export-1689595966246, srcFsUri=hdfs://localhost:46215, srcDir=hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b 2023-07-17 12:12:46,277 DEBUG [Listener at jenkins-hbase4.apache.org/44127] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:46215, inputRoot=hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b 2023-07-17 12:12:46,278 DEBUG [Listener at jenkins-hbase4.apache.org/44127] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1367290763_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/export-test/export-1689595966246, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/export-test/export-1689595966246/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:46,279 INFO [Listener at jenkins-hbase4.apache.org/44127] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:46215, inputRoot=hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b, snapshotDir=hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState. 2023-07-17 12:12:46,298 INFO [Listener at jenkins-hbase4.apache.org/44127] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/export-test/export-1689595966246/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:46,362 DEBUG [Listener at jenkins-hbase4.apache.org/44127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-17 12:12:46,362 DEBUG [Listener at jenkins-hbase4.apache.org/44127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-17 12:12:46,363 DEBUG [Listener at jenkins-hbase4.apache.org/44127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-17 12:12:46,363 DEBUG [Listener at jenkins-hbase4.apache.org/44127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-17 12:12:46,364 DEBUG [Listener at jenkins-hbase4.apache.org/44127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-17 12:12:46,364 DEBUG [Listener at jenkins-hbase4.apache.org/44127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-17 12:12:46,364 DEBUG [Listener at jenkins-hbase4.apache.org/44127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-17 12:12:46,452 DEBUG [Listener at jenkins-hbase4.apache.org/44127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58af5705-0594-af5f-981c-fa1d3b267fab/hadoop-3342738932473156284.jar 2023-07-17 12:12:46,452 DEBUG [Listener at jenkins-hbase4.apache.org/44127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-17 12:12:46,453 DEBUG [Listener at jenkins-hbase4.apache.org/44127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-17 12:12:46,453 DEBUG [Listener at jenkins-hbase4.apache.org/44127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-17 12:12:46,454 DEBUG [Listener at jenkins-hbase4.apache.org/44127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-17 12:12:46,454 DEBUG [Listener at jenkins-hbase4.apache.org/44127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-17 12:12:46,455 DEBUG [Listener at jenkins-hbase4.apache.org/44127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-17 12:12:46,455 DEBUG [Listener at jenkins-hbase4.apache.org/44127] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-17 12:12:46,456 DEBUG [Listener at jenkins-hbase4.apache.org/44127] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-17 12:12:46,457 DEBUG [Listener at jenkins-hbase4.apache.org/44127] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-17 12:12:46,457 DEBUG [Listener at jenkins-hbase4.apache.org/44127] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-17 12:12:46,458 DEBUG [Listener at jenkins-hbase4.apache.org/44127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-17 12:12:46,458 DEBUG [Listener at jenkins-hbase4.apache.org/44127] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-17 12:12:46,459 DEBUG [Listener at jenkins-hbase4.apache.org/44127] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-17 12:12:46,460 DEBUG [Listener at jenkins-hbase4.apache.org/44127] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-17 12:12:46,460 DEBUG [Listener at jenkins-hbase4.apache.org/44127] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-17 12:12:46,461 DEBUG [Listener at jenkins-hbase4.apache.org/44127] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-17 12:12:46,462 DEBUG [Listener at jenkins-hbase4.apache.org/44127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-17 12:12:46,462 DEBUG [Listener at jenkins-hbase4.apache.org/44127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-17 12:12:46,463 DEBUG [Listener at jenkins-hbase4.apache.org/44127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-17 12:12:46,463 DEBUG [Listener at jenkins-hbase4.apache.org/44127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-17 12:12:46,463 DEBUG [Listener at jenkins-hbase4.apache.org/44127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-17 12:12:46,464 DEBUG [Listener at jenkins-hbase4.apache.org/44127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-17 12:12:46,465 DEBUG [Listener at jenkins-hbase4.apache.org/44127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-17 12:12:47,001 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-17 12:12:47,658 WARN [Listener at jenkins-hbase4.apache.org/44127] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-17 12:12:47,663 INFO [Listener at jenkins-hbase4.apache.org/44127] snapshot.ExportSnapshot(578): Loading Snapshot 'emptySnaptb0-testEmptyExportFileSystemState' hfile list 2023-07-17 12:12:47,833 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-17 12:12:47,833 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-17 12:12:48,392 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689595867847_0006_000001 (auth:SIMPLE) 2023-07-17 12:12:54,261 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689595867847_0006_000001 (auth:SIMPLE) 2023-07-17 12:12:56,979 INFO [Listener at jenkins-hbase4.apache.org/44127] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-17 12:12:56,980 INFO [Listener at jenkins-hbase4.apache.org/44127] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-17 12:12:56,986 INFO [Listener at jenkins-hbase4.apache.org/44127] snapshot.ExportSnapshot(1127): Export Completed: emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:56,986 INFO [Listener at jenkins-hbase4.apache.org/44127] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-17 12:12:56,987 INFO [Listener at jenkins-hbase4.apache.org/44127] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-17 12:12:56,987 DEBUG [Listener at jenkins-hbase4.apache.org/44127] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1847813108_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:56,987 DEBUG [Listener at jenkins-hbase4.apache.org/44127] snapshot.TestExportSnapshot(367): hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-07-17 12:12:56,987 DEBUG [Listener at jenkins-hbase4.apache.org/44127] snapshot.TestExportSnapshot(367): hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-07-17 12:12:56,988 DEBUG [Listener at jenkins-hbase4.apache.org/44127] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1847813108_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/export-test/export-1689595966246/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/export-test/export-1689595966246/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:56,988 DEBUG [Listener at jenkins-hbase4.apache.org/44127] snapshot.TestExportSnapshot(367): hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/export-test/export-1689595966246/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-07-17 12:12:56,988 DEBUG [Listener at jenkins-hbase4.apache.org/44127] snapshot.TestExportSnapshot(367): hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/export-test/export-1689595966246/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-07-17 12:12:56,996 INFO [Listener at jenkins-hbase4.apache.org/44127] client.HBaseAdmin$15(890): Started disable of testtb-testEmptyExportFileSystemState 2023-07-17 12:12:56,996 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testEmptyExportFileSystemState 2023-07-17 12:12:56,998 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] procedure2.ProcedureExecutor(1029): Stored pid=99, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-17 12:12:57,001 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-17 12:12:57,002 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689595977002"}]},"ts":"1689595977002"} 2023-07-17 12:12:57,003 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLING in hbase:meta 2023-07-17 12:12:57,005 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testEmptyExportFileSystemState to state=DISABLING 2023-07-17 12:12:57,006 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=f349335016d00f26499a212280dc535c, UNASSIGN}, {pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=d610b9ff636d6929793263b2d7f98e7b, UNASSIGN}] 2023-07-17 12:12:57,008 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=d610b9ff636d6929793263b2d7f98e7b, UNASSIGN 2023-07-17 12:12:57,008 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=f349335016d00f26499a212280dc535c, UNASSIGN 2023-07-17 12:12:57,009 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=f349335016d00f26499a212280dc535c, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:12:57,009 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=d610b9ff636d6929793263b2d7f98e7b, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:12:57,009 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1689595962147.f349335016d00f26499a212280dc535c.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689595977009"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689595977009"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689595977009"}]},"ts":"1689595977009"} 2023-07-17 12:12:57,009 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1689595962147.d610b9ff636d6929793263b2d7f98e7b.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689595977009"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689595977009"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689595977009"}]},"ts":"1689595977009"} 2023-07-17 12:12:57,011 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=102, ppid=100, state=RUNNABLE; CloseRegionProcedure f349335016d00f26499a212280dc535c, server=jenkins-hbase4.apache.org,42615,1689595859906}] 2023-07-17 12:12:57,012 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=103, ppid=101, state=RUNNABLE; CloseRegionProcedure d610b9ff636d6929793263b2d7f98e7b, server=jenkins-hbase4.apache.org,33685,1689595859854}] 2023-07-17 12:12:57,103 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-17 12:12:57,163 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close f349335016d00f26499a212280dc535c 2023-07-17 12:12:57,163 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing f349335016d00f26499a212280dc535c, disabling compactions & flushes 2023-07-17 12:12:57,163 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1689595962147.f349335016d00f26499a212280dc535c. 2023-07-17 12:12:57,164 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1689595962147.f349335016d00f26499a212280dc535c. 2023-07-17 12:12:57,164 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1689595962147.f349335016d00f26499a212280dc535c. after waiting 0 ms 2023-07-17 12:12:57,164 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1689595962147.f349335016d00f26499a212280dc535c. 2023-07-17 12:12:57,164 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close d610b9ff636d6929793263b2d7f98e7b 2023-07-17 12:12:57,164 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing d610b9ff636d6929793263b2d7f98e7b, disabling compactions & flushes 2023-07-17 12:12:57,164 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1689595962147.d610b9ff636d6929793263b2d7f98e7b. 2023-07-17 12:12:57,164 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1689595962147.d610b9ff636d6929793263b2d7f98e7b. 2023-07-17 12:12:57,164 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1689595962147.d610b9ff636d6929793263b2d7f98e7b. after waiting 0 ms 2023-07-17 12:12:57,164 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1689595962147.d610b9ff636d6929793263b2d7f98e7b. 2023-07-17 12:12:57,185 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/default/testtb-testEmptyExportFileSystemState/f349335016d00f26499a212280dc535c/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-17 12:12:57,185 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/default/testtb-testEmptyExportFileSystemState/d610b9ff636d6929793263b2d7f98e7b/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-17 12:12:57,186 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-17 12:12:57,186 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-17 12:12:57,187 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1689595962147.f349335016d00f26499a212280dc535c. 2023-07-17 12:12:57,188 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for f349335016d00f26499a212280dc535c: 2023-07-17 12:12:57,188 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1689595962147.d610b9ff636d6929793263b2d7f98e7b. 2023-07-17 12:12:57,188 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for d610b9ff636d6929793263b2d7f98e7b: 2023-07-17 12:12:57,189 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed f349335016d00f26499a212280dc535c 2023-07-17 12:12:57,191 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=f349335016d00f26499a212280dc535c, regionState=CLOSED 2023-07-17 12:12:57,191 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1689595962147.f349335016d00f26499a212280dc535c.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689595977191"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689595977191"}]},"ts":"1689595977191"} 2023-07-17 12:12:57,191 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed d610b9ff636d6929793263b2d7f98e7b 2023-07-17 12:12:57,192 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=d610b9ff636d6929793263b2d7f98e7b, regionState=CLOSED 2023-07-17 12:12:57,192 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1689595962147.d610b9ff636d6929793263b2d7f98e7b.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689595977192"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689595977192"}]},"ts":"1689595977192"} 2023-07-17 12:12:57,201 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=102, resume processing ppid=100 2023-07-17 12:12:57,201 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=102, ppid=100, state=SUCCESS; CloseRegionProcedure f349335016d00f26499a212280dc535c, server=jenkins-hbase4.apache.org,42615,1689595859906 in 188 msec 2023-07-17 12:12:57,201 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=103, resume processing ppid=101 2023-07-17 12:12:57,201 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=103, ppid=101, state=SUCCESS; CloseRegionProcedure d610b9ff636d6929793263b2d7f98e7b, server=jenkins-hbase4.apache.org,33685,1689595859854 in 189 msec 2023-07-17 12:12:57,204 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=100, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=f349335016d00f26499a212280dc535c, UNASSIGN in 196 msec 2023-07-17 12:12:57,205 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=101, resume processing ppid=99 2023-07-17 12:12:57,205 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=101, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=d610b9ff636d6929793263b2d7f98e7b, UNASSIGN in 196 msec 2023-07-17 12:12:57,206 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689595977205"}]},"ts":"1689595977205"} 2023-07-17 12:12:57,207 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLED in hbase:meta 2023-07-17 12:12:57,209 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testEmptyExportFileSystemState to state=DISABLED 2023-07-17 12:12:57,217 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=99, state=SUCCESS; DisableTableProcedure table=testtb-testEmptyExportFileSystemState in 213 msec 2023-07-17 12:12:57,304 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-17 12:12:57,304 INFO [Listener at jenkins-hbase4.apache.org/44127] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 99 completed 2023-07-17 12:12:57,305 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testEmptyExportFileSystemState 2023-07-17 12:12:57,306 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] procedure2.ProcedureExecutor(1029): Stored pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-17 12:12:57,309 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-17 12:12:57,309 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] access.PermissionStorage(259): Removing permissions of removed table testtb-testEmptyExportFileSystemState 2023-07-17 12:12:57,310 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=104, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-17 12:12:57,311 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39491] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testEmptyExportFileSystemState 2023-07-17 12:12:57,314 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-17 12:12:57,314 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:33685-0x10173314c9f0002, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-17 12:12:57,314 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:39491-0x10173314c9f0001, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-17 12:12:57,314 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:42615-0x10173314c9f0003, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-17 12:12:57,314 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-17 12:12:57,314 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-17 12:12:57,314 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.tmp/data/default/testtb-testEmptyExportFileSystemState/d610b9ff636d6929793263b2d7f98e7b 2023-07-17 12:12:57,314 DEBUG [HFileArchiver-21] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.tmp/data/default/testtb-testEmptyExportFileSystemState/f349335016d00f26499a212280dc535c 2023-07-17 12:12:57,314 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-17 12:12:57,315 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-17 12:12:57,317 DEBUG [HFileArchiver-19] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.tmp/data/default/testtb-testEmptyExportFileSystemState/d610b9ff636d6929793263b2d7f98e7b/cf, FileablePath, hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.tmp/data/default/testtb-testEmptyExportFileSystemState/d610b9ff636d6929793263b2d7f98e7b/recovered.edits] 2023-07-17 12:12:57,317 DEBUG [HFileArchiver-21] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.tmp/data/default/testtb-testEmptyExportFileSystemState/f349335016d00f26499a212280dc535c/cf, FileablePath, hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.tmp/data/default/testtb-testEmptyExportFileSystemState/f349335016d00f26499a212280dc535c/recovered.edits] 2023-07-17 12:12:57,317 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-17 12:12:57,317 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:42615-0x10173314c9f0003, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-17 12:12:57,317 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:39491-0x10173314c9f0001, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-17 12:12:57,317 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:42615-0x10173314c9f0003, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 12:12:57,317 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 12:12:57,318 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:33685-0x10173314c9f0002, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-17 12:12:57,317 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:39491-0x10173314c9f0001, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 12:12:57,318 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:33685-0x10173314c9f0002, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 12:12:57,318 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-17 12:12:57,335 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.tmp/data/default/testtb-testEmptyExportFileSystemState/d610b9ff636d6929793263b2d7f98e7b/cf/172ed957ccb744adb0330fb52d0dff42 to hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/archive/data/default/testtb-testEmptyExportFileSystemState/d610b9ff636d6929793263b2d7f98e7b/cf/172ed957ccb744adb0330fb52d0dff42 2023-07-17 12:12:57,336 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.tmp/data/default/testtb-testEmptyExportFileSystemState/f349335016d00f26499a212280dc535c/cf/25b66c4574b94fe19f1817771a4aa502 to hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/archive/data/default/testtb-testEmptyExportFileSystemState/f349335016d00f26499a212280dc535c/cf/25b66c4574b94fe19f1817771a4aa502 2023-07-17 12:12:57,339 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.tmp/data/default/testtb-testEmptyExportFileSystemState/d610b9ff636d6929793263b2d7f98e7b/recovered.edits/9.seqid to hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/archive/data/default/testtb-testEmptyExportFileSystemState/d610b9ff636d6929793263b2d7f98e7b/recovered.edits/9.seqid 2023-07-17 12:12:57,339 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.tmp/data/default/testtb-testEmptyExportFileSystemState/f349335016d00f26499a212280dc535c/recovered.edits/9.seqid to hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/archive/data/default/testtb-testEmptyExportFileSystemState/f349335016d00f26499a212280dc535c/recovered.edits/9.seqid 2023-07-17 12:12:57,340 DEBUG [HFileArchiver-19] backup.HFileArchiver(596): Deleted hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.tmp/data/default/testtb-testEmptyExportFileSystemState/d610b9ff636d6929793263b2d7f98e7b 2023-07-17 12:12:57,340 DEBUG [HFileArchiver-21] backup.HFileArchiver(596): Deleted hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.tmp/data/default/testtb-testEmptyExportFileSystemState/f349335016d00f26499a212280dc535c 2023-07-17 12:12:57,340 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-07-17 12:12:57,340 DEBUG [PEWorker-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-07-17 12:12:57,341 DEBUG [PEWorker-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf] 2023-07-17 12:12:57,346 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b2023071795b317e1031a4e76a8a76ffaf632d420 to hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b2023071795b317e1031a4e76a8a76ffaf632d420 2023-07-17 12:12:57,348 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e2023071725b88645fdfe4daeb3c50a171c2b4bfe to hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e2023071725b88645fdfe4daeb3c50a171c2b4bfe 2023-07-17 12:12:57,348 DEBUG [PEWorker-3] backup.HFileArchiver(596): Deleted hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-07-17 12:12:57,351 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=104, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-17 12:12:57,353 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testEmptyExportFileSystemState from hbase:meta 2023-07-17 12:12:57,357 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testEmptyExportFileSystemState' descriptor. 2023-07-17 12:12:57,363 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=104, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-17 12:12:57,363 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testEmptyExportFileSystemState' from region states. 2023-07-17 12:12:57,363 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,,1689595962147.f349335016d00f26499a212280dc535c.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689595977363"}]},"ts":"9223372036854775807"} 2023-07-17 12:12:57,363 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,1,1689595962147.d610b9ff636d6929793263b2d7f98e7b.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689595977363"}]},"ts":"9223372036854775807"} 2023-07-17 12:12:57,366 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-17 12:12:57,366 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => f349335016d00f26499a212280dc535c, NAME => 'testtb-testEmptyExportFileSystemState,,1689595962147.f349335016d00f26499a212280dc535c.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => d610b9ff636d6929793263b2d7f98e7b, NAME => 'testtb-testEmptyExportFileSystemState,1,1689595962147.d610b9ff636d6929793263b2d7f98e7b.', STARTKEY => '1', ENDKEY => ''}] 2023-07-17 12:12:57,366 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testEmptyExportFileSystemState' as deleted. 2023-07-17 12:12:57,366 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689595977366"}]},"ts":"9223372036854775807"} 2023-07-17 12:12:57,368 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testEmptyExportFileSystemState state from META 2023-07-17 12:12:57,370 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=104, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-17 12:12:57,371 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=104, state=SUCCESS; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState in 65 msec 2023-07-17 12:12:57,419 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-17 12:12:57,420 INFO [Listener at jenkins-hbase4.apache.org/44127] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 104 completed 2023-07-17 12:12:57,427 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testEmptyExportFileSystemState" 2023-07-17 12:12:57,428 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:57,430 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testEmptyExportFileSystemState" 2023-07-17 12:12:57,431 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:57,458 INFO [Listener at jenkins-hbase4.apache.org/44127] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=759 (was 756) Potentially hanging thread: ApplicationMasterLauncher #10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-4785 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: hconnection-0x1abcf153-shared-pool-40 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1847813108_17 at /127.0.0.1:34488 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (232395425) connection to jenkins-hbase4.apache.org/172.31.14.131:34855 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: HFileArchiver-21 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1847813108_17 at /127.0.0.1:52834 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1abcf153-shared-pool-41 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1847813108_17 at /127.0.0.1:41050 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (232395425) connection to jenkins-hbase4.apache.org/172.31.14.131:44443 from appattempt_1689595867847_0006_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: ApplicationMasterLauncher #9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1abcf153-shared-pool-39 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1abcf153-shared-pool-38 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1493348100_1 at /127.0.0.1:41000 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=925 (was 903) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=688 (was 560) - SystemLoadAverage LEAK? -, ProcessCount=183 (was 183), AvailableMemoryMB=1468 (was 2316) 2023-07-17 12:12:57,458 WARN [Listener at jenkins-hbase4.apache.org/44127] hbase.ResourceChecker(130): Thread=759 is superior to 500 2023-07-17 12:12:57,479 INFO [Listener at jenkins-hbase4.apache.org/44127] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=759, OpenFileDescriptor=925, MaxFileDescriptor=60000, SystemLoadAverage=688, ProcessCount=183, AvailableMemoryMB=1468 2023-07-17 12:12:57,480 WARN [Listener at jenkins-hbase4.apache.org/44127] hbase.ResourceChecker(130): Thread=759 is superior to 500 2023-07-17 12:12:57,481 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-17 12:12:57,482 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] procedure2.ProcedureExecutor(1029): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:57,484 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_PRE_OPERATION 2023-07-17 12:12:57,484 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithSkipTmp" procId is: 105 2023-07-17 12:12:57,484 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-17 12:12:57,485 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-17 12:12:57,487 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/45118551119c768a9d87e6b5b2014f13 2023-07-17 12:12:57,487 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/fae85090b91130b5c2b5f8c32d0317ca 2023-07-17 12:12:57,487 DEBUG [HFileArchiver-13] backup.HFileArchiver(153): Directory hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/45118551119c768a9d87e6b5b2014f13 empty. 2023-07-17 12:12:57,487 DEBUG [HFileArchiver-20] backup.HFileArchiver(153): Directory hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/fae85090b91130b5c2b5f8c32d0317ca empty. 2023-07-17 12:12:57,487 DEBUG [HFileArchiver-13] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/45118551119c768a9d87e6b5b2014f13 2023-07-17 12:12:57,487 DEBUG [HFileArchiver-20] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/fae85090b91130b5c2b5f8c32d0317ca 2023-07-17 12:12:57,488 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-07-17 12:12:57,496 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/.tabledesc/.tableinfo.0000000001 2023-07-17 12:12:57,497 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(7675): creating {ENCODED => 45118551119c768a9d87e6b5b2014f13, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689595977481.45118551119c768a9d87e6b5b2014f13.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.tmp 2023-07-17 12:12:57,497 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(7675): creating {ENCODED => fae85090b91130b5c2b5f8c32d0317ca, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689595977481.fae85090b91130b5c2b5f8c32d0317ca.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.tmp 2023-07-17 12:12:57,504 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1689595977481.45118551119c768a9d87e6b5b2014f13.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 12:12:57,504 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1604): Closing 45118551119c768a9d87e6b5b2014f13, disabling compactions & flushes 2023-07-17 12:12:57,504 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1689595977481.45118551119c768a9d87e6b5b2014f13. 2023-07-17 12:12:57,504 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689595977481.45118551119c768a9d87e6b5b2014f13. 2023-07-17 12:12:57,504 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689595977481.45118551119c768a9d87e6b5b2014f13. after waiting 0 ms 2023-07-17 12:12:57,504 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1689595977481.45118551119c768a9d87e6b5b2014f13. 2023-07-17 12:12:57,504 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1689595977481.fae85090b91130b5c2b5f8c32d0317ca.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 12:12:57,504 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1689595977481.45118551119c768a9d87e6b5b2014f13. 2023-07-17 12:12:57,504 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1604): Closing fae85090b91130b5c2b5f8c32d0317ca, disabling compactions & flushes 2023-07-17 12:12:57,504 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1558): Region close journal for 45118551119c768a9d87e6b5b2014f13: 2023-07-17 12:12:57,504 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1689595977481.fae85090b91130b5c2b5f8c32d0317ca. 2023-07-17 12:12:57,504 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689595977481.fae85090b91130b5c2b5f8c32d0317ca. 2023-07-17 12:12:57,504 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689595977481.fae85090b91130b5c2b5f8c32d0317ca. after waiting 0 ms 2023-07-17 12:12:57,504 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1689595977481.fae85090b91130b5c2b5f8c32d0317ca. 2023-07-17 12:12:57,505 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1689595977481.fae85090b91130b5c2b5f8c32d0317ca. 2023-07-17 12:12:57,505 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1558): Region close journal for fae85090b91130b5c2b5f8c32d0317ca: 2023-07-17 12:12:57,508 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ADD_TO_META 2023-07-17 12:12:57,508 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689595977481.45118551119c768a9d87e6b5b2014f13.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689595977508"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689595977508"}]},"ts":"1689595977508"} 2023-07-17 12:12:57,508 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689595977481.fae85090b91130b5c2b5f8c32d0317ca.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689595977508"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689595977508"}]},"ts":"1689595977508"} 2023-07-17 12:12:57,510 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-17 12:12:57,511 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-17 12:12:57,511 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689595977511"}]},"ts":"1689595977511"} 2023-07-17 12:12:57,512 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLING in hbase:meta 2023-07-17 12:12:57,515 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-17 12:12:57,516 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-17 12:12:57,516 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-17 12:12:57,516 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-17 12:12:57,516 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-17 12:12:57,516 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=45118551119c768a9d87e6b5b2014f13, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=fae85090b91130b5c2b5f8c32d0317ca, ASSIGN}] 2023-07-17 12:12:57,518 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=fae85090b91130b5c2b5f8c32d0317ca, ASSIGN 2023-07-17 12:12:57,518 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=45118551119c768a9d87e6b5b2014f13, ASSIGN 2023-07-17 12:12:57,519 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=fae85090b91130b5c2b5f8c32d0317ca, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42615,1689595859906; forceNewPlan=false, retain=false 2023-07-17 12:12:57,519 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=45118551119c768a9d87e6b5b2014f13, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39491,1689595859788; forceNewPlan=false, retain=false 2023-07-17 12:12:57,586 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-17 12:12:57,669 INFO [jenkins-hbase4:42013] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-17 12:12:57,673 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=45118551119c768a9d87e6b5b2014f13, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:12:57,673 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=fae85090b91130b5c2b5f8c32d0317ca, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:12:57,673 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689595977481.45118551119c768a9d87e6b5b2014f13.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689595977673"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689595977673"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689595977673"}]},"ts":"1689595977673"} 2023-07-17 12:12:57,673 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689595977481.fae85090b91130b5c2b5f8c32d0317ca.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689595977673"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689595977673"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689595977673"}]},"ts":"1689595977673"} 2023-07-17 12:12:57,674 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=108, ppid=106, state=RUNNABLE; OpenRegionProcedure 45118551119c768a9d87e6b5b2014f13, server=jenkins-hbase4.apache.org,39491,1689595859788}] 2023-07-17 12:12:57,675 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=109, ppid=107, state=RUNNABLE; OpenRegionProcedure fae85090b91130b5c2b5f8c32d0317ca, server=jenkins-hbase4.apache.org,42615,1689595859906}] 2023-07-17 12:12:57,787 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-17 12:12:57,834 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,,1689595977481.45118551119c768a9d87e6b5b2014f13. 2023-07-17 12:12:57,834 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 45118551119c768a9d87e6b5b2014f13, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689595977481.45118551119c768a9d87e6b5b2014f13.', STARTKEY => '', ENDKEY => '1'} 2023-07-17 12:12:57,835 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,1,1689595977481.fae85090b91130b5c2b5f8c32d0317ca. 2023-07-17 12:12:57,835 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => fae85090b91130b5c2b5f8c32d0317ca, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689595977481.fae85090b91130b5c2b5f8c32d0317ca.', STARTKEY => '1', ENDKEY => ''} 2023-07-17 12:12:57,835 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,,1689595977481.45118551119c768a9d87e6b5b2014f13. service=AccessControlService 2023-07-17 12:12:57,835 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,1,1689595977481.fae85090b91130b5c2b5f8c32d0317ca. service=AccessControlService 2023-07-17 12:12:57,835 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-17 12:12:57,835 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-17 12:12:57,835 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp 45118551119c768a9d87e6b5b2014f13 2023-07-17 12:12:57,835 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp fae85090b91130b5c2b5f8c32d0317ca 2023-07-17 12:12:57,835 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1689595977481.45118551119c768a9d87e6b5b2014f13.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 12:12:57,835 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1689595977481.fae85090b91130b5c2b5f8c32d0317ca.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 12:12:57,835 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 45118551119c768a9d87e6b5b2014f13 2023-07-17 12:12:57,835 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for fae85090b91130b5c2b5f8c32d0317ca 2023-07-17 12:12:57,835 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 45118551119c768a9d87e6b5b2014f13 2023-07-17 12:12:57,835 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for fae85090b91130b5c2b5f8c32d0317ca 2023-07-17 12:12:57,837 INFO [StoreOpener-fae85090b91130b5c2b5f8c32d0317ca-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region fae85090b91130b5c2b5f8c32d0317ca 2023-07-17 12:12:57,837 INFO [StoreOpener-45118551119c768a9d87e6b5b2014f13-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 45118551119c768a9d87e6b5b2014f13 2023-07-17 12:12:57,838 DEBUG [StoreOpener-45118551119c768a9d87e6b5b2014f13-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/default/testtb-testExportFileSystemStateWithSkipTmp/45118551119c768a9d87e6b5b2014f13/cf 2023-07-17 12:12:57,838 DEBUG [StoreOpener-fae85090b91130b5c2b5f8c32d0317ca-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/default/testtb-testExportFileSystemStateWithSkipTmp/fae85090b91130b5c2b5f8c32d0317ca/cf 2023-07-17 12:12:57,838 DEBUG [StoreOpener-fae85090b91130b5c2b5f8c32d0317ca-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/default/testtb-testExportFileSystemStateWithSkipTmp/fae85090b91130b5c2b5f8c32d0317ca/cf 2023-07-17 12:12:57,838 DEBUG [StoreOpener-45118551119c768a9d87e6b5b2014f13-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/default/testtb-testExportFileSystemStateWithSkipTmp/45118551119c768a9d87e6b5b2014f13/cf 2023-07-17 12:12:57,838 INFO [StoreOpener-fae85090b91130b5c2b5f8c32d0317ca-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fae85090b91130b5c2b5f8c32d0317ca columnFamilyName cf 2023-07-17 12:12:57,838 INFO [StoreOpener-45118551119c768a9d87e6b5b2014f13-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 45118551119c768a9d87e6b5b2014f13 columnFamilyName cf 2023-07-17 12:12:57,840 INFO [StoreOpener-fae85090b91130b5c2b5f8c32d0317ca-1] regionserver.HStore(310): Store=fae85090b91130b5c2b5f8c32d0317ca/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-17 12:12:57,840 INFO [StoreOpener-45118551119c768a9d87e6b5b2014f13-1] regionserver.HStore(310): Store=45118551119c768a9d87e6b5b2014f13/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-17 12:12:57,841 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/default/testtb-testExportFileSystemStateWithSkipTmp/45118551119c768a9d87e6b5b2014f13 2023-07-17 12:12:57,841 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/default/testtb-testExportFileSystemStateWithSkipTmp/fae85090b91130b5c2b5f8c32d0317ca 2023-07-17 12:12:57,841 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/default/testtb-testExportFileSystemStateWithSkipTmp/45118551119c768a9d87e6b5b2014f13 2023-07-17 12:12:57,842 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/default/testtb-testExportFileSystemStateWithSkipTmp/fae85090b91130b5c2b5f8c32d0317ca 2023-07-17 12:12:57,844 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for fae85090b91130b5c2b5f8c32d0317ca 2023-07-17 12:12:57,844 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 45118551119c768a9d87e6b5b2014f13 2023-07-17 12:12:57,846 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/default/testtb-testExportFileSystemStateWithSkipTmp/fae85090b91130b5c2b5f8c32d0317ca/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-17 12:12:57,846 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/default/testtb-testExportFileSystemStateWithSkipTmp/45118551119c768a9d87e6b5b2014f13/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-17 12:12:57,846 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened fae85090b91130b5c2b5f8c32d0317ca; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68115922, jitterRate=0.015006333589553833}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-17 12:12:57,846 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for fae85090b91130b5c2b5f8c32d0317ca: 2023-07-17 12:12:57,847 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 45118551119c768a9d87e6b5b2014f13; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72096042, jitterRate=0.07431474328041077}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-17 12:12:57,847 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 45118551119c768a9d87e6b5b2014f13: 2023-07-17 12:12:57,847 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,1,1689595977481.fae85090b91130b5c2b5f8c32d0317ca., pid=109, masterSystemTime=1689595977829 2023-07-17 12:12:57,848 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,,1689595977481.45118551119c768a9d87e6b5b2014f13., pid=108, masterSystemTime=1689595977827 2023-07-17 12:12:57,849 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,1,1689595977481.fae85090b91130b5c2b5f8c32d0317ca. 2023-07-17 12:12:57,850 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,1,1689595977481.fae85090b91130b5c2b5f8c32d0317ca. 2023-07-17 12:12:57,850 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=fae85090b91130b5c2b5f8c32d0317ca, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:12:57,850 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,,1689595977481.45118551119c768a9d87e6b5b2014f13. 2023-07-17 12:12:57,850 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,,1689595977481.45118551119c768a9d87e6b5b2014f13. 2023-07-17 12:12:57,850 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689595977481.fae85090b91130b5c2b5f8c32d0317ca.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689595977850"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689595977850"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689595977850"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689595977850"}]},"ts":"1689595977850"} 2023-07-17 12:12:57,851 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=45118551119c768a9d87e6b5b2014f13, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:12:57,851 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689595977481.45118551119c768a9d87e6b5b2014f13.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689595977851"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689595977851"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689595977851"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689595977851"}]},"ts":"1689595977851"} 2023-07-17 12:12:57,854 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=109, resume processing ppid=107 2023-07-17 12:12:57,854 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=109, ppid=107, state=SUCCESS; OpenRegionProcedure fae85090b91130b5c2b5f8c32d0317ca, server=jenkins-hbase4.apache.org,42615,1689595859906 in 177 msec 2023-07-17 12:12:57,855 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=108, resume processing ppid=106 2023-07-17 12:12:57,855 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=108, ppid=106, state=SUCCESS; OpenRegionProcedure 45118551119c768a9d87e6b5b2014f13, server=jenkins-hbase4.apache.org,39491,1689595859788 in 179 msec 2023-07-17 12:12:57,855 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=fae85090b91130b5c2b5f8c32d0317ca, ASSIGN in 338 msec 2023-07-17 12:12:57,857 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=106, resume processing ppid=105 2023-07-17 12:12:57,857 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=45118551119c768a9d87e6b5b2014f13, ASSIGN in 339 msec 2023-07-17 12:12:57,857 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-17 12:12:57,857 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689595977857"}]},"ts":"1689595977857"} 2023-07-17 12:12:57,859 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLED in hbase:meta 2023-07-17 12:12:57,865 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_POST_OPERATION 2023-07-17 12:12:57,865 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithSkipTmp jenkins: RWXCA 2023-07-17 12:12:57,867 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39491] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-17 12:12:57,868 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 12:12:57,868 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:33685-0x10173314c9f0002, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 12:12:57,868 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:39491-0x10173314c9f0001, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 12:12:57,868 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:42615-0x10173314c9f0003, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 12:12:57,870 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-17 12:12:57,870 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-17 12:12:57,870 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-17 12:12:57,870 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-17 12:12:57,871 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=105, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 389 msec 2023-07-17 12:12:58,089 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-17 12:12:58,089 INFO [Listener at jenkins-hbase4.apache.org/44127] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 105 completed 2023-07-17 12:12:58,092 DEBUG [Listener at jenkins-hbase4.apache.org/44127] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:58,092 DEBUG [Listener at jenkins-hbase4.apache.org/44127] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1689595977481.45118551119c768a9d87e6b5b2014f13. 2023-07-17 12:12:58,094 INFO [Listener at jenkins-hbase4.apache.org/44127] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-17 12:12:58,110 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-17 12:12:58,110 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689595978110 (current time:1689595978110). 2023-07-17 12:12:58,110 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-17 12:12:58,110 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] zookeeper.ReadOnlyZKClient(139): Connect 0x1f73cd89 to 127.0.0.1:55622 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-17 12:12:58,121 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@10a1aa23, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-17 12:12:58,122 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 12:12:58,126 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35080, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 12:12:58,127 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1f73cd89 to 127.0.0.1:55622 2023-07-17 12:12:58,127 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 12:12:58,128 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] zookeeper.ReadOnlyZKClient(139): Connect 0x343b6c3e to 127.0.0.1:55622 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-17 12:12:58,139 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3525e0b5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-17 12:12:58,141 DEBUG [hconnection-0x2848b480-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 12:12:58,144 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35082, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 12:12:58,149 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 12:12:58,155 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57456, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 12:12:58,157 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x343b6c3e to 127.0.0.1:55622 2023-07-17 12:12:58,157 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 12:12:58,157 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-17 12:12:58,158 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-17 12:12:58,158 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-17 12:12:58,161 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] procedure2.ProcedureExecutor(1029): Stored pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-17 12:12:58,163 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-17 12:12:58,164 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=110, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1689596578164 2023-07-17 12:12:58,164 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-17 12:12:58,164 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:58,166 DEBUG [Listener at jenkins-hbase4.apache.org/44127] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-17 12:12:58,166 DEBUG [Listener at jenkins-hbase4.apache.org/44127] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-17 12:12:58,167 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-17 12:12:58,168 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=110, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-17 12:12:58,170 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=110, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 8 msec 2023-07-17 12:12:58,171 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-17 12:12:58,172 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=111, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1689596578172 2023-07-17 12:12:58,220 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:58,220 INFO [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' 2023-07-17 12:12:58,220 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 12:12:58,222 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-07-17 12:12:58,222 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-07-17 12:12:58,222 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:58,222 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:58,225 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:33685-0x10173314c9f0002, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 12:12:58,225 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:39491-0x10173314c9f0001, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 12:12:58,225 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:42615-0x10173314c9f0003, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 12:12:58,225 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:12:58,225 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 12:12:58,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 12:12:58,225 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 12:12:58,225 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 12:12:58,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 12:12:58,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 12:12:58,225 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:12:58,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:58,225 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:12:58,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:58,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:58,226 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:12:58,226 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-17 12:12:58,226 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39491-0x10173314c9f0001, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:58,226 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33685-0x10173314c9f0002, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:58,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-17 12:12:58,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:58,227 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42615-0x10173314c9f0003, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:58,227 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-17 12:12:58,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-17 12:12:58,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:58,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-17 12:12:58,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:58,227 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-17 12:12:58,227 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-17 12:12:58,227 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:58,228 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:58,228 DEBUG [member: 'jenkins-hbase4.apache.org,33685,1689595859854' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-17 12:12:58,228 DEBUG [member: 'jenkins-hbase4.apache.org,33685,1689595859854' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 12:12:58,228 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-17 12:12:58,228 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 12:12:58,230 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:58,232 DEBUG [member: 'jenkins-hbase4.apache.org,39491,1689595859788' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-17 12:12:58,233 DEBUG [member: 'jenkins-hbase4.apache.org,39491,1689595859788' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 12:12:58,232 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-17 12:12:58,233 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-17 12:12:58,233 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42615,1689595859906' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-17 12:12:58,232 DEBUG [member: 'jenkins-hbase4.apache.org,33685,1689595859854' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-17 12:12:58,234 DEBUG [member: 'jenkins-hbase4.apache.org,33685,1689595859854' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-17 12:12:58,234 DEBUG [member: 'jenkins-hbase4.apache.org,33685,1689595859854' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33685,1689595859854' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-17 12:12:58,234 DEBUG [member: 'jenkins-hbase4.apache.org,39491,1689595859788' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-17 12:12:58,234 DEBUG [member: 'jenkins-hbase4.apache.org,39491,1689595859788' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-17 12:12:58,234 DEBUG [member: 'jenkins-hbase4.apache.org,39491,1689595859788' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39491,1689595859788' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-17 12:12:58,242 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:58,242 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:12:58,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:12:58,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 12:12:58,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 12:12:58,246 DEBUG [member: 'jenkins-hbase4.apache.org,33685,1689595859854' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:58,246 DEBUG [member: 'jenkins-hbase4.apache.org,39491,1689595859788' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:58,246 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:12:58,247 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42615-0x10173314c9f0003, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:58,247 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 12:12:58,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 12:12:58,247 DEBUG [member: 'jenkins-hbase4.apache.org,39491,1689595859788' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39491-0x10173314c9f0001, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:58,247 DEBUG [member: 'jenkins-hbase4.apache.org,39491,1689595859788' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 12:12:58,247 DEBUG [member: 'jenkins-hbase4.apache.org,33685,1689595859854' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33685-0x10173314c9f0002, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:58,247 DEBUG [member: 'jenkins-hbase4.apache.org,33685,1689595859854' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 12:12:58,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 12:12:58,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:58,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:12:58,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:12:58,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:12:58,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 12:12:58,250 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42615,1689595859906' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-17 12:12:58,251 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6c34c4b4[Count = 1] remaining members to acquire global barrier 2023-07-17 12:12:58,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:12:58,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 12:12:58,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 12:12:58,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 12:12:58,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 12:12:58,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:58,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:12:58,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:12:58,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:12:58,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 12:12:58,255 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39491,1689595859788' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-17 12:12:58,255 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6c34c4b4[Count = 0] remaining members to acquire global barrier 2023-07-17 12:12:58,255 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-07-17 12:12:58,255 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:58,259 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:33685-0x10173314c9f0002, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:58,259 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:58,259 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:42615-0x10173314c9f0003, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:58,259 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:58,260 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:39491-0x10173314c9f0001, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:58,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:58,260 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:58,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:58,260 DEBUG [member: 'jenkins-hbase4.apache.org,33685,1689595859854' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-17 12:12:58,260 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-17 12:12:58,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:58,260 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:12:58,260 DEBUG [member: 'jenkins-hbase4.apache.org,33685,1689595859854' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-17 12:12:58,260 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-17 12:12:58,260 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-17 12:12:58,260 DEBUG [member: 'jenkins-hbase4.apache.org,39491,1689595859788' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-17 12:12:58,260 DEBUG [rs(jenkins-hbase4.apache.org,42615,1689595859906)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689595977481.fae85090b91130b5c2b5f8c32d0317ca. 2023-07-17 12:12:58,260 DEBUG [rs(jenkins-hbase4.apache.org,42615,1689595859906)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689595977481.fae85090b91130b5c2b5f8c32d0317ca. started... 2023-07-17 12:12:58,260 DEBUG [member: 'jenkins-hbase4.apache.org,39491,1689595859788' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-17 12:12:58,260 DEBUG [member: 'jenkins-hbase4.apache.org,39491,1689595859788' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-17 12:12:58,260 DEBUG [rs(jenkins-hbase4.apache.org,39491,1689595859788)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689595977481.45118551119c768a9d87e6b5b2014f13. 2023-07-17 12:12:58,260 DEBUG [member: 'jenkins-hbase4.apache.org,33685,1689595859854' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,33685,1689595859854' in zk 2023-07-17 12:12:58,263 DEBUG [rs(jenkins-hbase4.apache.org,42615,1689595859906)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for fae85090b91130b5c2b5f8c32d0317ca: 2023-07-17 12:12:58,263 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:12:58,263 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-17 12:12:58,263 DEBUG [rs(jenkins-hbase4.apache.org,42615,1689595859906)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1689595977481.fae85090b91130b5c2b5f8c32d0317ca.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:58,261 DEBUG [rs(jenkins-hbase4.apache.org,39491,1689595859788)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689595977481.45118551119c768a9d87e6b5b2014f13. started... 2023-07-17 12:12:58,263 DEBUG [rs(jenkins-hbase4.apache.org,42615,1689595859906)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-17 12:12:58,263 DEBUG [rs(jenkins-hbase4.apache.org,42615,1689595859906)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-17 12:12:58,263 DEBUG [rs(jenkins-hbase4.apache.org,39491,1689595859788)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 45118551119c768a9d87e6b5b2014f13: 2023-07-17 12:12:58,263 DEBUG [rs(jenkins-hbase4.apache.org,39491,1689595859788)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1689595977481.45118551119c768a9d87e6b5b2014f13.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:58,264 DEBUG [rs(jenkins-hbase4.apache.org,39491,1689595859788)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-17 12:12:58,264 DEBUG [rs(jenkins-hbase4.apache.org,39491,1689595859788)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-17 12:12:58,266 DEBUG [Listener at jenkins-hbase4.apache.org/44127] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 12:12:58,267 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-17 12:12:58,267 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-17 12:12:58,267 DEBUG [Listener at jenkins-hbase4.apache.org/44127] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-17 12:12:58,288 DEBUG [rs(jenkins-hbase4.apache.org,39491,1689595859788)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689595977481.45118551119c768a9d87e6b5b2014f13. completed. 2023-07-17 12:12:58,288 DEBUG [rs(jenkins-hbase4.apache.org,39491,1689595859788)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689595977481.45118551119c768a9d87e6b5b2014f13. 2023-07-17 12:12:58,289 DEBUG [member: 'jenkins-hbase4.apache.org,39491,1689595859788' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-17 12:12:58,289 DEBUG [member: 'jenkins-hbase4.apache.org,39491,1689595859788' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-17 12:12:58,289 DEBUG [member: 'jenkins-hbase4.apache.org,39491,1689595859788' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:12:58,289 DEBUG [member: 'jenkins-hbase4.apache.org,39491,1689595859788' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-17 12:12:58,289 DEBUG [member: 'jenkins-hbase4.apache.org,39491,1689595859788' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,39491,1689595859788' in zk 2023-07-17 12:12:58,290 DEBUG [rs(jenkins-hbase4.apache.org,42615,1689595859906)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689595977481.fae85090b91130b5c2b5f8c32d0317ca. completed. 2023-07-17 12:12:58,290 DEBUG [rs(jenkins-hbase4.apache.org,42615,1689595859906)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689595977481.fae85090b91130b5c2b5f8c32d0317ca. 2023-07-17 12:12:58,290 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-17 12:12:58,290 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-17 12:12:58,290 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:12:58,290 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-17 12:12:58,290 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,42615,1689595859906' in zk 2023-07-17 12:12:58,294 DEBUG [member: 'jenkins-hbase4.apache.org,33685,1689595859854' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-17 12:12:58,294 DEBUG [member: 'jenkins-hbase4.apache.org,33685,1689595859854' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 12:12:58,294 DEBUG [member: 'jenkins-hbase4.apache.org,33685,1689595859854' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-17 12:12:58,317 DEBUG [member: 'jenkins-hbase4.apache.org,39491,1689595859788' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-17 12:12:58,317 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:12:58,317 DEBUG [member: 'jenkins-hbase4.apache.org,39491,1689595859788' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 12:12:58,318 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-17 12:12:58,318 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:12:58,318 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 12:12:58,318 DEBUG [member: 'jenkins-hbase4.apache.org,39491,1689595859788' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-17 12:12:58,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:12:58,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 12:12:58,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 12:12:58,319 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-17 12:12:58,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 12:12:58,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 12:12:58,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:58,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:12:58,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:12:58,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:12:58,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 12:12:58,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:58,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:12:58,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:12:58,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:12:58,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,39491,1689595859788': 2023-07-17 12:12:58,325 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39491,1689595859788' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-07-17 12:12:58,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:12:58,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 12:12:58,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 12:12:58,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 12:12:58,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 12:12:58,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:58,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:12:58,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:12:58,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:12:58,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 12:12:58,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:58,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:12:58,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:12:58,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:12:58,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,42615,1689595859906': 2023-07-17 12:12:58,328 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42615,1689595859906' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-07-17 12:12:58,328 INFO [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-07-17 12:12:58,328 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-17 12:12:58,328 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-17 12:12:58,328 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:58,329 INFO [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-17 12:12:58,363 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:33685-0x10173314c9f0002, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:58,363 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:39491-0x10173314c9f0001, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:58,364 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:42615-0x10173314c9f0003, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:58,364 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:39491-0x10173314c9f0001, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 12:12:58,364 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:58,364 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:58,364 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:42615-0x10173314c9f0003, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 12:12:58,364 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:58,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:58,363 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:58,363 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:33685-0x10173314c9f0002, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 12:12:58,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:58,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 12:12:58,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 12:12:58,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:58,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:58,364 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 12:12:58,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 12:12:58,365 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:12:58,365 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 12:12:58,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 12:12:58,365 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 12:12:58,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 12:12:58,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 12:12:58,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:58,365 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:12:58,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:58,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:58,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:58,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 12:12:58,366 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:12:58,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:58,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:12:58,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:12:58,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:12:58,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 12:12:58,368 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:12:58,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:58,369 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:12:58,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:12:58,369 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:12:58,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:12:58,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:12:58,410 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:12:58,410 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:39491-0x10173314c9f0001, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 12:12:58,410 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:58,410 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 12:12:58,410 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:12:58,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 12:12:58,410 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 12:12:58,410 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:39491-0x10173314c9f0001, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 12:12:58,410 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:42615-0x10173314c9f0003, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 12:12:58,410 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:33685-0x10173314c9f0002, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 12:12:58,412 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 12:12:58,412 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:42615-0x10173314c9f0003, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 12:12:58,410 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:58,410 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:12:58,412 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:58,412 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 12:12:58,412 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:58,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 12:12:58,412 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:58,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 12:12:58,412 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 12:12:58,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 12:12:58,412 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:33685-0x10173314c9f0002, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 12:12:58,412 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:12:58,412 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-17 12:12:58,413 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:58,413 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:12:58,413 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:12:58,413 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:58,413 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:58,413 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 12:12:58,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 12:12:58,413 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 12:12:58,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 12:12:58,413 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-17 12:12:58,421 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:58,422 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:58,439 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:58,468 DEBUG [Listener at jenkins-hbase4.apache.org/44127] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 12:12:58,469 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-17 12:12:58,469 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-17 12:12:58,469 DEBUG [Listener at jenkins-hbase4.apache.org/44127] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-17 12:12:58,770 DEBUG [Listener at jenkins-hbase4.apache.org/44127] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 12:12:58,771 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-17 12:12:58,771 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-17 12:12:58,771 DEBUG [Listener at jenkins-hbase4.apache.org/44127] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-17 12:12:58,895 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-07-17 12:12:58,895 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:58,895 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:58,895 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1689595978164Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1689595978421 (+257 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689595978421Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689595978422 (+1 ms)Writing data manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689595978425 (+3 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689595978434 (+9 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1689595978895 (+461 ms) 2023-07-17 12:12:58,898 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=111, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-17 12:12:58,900 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=111, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 733 msec 2023-07-17 12:12:59,271 DEBUG [Listener at jenkins-hbase4.apache.org/44127] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 12:12:59,272 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-17 12:12:59,273 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-17 12:12:59,275 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39491] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,,1689595977481.45118551119c768a9d87e6b5b2014f13. with WAL disabled. Data may be lost in the event of a crash. 2023-07-17 12:12:59,276 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42615] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,1,1689595977481.fae85090b91130b5c2b5f8c32d0317ca. with WAL disabled. Data may be lost in the event of a crash. 2023-07-17 12:12:59,279 DEBUG [Listener at jenkins-hbase4.apache.org/44127] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:59,279 DEBUG [Listener at jenkins-hbase4.apache.org/44127] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1689595977481.45118551119c768a9d87e6b5b2014f13. 2023-07-17 12:12:59,279 INFO [Listener at jenkins-hbase4.apache.org/44127] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-17 12:12:59,292 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-17 12:12:59,292 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689595979292 (current time:1689595979292). 2023-07-17 12:12:59,293 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-17 12:12:59,293 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] zookeeper.ReadOnlyZKClient(139): Connect 0x2aeffff5 to 127.0.0.1:55622 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-17 12:12:59,307 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@476ea29c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-17 12:12:59,308 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 12:12:59,309 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35098, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 12:12:59,310 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2aeffff5 to 127.0.0.1:55622 2023-07-17 12:12:59,310 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 12:12:59,311 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] zookeeper.ReadOnlyZKClient(139): Connect 0x0670cbd4 to 127.0.0.1:55622 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-17 12:12:59,317 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@53359cb8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-17 12:12:59,319 DEBUG [hconnection-0x617dbe00-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 12:12:59,322 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35102, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 12:12:59,326 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 12:12:59,329 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57458, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 12:12:59,330 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0670cbd4 to 127.0.0.1:55622 2023-07-17 12:12:59,330 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 12:12:59,330 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-17 12:12:59,331 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-17 12:12:59,331 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-17 12:12:59,333 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] procedure2.ProcedureExecutor(1029): Stored pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-17 12:12:59,334 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-17 12:12:59,335 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=112, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1689596579335 2023-07-17 12:12:59,335 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-17 12:12:59,335 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:59,337 DEBUG [Listener at jenkins-hbase4.apache.org/44127] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-17 12:12:59,338 DEBUG [Listener at jenkins-hbase4.apache.org/44127] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-17 12:12:59,339 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-17 12:12:59,339 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=112, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-17 12:12:59,340 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=112, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 6 msec 2023-07-17 12:12:59,341 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-17 12:12:59,346 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=113, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1689596579346 2023-07-17 12:12:59,399 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:59,399 INFO [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' 2023-07-17 12:12:59,399 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 12:12:59,401 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-07-17 12:12:59,401 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-07-17 12:12:59,402 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:59,402 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:59,405 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:42615-0x10173314c9f0003, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 12:12:59,405 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:12:59,405 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 12:12:59,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 12:12:59,405 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:39491-0x10173314c9f0001, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 12:12:59,405 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:33685-0x10173314c9f0002, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 12:12:59,405 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 12:12:59,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 12:12:59,405 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 12:12:59,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 12:12:59,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:59,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:59,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:59,406 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:12:59,406 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:12:59,407 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33685-0x10173314c9f0002, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:59,407 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42615-0x10173314c9f0003, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:59,407 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39491-0x10173314c9f0001, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:59,407 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:12:59,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-17 12:12:59,407 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-17 12:12:59,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:59,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-17 12:12:59,407 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-17 12:12:59,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-17 12:12:59,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:59,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:59,407 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-17 12:12:59,408 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-17 12:12:59,408 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:59,408 DEBUG [member: 'jenkins-hbase4.apache.org,33685,1689595859854' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-17 12:12:59,408 DEBUG [member: 'jenkins-hbase4.apache.org,33685,1689595859854' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 12:12:59,414 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:59,415 DEBUG [member: 'jenkins-hbase4.apache.org,39491,1689595859788' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-17 12:12:59,415 DEBUG [member: 'jenkins-hbase4.apache.org,39491,1689595859788' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 12:12:59,416 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:59,416 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-17 12:12:59,417 DEBUG [member: 'jenkins-hbase4.apache.org,33685,1689595859854' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-17 12:12:59,417 DEBUG [member: 'jenkins-hbase4.apache.org,33685,1689595859854' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-17 12:12:59,418 DEBUG [member: 'jenkins-hbase4.apache.org,33685,1689595859854' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33685,1689595859854' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-17 12:12:59,418 DEBUG [member: 'jenkins-hbase4.apache.org,39491,1689595859788' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-17 12:12:59,418 DEBUG [member: 'jenkins-hbase4.apache.org,39491,1689595859788' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-17 12:12:59,418 DEBUG [member: 'jenkins-hbase4.apache.org,39491,1689595859788' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39491,1689595859788' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-17 12:12:59,417 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 12:12:59,419 DEBUG [member: 'jenkins-hbase4.apache.org,33685,1689595859854' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:59,421 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-17 12:12:59,421 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-17 12:12:59,421 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42615,1689595859906' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-17 12:12:59,422 DEBUG [member: 'jenkins-hbase4.apache.org,39491,1689595859788' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:59,422 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:12:59,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:12:59,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 12:12:59,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 12:12:59,422 DEBUG [member: 'jenkins-hbase4.apache.org,33685,1689595859854' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33685-0x10173314c9f0002, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:59,423 DEBUG [member: 'jenkins-hbase4.apache.org,33685,1689595859854' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 12:12:59,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 12:12:59,424 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:12:59,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 12:12:59,424 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:59,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:59,424 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42615-0x10173314c9f0003, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:59,424 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 12:12:59,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:12:59,426 DEBUG [member: 'jenkins-hbase4.apache.org,39491,1689595859788' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39491-0x10173314c9f0001, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:59,426 DEBUG [member: 'jenkins-hbase4.apache.org,39491,1689595859788' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 12:12:59,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:12:59,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:12:59,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 12:12:59,429 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39491,1689595859788' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-17 12:12:59,429 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5a1963c2[Count = 1] remaining members to acquire global barrier 2023-07-17 12:12:59,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:12:59,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 12:12:59,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 12:12:59,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 12:12:59,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 12:12:59,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:59,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:12:59,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:12:59,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:12:59,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 12:12:59,432 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42615,1689595859906' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-17 12:12:59,432 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5a1963c2[Count = 0] remaining members to acquire global barrier 2023-07-17 12:12:59,432 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-07-17 12:12:59,432 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:59,438 DEBUG [Listener at jenkins-hbase4.apache.org/44127] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 12:12:59,439 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-17 12:12:59,439 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-17 12:12:59,439 DEBUG [Listener at jenkins-hbase4.apache.org/44127] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-17 12:12:59,444 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:39491-0x10173314c9f0001, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:59,444 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:59,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:59,444 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:33685-0x10173314c9f0002, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:59,444 DEBUG [member: 'jenkins-hbase4.apache.org,39491,1689595859788' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-17 12:12:59,444 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:59,444 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:42615-0x10173314c9f0003, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:59,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:59,444 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:59,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:59,444 DEBUG [rs(jenkins-hbase4.apache.org,39491,1689595859788)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689595977481.45118551119c768a9d87e6b5b2014f13. 2023-07-17 12:12:59,444 DEBUG [member: 'jenkins-hbase4.apache.org,39491,1689595859788' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-17 12:12:59,445 DEBUG [member: 'jenkins-hbase4.apache.org,39491,1689595859788' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-17 12:12:59,445 DEBUG [rs(jenkins-hbase4.apache.org,39491,1689595859788)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689595977481.45118551119c768a9d87e6b5b2014f13. started... 2023-07-17 12:12:59,444 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:12:59,444 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-17 12:12:59,444 DEBUG [member: 'jenkins-hbase4.apache.org,33685,1689595859854' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-17 12:12:59,445 INFO [rs(jenkins-hbase4.apache.org,39491,1689595859788)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 45118551119c768a9d87e6b5b2014f13 1/1 column families, dataSize=266 B heapSize=832 B 2023-07-17 12:12:59,445 DEBUG [member: 'jenkins-hbase4.apache.org,33685,1689595859854' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-17 12:12:59,445 DEBUG [member: 'jenkins-hbase4.apache.org,33685,1689595859854' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,33685,1689595859854' in zk 2023-07-17 12:12:59,445 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:12:59,445 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-17 12:12:59,447 DEBUG [member: 'jenkins-hbase4.apache.org,33685,1689595859854' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-17 12:12:59,447 DEBUG [member: 'jenkins-hbase4.apache.org,33685,1689595859854' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 12:12:59,447 DEBUG [member: 'jenkins-hbase4.apache.org,33685,1689595859854' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-17 12:12:59,450 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-17 12:12:59,457 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-17 12:12:59,457 DEBUG [rs(jenkins-hbase4.apache.org,42615,1689595859906)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689595977481.fae85090b91130b5c2b5f8c32d0317ca. 2023-07-17 12:12:59,458 DEBUG [rs(jenkins-hbase4.apache.org,42615,1689595859906)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689595977481.fae85090b91130b5c2b5f8c32d0317ca. started... 2023-07-17 12:12:59,459 INFO [rs(jenkins-hbase4.apache.org,42615,1689595859906)-snapshot-pool-0] regionserver.HRegion(2745): Flushing fae85090b91130b5c2b5f8c32d0317ca 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-07-17 12:12:59,479 INFO [rs(jenkins-hbase4.apache.org,39491,1689595859788)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230717f8c8db2dcb9642b29966c094b36401b8 to hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230717f8c8db2dcb9642b29966c094b36401b8 2023-07-17 12:12:59,502 INFO [rs(jenkins-hbase4.apache.org,39491,1689595859788)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=266, hasBloomFilter=true, into tmp file hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/default/testtb-testExportFileSystemStateWithSkipTmp/45118551119c768a9d87e6b5b2014f13/.tmp/cf/d7d1e7fb94564cee943eb99796d79338 2023-07-17 12:12:59,504 INFO [rs(jenkins-hbase4.apache.org,42615,1689595859906)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023071724324fa61a12423ead76587c92662666 to hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b2023071724324fa61a12423ead76587c92662666 2023-07-17 12:12:59,509 DEBUG [rs(jenkins-hbase4.apache.org,39491,1689595859788)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/default/testtb-testExportFileSystemStateWithSkipTmp/45118551119c768a9d87e6b5b2014f13/.tmp/cf/d7d1e7fb94564cee943eb99796d79338 as hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/default/testtb-testExportFileSystemStateWithSkipTmp/45118551119c768a9d87e6b5b2014f13/cf/d7d1e7fb94564cee943eb99796d79338 2023-07-17 12:12:59,528 INFO [rs(jenkins-hbase4.apache.org,39491,1689595859788)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/default/testtb-testExportFileSystemStateWithSkipTmp/45118551119c768a9d87e6b5b2014f13/cf/d7d1e7fb94564cee943eb99796d79338, entries=4, sequenceid=6, filesize=5.6 K 2023-07-17 12:12:59,530 INFO [rs(jenkins-hbase4.apache.org,39491,1689595859788)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for 45118551119c768a9d87e6b5b2014f13 in 85ms, sequenceid=6, compaction requested=false 2023-07-17 12:12:59,530 DEBUG [rs(jenkins-hbase4.apache.org,39491,1689595859788)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithSkipTmp' 2023-07-17 12:12:59,531 DEBUG [rs(jenkins-hbase4.apache.org,39491,1689595859788)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 45118551119c768a9d87e6b5b2014f13: 2023-07-17 12:12:59,531 DEBUG [rs(jenkins-hbase4.apache.org,39491,1689595859788)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1689595977481.45118551119c768a9d87e6b5b2014f13.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:59,531 DEBUG [rs(jenkins-hbase4.apache.org,39491,1689595859788)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-17 12:12:59,531 DEBUG [rs(jenkins-hbase4.apache.org,39491,1689595859788)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/default/testtb-testExportFileSystemStateWithSkipTmp/45118551119c768a9d87e6b5b2014f13/cf/d7d1e7fb94564cee943eb99796d79338] hfiles 2023-07-17 12:12:59,531 DEBUG [rs(jenkins-hbase4.apache.org,39491,1689595859788)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/default/testtb-testExportFileSystemStateWithSkipTmp/45118551119c768a9d87e6b5b2014f13/cf/d7d1e7fb94564cee943eb99796d79338 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:59,538 INFO [rs(jenkins-hbase4.apache.org,42615,1689595859906)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.0 K, hasBloomFilter=true, into tmp file hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/default/testtb-testExportFileSystemStateWithSkipTmp/fae85090b91130b5c2b5f8c32d0317ca/.tmp/cf/d4c53e118f9343d4958838da296e8b8f 2023-07-17 12:12:59,545 DEBUG [rs(jenkins-hbase4.apache.org,42615,1689595859906)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/default/testtb-testExportFileSystemStateWithSkipTmp/fae85090b91130b5c2b5f8c32d0317ca/.tmp/cf/d4c53e118f9343d4958838da296e8b8f as hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/default/testtb-testExportFileSystemStateWithSkipTmp/fae85090b91130b5c2b5f8c32d0317ca/cf/d4c53e118f9343d4958838da296e8b8f 2023-07-17 12:12:59,550 INFO [rs(jenkins-hbase4.apache.org,42615,1689595859906)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/default/testtb-testExportFileSystemStateWithSkipTmp/fae85090b91130b5c2b5f8c32d0317ca/cf/d4c53e118f9343d4958838da296e8b8f, entries=46, sequenceid=6, filesize=13.2 K 2023-07-17 12:12:59,555 INFO [rs(jenkins-hbase4.apache.org,42615,1689595859906)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for fae85090b91130b5c2b5f8c32d0317ca in 97ms, sequenceid=6, compaction requested=false 2023-07-17 12:12:59,557 DEBUG [rs(jenkins-hbase4.apache.org,42615,1689595859906)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for fae85090b91130b5c2b5f8c32d0317ca: 2023-07-17 12:12:59,557 DEBUG [rs(jenkins-hbase4.apache.org,42615,1689595859906)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1689595977481.fae85090b91130b5c2b5f8c32d0317ca.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:59,557 DEBUG [rs(jenkins-hbase4.apache.org,42615,1689595859906)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-17 12:12:59,557 DEBUG [rs(jenkins-hbase4.apache.org,42615,1689595859906)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/default/testtb-testExportFileSystemStateWithSkipTmp/fae85090b91130b5c2b5f8c32d0317ca/cf/d4c53e118f9343d4958838da296e8b8f] hfiles 2023-07-17 12:12:59,557 DEBUG [rs(jenkins-hbase4.apache.org,42615,1689595859906)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/default/testtb-testExportFileSystemStateWithSkipTmp/fae85090b91130b5c2b5f8c32d0317ca/cf/d4c53e118f9343d4958838da296e8b8f for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:59,599 DEBUG [rs(jenkins-hbase4.apache.org,42615,1689595859906)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689595977481.fae85090b91130b5c2b5f8c32d0317ca. completed. 2023-07-17 12:12:59,599 DEBUG [rs(jenkins-hbase4.apache.org,42615,1689595859906)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689595977481.fae85090b91130b5c2b5f8c32d0317ca. 2023-07-17 12:12:59,599 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-17 12:12:59,599 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-17 12:12:59,599 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:12:59,599 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-17 12:12:59,599 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,42615,1689595859906' in zk 2023-07-17 12:12:59,601 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-17 12:12:59,601 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:12:59,601 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 12:12:59,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:12:59,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 12:12:59,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 12:12:59,601 DEBUG [member: 'jenkins-hbase4.apache.org,42615,1689595859906' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-17 12:12:59,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 12:12:59,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 12:12:59,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:59,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:12:59,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:12:59,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:12:59,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 12:12:59,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:59,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:12:59,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:12:59,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,42615,1689595859906': 2023-07-17 12:12:59,609 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42615,1689595859906' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-07-17 12:12:59,639 DEBUG [Listener at jenkins-hbase4.apache.org/44127] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 12:12:59,640 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-17 12:12:59,640 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-17 12:12:59,640 DEBUG [Listener at jenkins-hbase4.apache.org/44127] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-17 12:12:59,941 DEBUG [Listener at jenkins-hbase4.apache.org/44127] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 12:12:59,942 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-17 12:12:59,942 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-17 12:12:59,942 DEBUG [Listener at jenkins-hbase4.apache.org/44127] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-17 12:12:59,965 DEBUG [rs(jenkins-hbase4.apache.org,39491,1689595859788)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689595977481.45118551119c768a9d87e6b5b2014f13. completed. 2023-07-17 12:12:59,965 DEBUG [rs(jenkins-hbase4.apache.org,39491,1689595859788)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689595977481.45118551119c768a9d87e6b5b2014f13. 2023-07-17 12:12:59,965 DEBUG [member: 'jenkins-hbase4.apache.org,39491,1689595859788' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-17 12:12:59,965 DEBUG [member: 'jenkins-hbase4.apache.org,39491,1689595859788' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-17 12:12:59,965 DEBUG [member: 'jenkins-hbase4.apache.org,39491,1689595859788' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:12:59,965 DEBUG [member: 'jenkins-hbase4.apache.org,39491,1689595859788' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-17 12:12:59,965 DEBUG [member: 'jenkins-hbase4.apache.org,39491,1689595859788' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,39491,1689595859788' in zk 2023-07-17 12:12:59,967 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:12:59,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:12:59,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 12:12:59,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 12:12:59,967 DEBUG [member: 'jenkins-hbase4.apache.org,39491,1689595859788' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-17 12:12:59,967 DEBUG [member: 'jenkins-hbase4.apache.org,39491,1689595859788' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 12:12:59,967 DEBUG [member: 'jenkins-hbase4.apache.org,39491,1689595859788' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-17 12:12:59,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 12:12:59,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 12:12:59,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:59,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:12:59,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:12:59,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:12:59,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 12:12:59,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:59,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:12:59,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:12:59,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:12:59,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,39491,1689595859788': 2023-07-17 12:12:59,978 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39491,1689595859788' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-07-17 12:12:59,978 INFO [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-07-17 12:12:59,978 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-17 12:12:59,979 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-17 12:12:59,979 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:59,979 INFO [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-17 12:12:59,981 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:33685-0x10173314c9f0002, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:59,981 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:33685-0x10173314c9f0002, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 12:12:59,981 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:59,981 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:39491-0x10173314c9f0001, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:59,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:59,981 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:59,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 12:12:59,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 12:12:59,981 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:39491-0x10173314c9f0001, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 12:12:59,981 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:59,981 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:42615-0x10173314c9f0003, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:59,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:59,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:59,982 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:59,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:59,981 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:42615-0x10173314c9f0003, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 12:12:59,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 12:12:59,982 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:12:59,982 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 12:12:59,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 12:12:59,982 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 12:12:59,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 12:12:59,982 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 12:12:59,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 12:12:59,983 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:12:59,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:59,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:59,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:59,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:59,984 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:12:59,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 12:12:59,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:59,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:12:59,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:12:59,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:12:59,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 12:12:59,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:59,986 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:12:59,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:12:59,987 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:12:59,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:12:59,987 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:12:59,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:12:59,996 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:12:59,996 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:33685-0x10173314c9f0002, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 12:12:59,997 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:39491-0x10173314c9f0001, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 12:12:59,997 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 12:12:59,997 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:39491-0x10173314c9f0001, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 12:12:59,997 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 12:12:59,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 12:12:59,997 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:42615-0x10173314c9f0003, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 12:12:59,997 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:33685-0x10173314c9f0002, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 12:12:59,996 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:59,997 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 12:12:59,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 12:12:59,997 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:42615-0x10173314c9f0003, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 12:12:59,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 12:12:59,997 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:12:59,997 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:12:59,997 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:59,997 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 12:12:59,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 12:12:59,997 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:12:59,997 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:59,998 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:12:59,998 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 12:12:59,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 12:12:59,998 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 12:12:59,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 12:12:59,998 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:12:59,998 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:59,998 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:59,998 DEBUG [(jenkins-hbase4.apache.org,42013,1689595858265)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 12:12:59,998 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:13:00,000 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-07-17 12:13:00,000 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:13:00,000 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-17 12:13:00,001 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b2023071724324fa61a12423ead76587c92662666, hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230717f8c8db2dcb9642b29966c094b36401b8] mob files 2023-07-17 12:13:00,001 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b2023071724324fa61a12423ead76587c92662666 2023-07-17 12:13:00,002 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230717f8c8db2dcb9642b29966c094b36401b8 2023-07-17 12:13:00,059 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:13:00,060 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:13:00,144 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:13:00,181 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-07-17 12:13:00,181 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:13:00,182 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:13:00,182 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1689595979335Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1689595980059 (+724 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1689595980059Loading Region manifests for snaptb0-testExportFileSystemStateWithSkipTmp at 1689595980059Writing data manifest for snaptb0-testExportFileSystemStateWithSkipTmp at 1689595980076 (+17 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1689595980124 (+48 ms)Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1689595980181 (+57 ms) 2023-07-17 12:13:00,186 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=113, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-17 12:13:00,190 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=113, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 849 msec 2023-07-17 12:13:00,442 DEBUG [Listener at jenkins-hbase4.apache.org/44127] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 12:13:00,443 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-17 12:13:00,443 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-17 12:13:00,444 INFO [Listener at jenkins-hbase4.apache.org/44127] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/export-test/export-1689595980444 2023-07-17 12:13:00,444 INFO [Listener at jenkins-hbase4.apache.org/44127] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:46215, tgtDir=hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/export-test/export-1689595980444, rawTgtDir=hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/export-test/export-1689595980444, srcFsUri=hdfs://localhost:46215, srcDir=hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b 2023-07-17 12:13:00,473 DEBUG [Listener at jenkins-hbase4.apache.org/44127] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:46215, inputRoot=hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b 2023-07-17 12:13:00,473 DEBUG [Listener at jenkins-hbase4.apache.org/44127] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-815026494_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/export-test/export-1689595980444, skipTmp=true, initialOutputSnapshotDir=hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/export-test/export-1689595980444/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:13:00,474 INFO [Listener at jenkins-hbase4.apache.org/44127] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:46215, inputRoot=hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b, snapshotDir=hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp. 2023-07-17 12:13:00,531 INFO [Listener at jenkins-hbase4.apache.org/44127] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/export-test/export-1689595980444/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:13:00,596 DEBUG [Listener at jenkins-hbase4.apache.org/44127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-17 12:13:00,597 DEBUG [Listener at jenkins-hbase4.apache.org/44127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-17 12:13:00,597 DEBUG [Listener at jenkins-hbase4.apache.org/44127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-17 12:13:00,598 DEBUG [Listener at jenkins-hbase4.apache.org/44127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-17 12:13:00,598 DEBUG [Listener at jenkins-hbase4.apache.org/44127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-17 12:13:00,598 DEBUG [Listener at jenkins-hbase4.apache.org/44127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-17 12:13:00,598 DEBUG [Listener at jenkins-hbase4.apache.org/44127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-17 12:13:00,690 DEBUG [Listener at jenkins-hbase4.apache.org/44127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58af5705-0594-af5f-981c-fa1d3b267fab/hadoop-6369718700031009438.jar 2023-07-17 12:13:00,691 DEBUG [Listener at jenkins-hbase4.apache.org/44127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-17 12:13:00,691 DEBUG [Listener at jenkins-hbase4.apache.org/44127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-17 12:13:00,692 DEBUG [Listener at jenkins-hbase4.apache.org/44127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-17 12:13:00,692 DEBUG [Listener at jenkins-hbase4.apache.org/44127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-17 12:13:00,692 DEBUG [Listener at jenkins-hbase4.apache.org/44127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-17 12:13:00,693 DEBUG [Listener at jenkins-hbase4.apache.org/44127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-17 12:13:00,693 DEBUG [Listener at jenkins-hbase4.apache.org/44127] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-17 12:13:00,694 DEBUG [Listener at jenkins-hbase4.apache.org/44127] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-17 12:13:00,694 DEBUG [Listener at jenkins-hbase4.apache.org/44127] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-17 12:13:00,695 DEBUG [Listener at jenkins-hbase4.apache.org/44127] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-17 12:13:00,696 DEBUG [Listener at jenkins-hbase4.apache.org/44127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-17 12:13:00,696 DEBUG [Listener at jenkins-hbase4.apache.org/44127] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-17 12:13:00,696 DEBUG [Listener at jenkins-hbase4.apache.org/44127] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-17 12:13:00,697 DEBUG [Listener at jenkins-hbase4.apache.org/44127] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-17 12:13:00,697 DEBUG [Listener at jenkins-hbase4.apache.org/44127] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-17 12:13:00,698 DEBUG [Listener at jenkins-hbase4.apache.org/44127] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-17 12:13:00,699 DEBUG [Listener at jenkins-hbase4.apache.org/44127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-17 12:13:00,699 DEBUG [Listener at jenkins-hbase4.apache.org/44127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-17 12:13:00,700 DEBUG [Listener at jenkins-hbase4.apache.org/44127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-17 12:13:00,700 DEBUG [Listener at jenkins-hbase4.apache.org/44127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-17 12:13:00,700 DEBUG [Listener at jenkins-hbase4.apache.org/44127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-17 12:13:00,701 DEBUG [Listener at jenkins-hbase4.apache.org/44127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-17 12:13:00,702 DEBUG [Listener at jenkins-hbase4.apache.org/44127] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-17 12:13:01,075 WARN [DataStreamer for file /user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/hadoop/mapreduce-am-staging-root-dir/jenkins/.staging/job_1689595867847_0007/libjars/hadoop-mapreduce-client-core-2.10.0.jar] hdfs.DataStreamer(982): Caught exception java.lang.InterruptedException at java.lang.Object.wait(Native Method) at java.lang.Thread.join(Thread.java:1257) at java.lang.Thread.join(Thread.java:1331) at org.apache.hadoop.hdfs.DataStreamer.closeResponder(DataStreamer.java:980) at org.apache.hadoop.hdfs.DataStreamer.endBlock(DataStreamer.java:630) at org.apache.hadoop.hdfs.DataStreamer.run(DataStreamer.java:807) 2023-07-17 12:13:01,620 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689595867847_0006_000001 (auth:SIMPLE) 2023-07-17 12:13:01,721 WARN [Listener at jenkins-hbase4.apache.org/44127] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-17 12:13:01,726 INFO [Listener at jenkins-hbase4.apache.org/44127] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithSkipTmp' hfile list 2023-07-17 12:13:01,734 DEBUG [Listener at jenkins-hbase4.apache.org/44127] snapshot.ExportSnapshot(671): export split=0 size=31.5 K 2023-07-17 12:13:01,885 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-17 12:13:01,885 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-17 12:13:02,635 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689595867847_0007_000001 (auth:SIMPLE) 2023-07-17 12:13:02,828 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-17 12:13:08,860 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689595867847_0007_000001 (auth:SIMPLE) 2023-07-17 12:13:11,290 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689595867847_0007_000001 (auth:SIMPLE) 2023-07-17 12:13:15,434 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689595867847_0007_000001 (auth:SIMPLE) 2023-07-17 12:13:17,253 INFO [Listener at jenkins-hbase4.apache.org/44127] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-17 12:13:17,253 INFO [Listener at jenkins-hbase4.apache.org/44127] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-17 12:13:17,267 INFO [Listener at jenkins-hbase4.apache.org/44127] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:13:17,267 INFO [Listener at jenkins-hbase4.apache.org/44127] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-17 12:13:17,268 INFO [Listener at jenkins-hbase4.apache.org/44127] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-17 12:13:17,268 DEBUG [Listener at jenkins-hbase4.apache.org/44127] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1847813108_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:13:17,268 DEBUG [Listener at jenkins-hbase4.apache.org/44127] snapshot.TestExportSnapshot(367): hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-07-17 12:13:17,269 DEBUG [Listener at jenkins-hbase4.apache.org/44127] snapshot.TestExportSnapshot(367): hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-07-17 12:13:17,269 DEBUG [Listener at jenkins-hbase4.apache.org/44127] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1847813108_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/export-test/export-1689595980444/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/export-test/export-1689595980444/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:13:17,269 DEBUG [Listener at jenkins-hbase4.apache.org/44127] snapshot.TestExportSnapshot(367): hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/export-test/export-1689595980444/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-07-17 12:13:17,269 DEBUG [Listener at jenkins-hbase4.apache.org/44127] snapshot.TestExportSnapshot(367): hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/export-test/export-1689595980444/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-07-17 12:13:17,275 INFO [Listener at jenkins-hbase4.apache.org/44127] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithSkipTmp 2023-07-17 12:13:17,275 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithSkipTmp 2023-07-17 12:13:17,276 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] procedure2.ProcedureExecutor(1029): Stored pid=114, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-17 12:13:17,280 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-17 12:13:17,280 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689595997280"}]},"ts":"1689595997280"} 2023-07-17 12:13:17,281 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLING in hbase:meta 2023-07-17 12:13:17,282 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLING 2023-07-17 12:13:17,283 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=45118551119c768a9d87e6b5b2014f13, UNASSIGN}, {pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=fae85090b91130b5c2b5f8c32d0317ca, UNASSIGN}] 2023-07-17 12:13:17,285 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=45118551119c768a9d87e6b5b2014f13, UNASSIGN 2023-07-17 12:13:17,285 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=fae85090b91130b5c2b5f8c32d0317ca, UNASSIGN 2023-07-17 12:13:17,287 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=45118551119c768a9d87e6b5b2014f13, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:13:17,287 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=fae85090b91130b5c2b5f8c32d0317ca, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:13:17,287 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689595977481.45118551119c768a9d87e6b5b2014f13.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689595997287"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689595997287"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689595997287"}]},"ts":"1689595997287"} 2023-07-17 12:13:17,287 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689595977481.fae85090b91130b5c2b5f8c32d0317ca.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689595997287"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689595997287"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689595997287"}]},"ts":"1689595997287"} 2023-07-17 12:13:17,288 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=117, ppid=115, state=RUNNABLE; CloseRegionProcedure 45118551119c768a9d87e6b5b2014f13, server=jenkins-hbase4.apache.org,39491,1689595859788}] 2023-07-17 12:13:17,289 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=118, ppid=116, state=RUNNABLE; CloseRegionProcedure fae85090b91130b5c2b5f8c32d0317ca, server=jenkins-hbase4.apache.org,42615,1689595859906}] 2023-07-17 12:13:17,381 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-17 12:13:17,440 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 45118551119c768a9d87e6b5b2014f13 2023-07-17 12:13:17,440 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 45118551119c768a9d87e6b5b2014f13, disabling compactions & flushes 2023-07-17 12:13:17,440 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1689595977481.45118551119c768a9d87e6b5b2014f13. 2023-07-17 12:13:17,440 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689595977481.45118551119c768a9d87e6b5b2014f13. 2023-07-17 12:13:17,440 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689595977481.45118551119c768a9d87e6b5b2014f13. after waiting 0 ms 2023-07-17 12:13:17,440 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1689595977481.45118551119c768a9d87e6b5b2014f13. 2023-07-17 12:13:17,444 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close fae85090b91130b5c2b5f8c32d0317ca 2023-07-17 12:13:17,444 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing fae85090b91130b5c2b5f8c32d0317ca, disabling compactions & flushes 2023-07-17 12:13:17,444 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1689595977481.fae85090b91130b5c2b5f8c32d0317ca. 2023-07-17 12:13:17,444 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689595977481.fae85090b91130b5c2b5f8c32d0317ca. 2023-07-17 12:13:17,444 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689595977481.fae85090b91130b5c2b5f8c32d0317ca. after waiting 0 ms 2023-07-17 12:13:17,444 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1689595977481.fae85090b91130b5c2b5f8c32d0317ca. 2023-07-17 12:13:17,456 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/default/testtb-testExportFileSystemStateWithSkipTmp/45118551119c768a9d87e6b5b2014f13/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-17 12:13:17,456 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/default/testtb-testExportFileSystemStateWithSkipTmp/fae85090b91130b5c2b5f8c32d0317ca/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-17 12:13:17,457 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-17 12:13:17,458 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1689595977481.45118551119c768a9d87e6b5b2014f13. 2023-07-17 12:13:17,458 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 45118551119c768a9d87e6b5b2014f13: 2023-07-17 12:13:17,458 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-17 12:13:17,459 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1689595977481.fae85090b91130b5c2b5f8c32d0317ca. 2023-07-17 12:13:17,459 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for fae85090b91130b5c2b5f8c32d0317ca: 2023-07-17 12:13:17,460 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 45118551119c768a9d87e6b5b2014f13 2023-07-17 12:13:17,460 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=45118551119c768a9d87e6b5b2014f13, regionState=CLOSED 2023-07-17 12:13:17,461 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689595977481.45118551119c768a9d87e6b5b2014f13.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689595997460"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689595997460"}]},"ts":"1689595997460"} 2023-07-17 12:13:17,461 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed fae85090b91130b5c2b5f8c32d0317ca 2023-07-17 12:13:17,461 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=fae85090b91130b5c2b5f8c32d0317ca, regionState=CLOSED 2023-07-17 12:13:17,461 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689595977481.fae85090b91130b5c2b5f8c32d0317ca.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689595997461"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689595997461"}]},"ts":"1689595997461"} 2023-07-17 12:13:17,463 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=117, resume processing ppid=115 2023-07-17 12:13:17,463 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=117, ppid=115, state=SUCCESS; CloseRegionProcedure 45118551119c768a9d87e6b5b2014f13, server=jenkins-hbase4.apache.org,39491,1689595859788 in 174 msec 2023-07-17 12:13:17,464 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=118, resume processing ppid=116 2023-07-17 12:13:17,464 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=118, ppid=116, state=SUCCESS; CloseRegionProcedure fae85090b91130b5c2b5f8c32d0317ca, server=jenkins-hbase4.apache.org,42615,1689595859906 in 173 msec 2023-07-17 12:13:17,465 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=115, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=45118551119c768a9d87e6b5b2014f13, UNASSIGN in 180 msec 2023-07-17 12:13:17,466 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=116, resume processing ppid=114 2023-07-17 12:13:17,466 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=116, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=fae85090b91130b5c2b5f8c32d0317ca, UNASSIGN in 181 msec 2023-07-17 12:13:17,467 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689595997466"}]},"ts":"1689595997466"} 2023-07-17 12:13:17,468 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLED in hbase:meta 2023-07-17 12:13:17,469 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLED 2023-07-17 12:13:17,471 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=114, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 195 msec 2023-07-17 12:13:17,582 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-17 12:13:17,582 INFO [Listener at jenkins-hbase4.apache.org/44127] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 114 completed 2023-07-17 12:13:17,583 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithSkipTmp 2023-07-17 12:13:17,584 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] procedure2.ProcedureExecutor(1029): Stored pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-17 12:13:17,586 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-17 12:13:17,586 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithSkipTmp 2023-07-17 12:13:17,587 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=119, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-17 12:13:17,590 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39491] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithSkipTmp 2023-07-17 12:13:17,594 DEBUG [HFileArchiver-22] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/45118551119c768a9d87e6b5b2014f13 2023-07-17 12:13:17,594 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:39491-0x10173314c9f0001, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-17 12:13:17,594 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:33685-0x10173314c9f0002, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-17 12:13:17,594 DEBUG [HFileArchiver-23] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/fae85090b91130b5c2b5f8c32d0317ca 2023-07-17 12:13:17,594 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:42615-0x10173314c9f0003, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-17 12:13:17,594 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-17 12:13:17,595 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-17 12:13:17,595 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-17 12:13:17,595 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-17 12:13:17,596 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:39491-0x10173314c9f0001, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-17 12:13:17,596 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:33685-0x10173314c9f0002, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-17 12:13:17,596 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:39491-0x10173314c9f0001, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 12:13:17,596 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data null 2023-07-17 12:13:17,596 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-17 12:13:17,596 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 12:13:17,596 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:33685-0x10173314c9f0002, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 12:13:17,596 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:42615-0x10173314c9f0003, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 12:13:17,596 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-17 12:13:17,597 DEBUG [HFileArchiver-22] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/45118551119c768a9d87e6b5b2014f13/cf, FileablePath, hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/45118551119c768a9d87e6b5b2014f13/recovered.edits] 2023-07-17 12:13:17,597 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-17 12:13:17,598 DEBUG [HFileArchiver-23] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/fae85090b91130b5c2b5f8c32d0317ca/cf, FileablePath, hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/fae85090b91130b5c2b5f8c32d0317ca/recovered.edits] 2023-07-17 12:13:17,602 DEBUG [HFileArchiver-22] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/45118551119c768a9d87e6b5b2014f13/cf/d7d1e7fb94564cee943eb99796d79338 to hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/45118551119c768a9d87e6b5b2014f13/cf/d7d1e7fb94564cee943eb99796d79338 2023-07-17 12:13:17,602 DEBUG [HFileArchiver-23] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/fae85090b91130b5c2b5f8c32d0317ca/cf/d4c53e118f9343d4958838da296e8b8f to hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/fae85090b91130b5c2b5f8c32d0317ca/cf/d4c53e118f9343d4958838da296e8b8f 2023-07-17 12:13:17,605 DEBUG [HFileArchiver-22] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/45118551119c768a9d87e6b5b2014f13/recovered.edits/9.seqid to hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/45118551119c768a9d87e6b5b2014f13/recovered.edits/9.seqid 2023-07-17 12:13:17,605 DEBUG [HFileArchiver-23] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/fae85090b91130b5c2b5f8c32d0317ca/recovered.edits/9.seqid to hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/fae85090b91130b5c2b5f8c32d0317ca/recovered.edits/9.seqid 2023-07-17 12:13:17,606 DEBUG [HFileArchiver-22] backup.HFileArchiver(596): Deleted hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/45118551119c768a9d87e6b5b2014f13 2023-07-17 12:13:17,606 DEBUG [HFileArchiver-23] backup.HFileArchiver(596): Deleted hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/fae85090b91130b5c2b5f8c32d0317ca 2023-07-17 12:13:17,606 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-07-17 12:13:17,606 DEBUG [PEWorker-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-07-17 12:13:17,607 DEBUG [PEWorker-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf] 2023-07-17 12:13:17,611 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b2023071724324fa61a12423ead76587c92662666 to hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b2023071724324fa61a12423ead76587c92662666 2023-07-17 12:13:17,612 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230717f8c8db2dcb9642b29966c094b36401b8 to hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230717f8c8db2dcb9642b29966c094b36401b8 2023-07-17 12:13:17,613 DEBUG [PEWorker-5] backup.HFileArchiver(596): Deleted hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-07-17 12:13:17,615 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=119, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-17 12:13:17,618 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithSkipTmp from hbase:meta 2023-07-17 12:13:17,621 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithSkipTmp' descriptor. 2023-07-17 12:13:17,625 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=119, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-17 12:13:17,625 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithSkipTmp' from region states. 2023-07-17 12:13:17,625 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689595977481.45118551119c768a9d87e6b5b2014f13.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689595997625"}]},"ts":"9223372036854775807"} 2023-07-17 12:13:17,625 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689595977481.fae85090b91130b5c2b5f8c32d0317ca.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689595997625"}]},"ts":"9223372036854775807"} 2023-07-17 12:13:17,630 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-17 12:13:17,630 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 45118551119c768a9d87e6b5b2014f13, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689595977481.45118551119c768a9d87e6b5b2014f13.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => fae85090b91130b5c2b5f8c32d0317ca, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689595977481.fae85090b91130b5c2b5f8c32d0317ca.', STARTKEY => '1', ENDKEY => ''}] 2023-07-17 12:13:17,630 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithSkipTmp' as deleted. 2023-07-17 12:13:17,630 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689595997630"}]},"ts":"9223372036854775807"} 2023-07-17 12:13:17,632 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithSkipTmp state from META 2023-07-17 12:13:17,634 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=119, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-17 12:13:17,635 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=119, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 51 msec 2023-07-17 12:13:17,698 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-17 12:13:17,699 INFO [Listener at jenkins-hbase4.apache.org/44127] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 119 completed 2023-07-17 12:13:17,705 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithSkipTmp" 2023-07-17 12:13:17,707 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:13:17,708 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithSkipTmp" 2023-07-17 12:13:17,709 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42013] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:13:17,736 INFO [Listener at jenkins-hbase4.apache.org/44127] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=759 (was 759), OpenFileDescriptor=897 (was 925), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=718 (was 688) - SystemLoadAverage LEAK? -, ProcessCount=183 (was 183), AvailableMemoryMB=979 (was 1468) 2023-07-17 12:13:17,736 WARN [Listener at jenkins-hbase4.apache.org/44127] hbase.ResourceChecker(130): Thread=759 is superior to 500 2023-07-17 12:13:17,736 INFO [Listener at jenkins-hbase4.apache.org/44127] hbase.HBaseTestingUtility(2762): Stopping mini mapreduce cluster... 2023-07-17 12:13:17,747 INFO [Listener at jenkins-hbase4.apache.org/44127] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-17 12:13:21,618 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689595867847_0007_000001 (auth:SIMPLE) 2023-07-17 12:13:23,025 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-17 12:13:31,872 INFO [Listener at jenkins-hbase4.apache.org/44127] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-17 12:13:46,018 ERROR [Thread[Thread-409,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-17 12:13:46,019 INFO [Listener at jenkins-hbase4.apache.org/44127] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-17 12:13:46,020 WARN [336559450@qtp-1955159178-1 - Acceptor0 HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:41619] http.HttpServer2$SelectChannelConnectorWithSafeStartup(546): HttpServer Acceptor: isRunning is false. Rechecking. 2023-07-17 12:13:46,020 WARN [336559450@qtp-1955159178-1 - Acceptor0 HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:41619] http.HttpServer2$SelectChannelConnectorWithSafeStartup(555): HttpServer Acceptor: isRunning is false 2023-07-17 12:13:46,034 WARN [ApplicationMaster Launcher] amlauncher.ApplicationMasterLauncher$LauncherThread(122): org.apache.hadoop.yarn.server.resourcemanager.amlauncher.ApplicationMasterLauncher$LauncherThread interrupted. Returning. 2023-07-17 12:13:46,059 ERROR [SchedulerEventDispatcher:Event Processor] event.EventDispatcher$EventProcessor(61): Returning, interrupted : java.lang.InterruptedException 2023-07-17 12:13:46,062 ERROR [Thread[Thread-419,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-17 12:13:46,097 INFO [Listener at jenkins-hbase4.apache.org/44127] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-17 12:13:46,206 ERROR [Thread[Thread-384,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-17 12:13:46,206 INFO [Listener at jenkins-hbase4.apache.org/44127] hbase.HBaseTestingUtility(2765): Mini mapreduce cluster stopped 2023-07-17 12:13:46,206 INFO [Listener at jenkins-hbase4.apache.org/44127] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-07-17 12:13:46,206 INFO [Listener at jenkins-hbase4.apache.org/44127] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-17 12:13:46,206 DEBUG [Listener at jenkins-hbase4.apache.org/44127] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x33afdcd8 to 127.0.0.1:55622 2023-07-17 12:13:46,206 DEBUG [Listener at jenkins-hbase4.apache.org/44127] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 12:13:46,206 DEBUG [Listener at jenkins-hbase4.apache.org/44127] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-07-17 12:13:46,207 DEBUG [Listener at jenkins-hbase4.apache.org/44127] util.JVMClusterUtil(257): Found active master hash=1245815773, stopped=false 2023-07-17 12:13:46,207 DEBUG [Listener at jenkins-hbase4.apache.org/44127] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-17 12:13:46,207 DEBUG [Listener at jenkins-hbase4.apache.org/44127] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-17 12:13:46,207 INFO [Listener at jenkins-hbase4.apache.org/44127] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,42013,1689595858265 2023-07-17 12:13:46,209 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:39491-0x10173314c9f0001, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-17 12:13:46,209 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:42615-0x10173314c9f0003, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-17 12:13:46,209 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:33685-0x10173314c9f0002, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-17 12:13:46,210 INFO [Listener at jenkins-hbase4.apache.org/44127] procedure2.ProcedureExecutor(629): Stopping 2023-07-17 12:13:46,209 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-17 12:13:46,210 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-17 12:13:46,210 DEBUG [Listener at jenkins-hbase4.apache.org/44127] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x49de9804 to 127.0.0.1:55622 2023-07-17 12:13:46,210 DEBUG [Listener at jenkins-hbase4.apache.org/44127] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 12:13:46,210 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33685-0x10173314c9f0002, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-17 12:13:46,210 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42615-0x10173314c9f0003, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-17 12:13:46,210 INFO [Listener at jenkins-hbase4.apache.org/44127] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,39491,1689595859788' ***** 2023-07-17 12:13:46,210 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39491-0x10173314c9f0001, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-17 12:13:46,211 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-17 12:13:46,211 DEBUG [Listener at jenkins-hbase4.apache.org/44127] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-17 12:13:46,211 INFO [Listener at jenkins-hbase4.apache.org/44127] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-17 12:13:46,211 INFO [Listener at jenkins-hbase4.apache.org/44127] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,33685,1689595859854' ***** 2023-07-17 12:13:46,211 DEBUG [Listener at jenkins-hbase4.apache.org/44127] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-17 12:13:46,211 INFO [Listener at jenkins-hbase4.apache.org/44127] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-17 12:13:46,211 INFO [Listener at jenkins-hbase4.apache.org/44127] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,42615,1689595859906' ***** 2023-07-17 12:13:46,211 DEBUG [Listener at jenkins-hbase4.apache.org/44127] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-17 12:13:46,211 INFO [Listener at jenkins-hbase4.apache.org/44127] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-17 12:13:46,211 INFO [RS:1;jenkins-hbase4:33685] regionserver.HeapMemoryManager(220): Stopping 2023-07-17 12:13:46,211 INFO [RS:0;jenkins-hbase4:39491] regionserver.HeapMemoryManager(220): Stopping 2023-07-17 12:13:46,212 INFO [RS:2;jenkins-hbase4:42615] regionserver.HeapMemoryManager(220): Stopping 2023-07-17 12:13:46,212 INFO [RS:2;jenkins-hbase4:42615] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-17 12:13:46,212 INFO [RS:0;jenkins-hbase4:39491] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-17 12:13:46,212 INFO [RS:2;jenkins-hbase4:42615] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-17 12:13:46,212 INFO [RS:0;jenkins-hbase4:39491] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-17 12:13:46,212 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-17 12:13:46,212 INFO [RS:2;jenkins-hbase4:42615] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:13:46,212 INFO [RS:0;jenkins-hbase4:39491] regionserver.HRegionServer(3305): Received CLOSE for af4fd60aa1dd6d835445a6209c26cbfd 2023-07-17 12:13:46,212 DEBUG [RS:2;jenkins-hbase4:42615] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x369d3ad4 to 127.0.0.1:55622 2023-07-17 12:13:46,212 DEBUG [RS:2;jenkins-hbase4:42615] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 12:13:46,215 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-17 12:13:46,215 INFO [RS:2;jenkins-hbase4:42615] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,42615,1689595859906; all regions closed. 2023-07-17 12:13:46,215 INFO [RS:0;jenkins-hbase4:39491] regionserver.HRegionServer(3305): Received CLOSE for 81856128cd0e8d95ff069a63b0ef1b04 2023-07-17 12:13:46,215 INFO [RS:0;jenkins-hbase4:39491] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:13:46,215 INFO [RS:1;jenkins-hbase4:33685] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-17 12:13:46,215 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-17 12:13:46,216 INFO [RS:1;jenkins-hbase4:33685] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-17 12:13:46,216 INFO [RS:1;jenkins-hbase4:33685] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:13:46,216 DEBUG [RS:1;jenkins-hbase4:33685] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x409d28e9 to 127.0.0.1:55622 2023-07-17 12:13:46,216 DEBUG [RS:1;jenkins-hbase4:33685] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 12:13:46,216 DEBUG [RS:0;jenkins-hbase4:39491] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x711ee0b2 to 127.0.0.1:55622 2023-07-17 12:13:46,216 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing af4fd60aa1dd6d835445a6209c26cbfd, disabling compactions & flushes 2023-07-17 12:13:46,217 DEBUG [RS:0;jenkins-hbase4:39491] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 12:13:46,217 INFO [RS:1;jenkins-hbase4:33685] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-17 12:13:46,217 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-17 12:13:46,217 INFO [RS:1;jenkins-hbase4:33685] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-17 12:13:46,217 INFO [RS:0;jenkins-hbase4:39491] regionserver.HRegionServer(1474): Waiting on 2 regions to close 2023-07-17 12:13:46,217 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689595862786.af4fd60aa1dd6d835445a6209c26cbfd. 2023-07-17 12:13:46,218 DEBUG [RS:0;jenkins-hbase4:39491] regionserver.HRegionServer(1478): Online Regions={af4fd60aa1dd6d835445a6209c26cbfd=hbase:namespace,,1689595862786.af4fd60aa1dd6d835445a6209c26cbfd., 81856128cd0e8d95ff069a63b0ef1b04=hbase:acl,,1689595863681.81856128cd0e8d95ff069a63b0ef1b04.} 2023-07-17 12:13:46,218 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689595862786.af4fd60aa1dd6d835445a6209c26cbfd. 2023-07-17 12:13:46,218 INFO [RS:1;jenkins-hbase4:33685] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-17 12:13:46,218 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689595862786.af4fd60aa1dd6d835445a6209c26cbfd. after waiting 0 ms 2023-07-17 12:13:46,218 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689595862786.af4fd60aa1dd6d835445a6209c26cbfd. 2023-07-17 12:13:46,218 INFO [RS:1;jenkins-hbase4:33685] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-07-17 12:13:46,218 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing af4fd60aa1dd6d835445a6209c26cbfd 1/1 column families, dataSize=78 B heapSize=488 B 2023-07-17 12:13:46,218 INFO [RS:1;jenkins-hbase4:33685] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-07-17 12:13:46,219 DEBUG [RS:1;jenkins-hbase4:33685] regionserver.HRegionServer(1478): Online Regions={1588230740=hbase:meta,,1.1588230740} 2023-07-17 12:13:46,219 DEBUG [RS:0;jenkins-hbase4:39491] regionserver.HRegionServer(1504): Waiting on 81856128cd0e8d95ff069a63b0ef1b04, af4fd60aa1dd6d835445a6209c26cbfd 2023-07-17 12:13:46,219 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-17 12:13:46,219 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-17 12:13:46,219 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-17 12:13:46,220 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-17 12:13:46,220 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-17 12:13:46,220 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=45.93 KB heapSize=71.92 KB 2023-07-17 12:13:46,219 DEBUG [RS:1;jenkins-hbase4:33685] regionserver.HRegionServer(1504): Waiting on 1588230740 2023-07-17 12:13:46,243 DEBUG [RS:2;jenkins-hbase4:42615] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/oldWALs 2023-07-17 12:13:46,243 INFO [RS:2;jenkins-hbase4:42615] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C42615%2C1689595859906:(num 1689595862204) 2023-07-17 12:13:46,244 DEBUG [RS:2;jenkins-hbase4:42615] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 12:13:46,244 INFO [RS:2;jenkins-hbase4:42615] regionserver.LeaseManager(133): Closed leases 2023-07-17 12:13:46,244 INFO [RS:2;jenkins-hbase4:42615] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-07-17 12:13:46,244 INFO [RS:2;jenkins-hbase4:42615] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-17 12:13:46,244 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-17 12:13:46,244 INFO [RS:2;jenkins-hbase4:42615] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-17 12:13:46,244 INFO [RS:2;jenkins-hbase4:42615] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-17 12:13:46,246 INFO [RS:2;jenkins-hbase4:42615] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:42615 2023-07-17 12:13:46,252 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:33685-0x10173314c9f0002, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:13:46,252 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:42615-0x10173314c9f0003, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:13:46,252 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:42615-0x10173314c9f0003, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-17 12:13:46,252 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-17 12:13:46,252 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:33685-0x10173314c9f0002, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-17 12:13:46,252 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:39491-0x10173314c9f0001, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,42615,1689595859906 2023-07-17 12:13:46,253 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:39491-0x10173314c9f0001, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-17 12:13:46,256 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,42615,1689595859906] 2023-07-17 12:13:46,259 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,42615,1689595859906; numProcessing=1 2023-07-17 12:13:46,263 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,42615,1689595859906 already deleted, retry=false 2023-07-17 12:13:46,263 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,42615,1689595859906 expired; onlineServers=2 2023-07-17 12:13:46,268 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/hbase/namespace/af4fd60aa1dd6d835445a6209c26cbfd/.tmp/info/80054e26792b473b85c0c6871edd887b 2023-07-17 12:13:46,269 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=40.45 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/hbase/meta/1588230740/.tmp/info/89589c80f0014625822bcaed2381424e 2023-07-17 12:13:46,269 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-17 12:13:46,273 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 89589c80f0014625822bcaed2381424e 2023-07-17 12:13:46,274 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/hbase/namespace/af4fd60aa1dd6d835445a6209c26cbfd/.tmp/info/80054e26792b473b85c0c6871edd887b as hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/hbase/namespace/af4fd60aa1dd6d835445a6209c26cbfd/info/80054e26792b473b85c0c6871edd887b 2023-07-17 12:13:46,278 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/hbase/namespace/af4fd60aa1dd6d835445a6209c26cbfd/info/80054e26792b473b85c0c6871edd887b, entries=2, sequenceid=6, filesize=4.8 K 2023-07-17 12:13:46,279 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for af4fd60aa1dd6d835445a6209c26cbfd in 61ms, sequenceid=6, compaction requested=false 2023-07-17 12:13:46,287 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/hbase/namespace/af4fd60aa1dd6d835445a6209c26cbfd/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-17 12:13:46,288 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-17 12:13:46,288 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689595862786.af4fd60aa1dd6d835445a6209c26cbfd. 2023-07-17 12:13:46,288 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-17 12:13:46,288 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for af4fd60aa1dd6d835445a6209c26cbfd: 2023-07-17 12:13:46,288 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1689595862786.af4fd60aa1dd6d835445a6209c26cbfd. 2023-07-17 12:13:46,289 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.50 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/hbase/meta/1588230740/.tmp/rep_barrier/c48447b443454c3a936bfe9b17049624 2023-07-17 12:13:46,289 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 81856128cd0e8d95ff069a63b0ef1b04, disabling compactions & flushes 2023-07-17 12:13:46,289 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:acl,,1689595863681.81856128cd0e8d95ff069a63b0ef1b04. 2023-07-17 12:13:46,289 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1689595863681.81856128cd0e8d95ff069a63b0ef1b04. 2023-07-17 12:13:46,289 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1689595863681.81856128cd0e8d95ff069a63b0ef1b04. after waiting 0 ms 2023-07-17 12:13:46,289 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1689595863681.81856128cd0e8d95ff069a63b0ef1b04. 2023-07-17 12:13:46,289 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 81856128cd0e8d95ff069a63b0ef1b04 1/1 column families, dataSize=914 B heapSize=2.17 KB 2023-07-17 12:13:46,293 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c48447b443454c3a936bfe9b17049624 2023-07-17 12:13:46,310 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=914 B at sequenceid=18 (bloomFilter=false), to=hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/hbase/acl/81856128cd0e8d95ff069a63b0ef1b04/.tmp/l/279a4c6673b440438e5500bd4cd5dd99 2023-07-17 12:13:46,311 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.98 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/hbase/meta/1588230740/.tmp/table/e16e53472c70444992bacbc11a4dc4ab 2023-07-17 12:13:46,316 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 279a4c6673b440438e5500bd4cd5dd99 2023-07-17 12:13:46,317 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/hbase/acl/81856128cd0e8d95ff069a63b0ef1b04/.tmp/l/279a4c6673b440438e5500bd4cd5dd99 as hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/hbase/acl/81856128cd0e8d95ff069a63b0ef1b04/l/279a4c6673b440438e5500bd4cd5dd99 2023-07-17 12:13:46,324 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e16e53472c70444992bacbc11a4dc4ab 2023-07-17 12:13:46,325 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/hbase/meta/1588230740/.tmp/info/89589c80f0014625822bcaed2381424e as hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/hbase/meta/1588230740/info/89589c80f0014625822bcaed2381424e 2023-07-17 12:13:46,329 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 279a4c6673b440438e5500bd4cd5dd99 2023-07-17 12:13:46,329 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/hbase/acl/81856128cd0e8d95ff069a63b0ef1b04/l/279a4c6673b440438e5500bd4cd5dd99, entries=7, sequenceid=18, filesize=5.2 K 2023-07-17 12:13:46,330 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~914 B/914, heapSize ~2.16 KB/2208, currentSize=0 B/0 for 81856128cd0e8d95ff069a63b0ef1b04 in 41ms, sequenceid=18, compaction requested=false 2023-07-17 12:13:46,333 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 89589c80f0014625822bcaed2381424e 2023-07-17 12:13:46,333 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/hbase/meta/1588230740/info/89589c80f0014625822bcaed2381424e, entries=48, sequenceid=131, filesize=10.3 K 2023-07-17 12:13:46,334 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/hbase/meta/1588230740/.tmp/rep_barrier/c48447b443454c3a936bfe9b17049624 as hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/hbase/meta/1588230740/rep_barrier/c48447b443454c3a936bfe9b17049624 2023-07-17 12:13:46,339 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/hbase/acl/81856128cd0e8d95ff069a63b0ef1b04/recovered.edits/21.seqid, newMaxSeqId=21, maxSeqId=1 2023-07-17 12:13:46,340 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-17 12:13:46,340 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:acl,,1689595863681.81856128cd0e8d95ff069a63b0ef1b04. 2023-07-17 12:13:46,341 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 81856128cd0e8d95ff069a63b0ef1b04: 2023-07-17 12:13:46,341 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:acl,,1689595863681.81856128cd0e8d95ff069a63b0ef1b04. 2023-07-17 12:13:46,341 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c48447b443454c3a936bfe9b17049624 2023-07-17 12:13:46,341 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/hbase/meta/1588230740/rep_barrier/c48447b443454c3a936bfe9b17049624, entries=13, sequenceid=131, filesize=6.4 K 2023-07-17 12:13:46,342 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/hbase/meta/1588230740/.tmp/table/e16e53472c70444992bacbc11a4dc4ab as hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/hbase/meta/1588230740/table/e16e53472c70444992bacbc11a4dc4ab 2023-07-17 12:13:46,346 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e16e53472c70444992bacbc11a4dc4ab 2023-07-17 12:13:46,346 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/hbase/meta/1588230740/table/e16e53472c70444992bacbc11a4dc4ab, entries=24, sequenceid=131, filesize=6.9 K 2023-07-17 12:13:46,347 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~45.93 KB/47028, heapSize ~71.88 KB/73600, currentSize=0 B/0 for 1588230740 in 127ms, sequenceid=131, compaction requested=false 2023-07-17 12:13:46,354 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:42615-0x10173314c9f0003, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-17 12:13:46,354 INFO [RS:2;jenkins-hbase4:42615] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,42615,1689595859906; zookeeper connection closed. 2023-07-17 12:13:46,355 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:42615-0x10173314c9f0003, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-17 12:13:46,357 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@751860be] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@751860be 2023-07-17 12:13:46,360 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/data/hbase/meta/1588230740/recovered.edits/134.seqid, newMaxSeqId=134, maxSeqId=1 2023-07-17 12:13:46,361 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-17 12:13:46,361 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-17 12:13:46,361 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-17 12:13:46,362 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-17 12:13:46,362 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-07-17 12:13:46,419 INFO [RS:0;jenkins-hbase4:39491] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,39491,1689595859788; all regions closed. 2023-07-17 12:13:46,420 INFO [RS:1;jenkins-hbase4:33685] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,33685,1689595859854; all regions closed. 2023-07-17 12:13:46,427 WARN [Close-WAL-Writer-0] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(641): complete file /user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/WALs/jenkins-hbase4.apache.org,33685,1689595859854/jenkins-hbase4.apache.org%2C33685%2C1689595859854.meta.1689595862383.meta not finished, retry = 0 2023-07-17 12:13:46,429 DEBUG [RS:0;jenkins-hbase4:39491] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/oldWALs 2023-07-17 12:13:46,429 INFO [RS:0;jenkins-hbase4:39491] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C39491%2C1689595859788:(num 1689595862205) 2023-07-17 12:13:46,429 DEBUG [RS:0;jenkins-hbase4:39491] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 12:13:46,429 INFO [RS:0;jenkins-hbase4:39491] regionserver.LeaseManager(133): Closed leases 2023-07-17 12:13:46,429 INFO [RS:0;jenkins-hbase4:39491] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-07-17 12:13:46,430 INFO [RS:0;jenkins-hbase4:39491] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-17 12:13:46,430 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-17 12:13:46,430 INFO [RS:0;jenkins-hbase4:39491] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-17 12:13:46,430 INFO [RS:0;jenkins-hbase4:39491] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-17 12:13:46,457 INFO [RS:0;jenkins-hbase4:39491] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:39491 2023-07-17 12:13:46,461 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:33685-0x10173314c9f0002, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:13:46,461 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:39491-0x10173314c9f0001, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,39491,1689595859788 2023-07-17 12:13:46,461 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-17 12:13:46,463 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,39491,1689595859788] 2023-07-17 12:13:46,463 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,39491,1689595859788; numProcessing=2 2023-07-17 12:13:46,465 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,39491,1689595859788 already deleted, retry=false 2023-07-17 12:13:46,465 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,39491,1689595859788 expired; onlineServers=1 2023-07-17 12:13:46,529 DEBUG [RS:1;jenkins-hbase4:33685] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/oldWALs 2023-07-17 12:13:46,529 INFO [RS:1;jenkins-hbase4:33685] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C33685%2C1689595859854.meta:.meta(num 1689595862383) 2023-07-17 12:13:46,536 DEBUG [RS:1;jenkins-hbase4:33685] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/oldWALs 2023-07-17 12:13:46,536 INFO [RS:1;jenkins-hbase4:33685] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C33685%2C1689595859854:(num 1689595862212) 2023-07-17 12:13:46,536 DEBUG [RS:1;jenkins-hbase4:33685] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 12:13:46,536 INFO [RS:1;jenkins-hbase4:33685] regionserver.LeaseManager(133): Closed leases 2023-07-17 12:13:46,537 INFO [RS:1;jenkins-hbase4:33685] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-07-17 12:13:46,537 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-17 12:13:46,539 INFO [RS:1;jenkins-hbase4:33685] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:33685 2023-07-17 12:13:46,540 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-17 12:13:46,540 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:33685-0x10173314c9f0002, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,33685,1689595859854 2023-07-17 12:13:46,541 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,33685,1689595859854] 2023-07-17 12:13:46,541 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,33685,1689595859854; numProcessing=3 2023-07-17 12:13:46,545 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,33685,1689595859854 already deleted, retry=false 2023-07-17 12:13:46,545 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,33685,1689595859854 expired; onlineServers=0 2023-07-17 12:13:46,545 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,42013,1689595858265' ***** 2023-07-17 12:13:46,545 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-07-17 12:13:46,545 DEBUG [M:0;jenkins-hbase4:42013] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@b7ca9e6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-17 12:13:46,545 INFO [M:0;jenkins-hbase4:42013] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,42013,1689595858265 2023-07-17 12:13:46,545 INFO [M:0;jenkins-hbase4:42013] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,42013,1689595858265; all regions closed. 2023-07-17 12:13:46,545 DEBUG [M:0;jenkins-hbase4:42013] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 12:13:46,545 DEBUG [M:0;jenkins-hbase4:42013] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-07-17 12:13:46,545 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-07-17 12:13:46,546 DEBUG [M:0;jenkins-hbase4:42013] cleaner.HFileCleaner(317): Stopping file delete threads 2023-07-17 12:13:46,546 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689595861651] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689595861651,5,FailOnTimeoutGroup] 2023-07-17 12:13:46,546 INFO [M:0;jenkins-hbase4:42013] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-07-17 12:13:46,546 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689595861652] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689595861652,5,FailOnTimeoutGroup] 2023-07-17 12:13:46,546 INFO [M:0;jenkins-hbase4:42013] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-07-17 12:13:46,546 INFO [M:0;jenkins-hbase4:42013] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-07-17 12:13:46,546 DEBUG [M:0;jenkins-hbase4:42013] master.HMaster(1512): Stopping service threads 2023-07-17 12:13:46,546 INFO [M:0;jenkins-hbase4:42013] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-07-17 12:13:46,546 ERROR [M:0;jenkins-hbase4:42013] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-22,5,PEWorkerGroup] 2023-07-17 12:13:46,546 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master Thread[HFileArchiver-23,5,PEWorkerGroup] 2023-07-17 12:13:46,547 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-17 12:13:46,547 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-17 12:13:46,547 INFO [M:0;jenkins-hbase4:42013] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-07-17 12:13:46,548 DEBUG [M:0;jenkins-hbase4:42013] zookeeper.ZKUtil(398): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-07-17 12:13:46,548 WARN [M:0;jenkins-hbase4:42013] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-07-17 12:13:46,548 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-07-17 12:13:46,548 INFO [M:0;jenkins-hbase4:42013] assignment.AssignmentManager(315): Stopping assignment manager 2023-07-17 12:13:46,548 INFO [M:0;jenkins-hbase4:42013] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-07-17 12:13:46,549 DEBUG [M:0;jenkins-hbase4:42013] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-17 12:13:46,549 INFO [M:0;jenkins-hbase4:42013] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-17 12:13:46,549 DEBUG [M:0;jenkins-hbase4:42013] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-17 12:13:46,549 DEBUG [M:0;jenkins-hbase4:42013] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-17 12:13:46,549 DEBUG [M:0;jenkins-hbase4:42013] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-17 12:13:46,549 INFO [M:0;jenkins-hbase4:42013] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=375.84 KB heapSize=452.13 KB 2023-07-17 12:13:46,564 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:39491-0x10173314c9f0001, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-17 12:13:46,564 INFO [RS:0;jenkins-hbase4:39491] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,39491,1689595859788; zookeeper connection closed. 2023-07-17 12:13:46,564 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:39491-0x10173314c9f0001, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-17 12:13:46,567 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@2660d273] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@2660d273 2023-07-17 12:13:46,571 INFO [M:0;jenkins-hbase4:42013] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=375.84 KB at sequenceid=899 (bloomFilter=true), to=hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/48ea2db0f490456581f7b64905646faf 2023-07-17 12:13:46,576 INFO [M:0;jenkins-hbase4:42013] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 48ea2db0f490456581f7b64905646faf 2023-07-17 12:13:46,576 DEBUG [M:0;jenkins-hbase4:42013] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/48ea2db0f490456581f7b64905646faf as hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/48ea2db0f490456581f7b64905646faf 2023-07-17 12:13:46,580 INFO [M:0;jenkins-hbase4:42013] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 48ea2db0f490456581f7b64905646faf 2023-07-17 12:13:46,580 INFO [M:0;jenkins-hbase4:42013] regionserver.HStore(1080): Added hdfs://localhost:46215/user/jenkins/test-data/b4821002-6e3c-d6f0-a601-d353aa9e475b/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/48ea2db0f490456581f7b64905646faf, entries=119, sequenceid=899, filesize=28.7 K 2023-07-17 12:13:46,581 INFO [M:0;jenkins-hbase4:42013] regionserver.HRegion(2948): Finished flush of dataSize ~375.84 KB/384860, heapSize ~452.11 KB/462960, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 32ms, sequenceid=899, compaction requested=false 2023-07-17 12:13:46,582 INFO [M:0;jenkins-hbase4:42013] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-17 12:13:46,582 DEBUG [M:0;jenkins-hbase4:42013] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-17 12:13:46,586 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-17 12:13:46,586 INFO [M:0;jenkins-hbase4:42013] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-07-17 12:13:46,587 INFO [M:0;jenkins-hbase4:42013] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:42013 2023-07-17 12:13:46,588 DEBUG [M:0;jenkins-hbase4:42013] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,42013,1689595858265 already deleted, retry=false 2023-07-17 12:13:46,664 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:33685-0x10173314c9f0002, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-17 12:13:46,664 INFO [RS:1;jenkins-hbase4:33685] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,33685,1689595859854; zookeeper connection closed. 2023-07-17 12:13:46,664 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): regionserver:33685-0x10173314c9f0002, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-17 12:13:46,664 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@7ddc8175] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@7ddc8175 2023-07-17 12:13:46,664 INFO [Listener at jenkins-hbase4.apache.org/44127] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 3 regionserver(s) complete 2023-07-17 12:13:46,764 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-17 12:13:46,764 INFO [M:0;jenkins-hbase4:42013] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,42013,1689595858265; zookeeper connection closed. 2023-07-17 12:13:46,764 DEBUG [Listener at localhost/44083-EventThread] zookeeper.ZKWatcher(600): master:42013-0x10173314c9f0000, quorum=127.0.0.1:55622, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-17 12:13:46,766 WARN [Listener at jenkins-hbase4.apache.org/44127] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-17 12:13:46,771 INFO [Listener at jenkins-hbase4.apache.org/44127] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-17 12:13:46,875 WARN [BP-1557304133-172.31.14.131-1689595854283 heartbeating to localhost/127.0.0.1:46215] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-17 12:13:46,875 WARN [BP-1557304133-172.31.14.131-1689595854283 heartbeating to localhost/127.0.0.1:46215] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1557304133-172.31.14.131-1689595854283 (Datanode Uuid 29e2ec77-bce9-47bd-90c1-a35f8cbadef3) service to localhost/127.0.0.1:46215 2023-07-17 12:13:46,878 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58af5705-0594-af5f-981c-fa1d3b267fab/cluster_dbe17dd1-5343-f0e6-c8ea-53484480c8b1/dfs/data/data5/current/BP-1557304133-172.31.14.131-1689595854283] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-17 12:13:46,878 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58af5705-0594-af5f-981c-fa1d3b267fab/cluster_dbe17dd1-5343-f0e6-c8ea-53484480c8b1/dfs/data/data6/current/BP-1557304133-172.31.14.131-1689595854283] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-17 12:13:46,880 WARN [Listener at jenkins-hbase4.apache.org/44127] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-17 12:13:46,885 INFO [Listener at jenkins-hbase4.apache.org/44127] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-17 12:13:46,891 WARN [BP-1557304133-172.31.14.131-1689595854283 heartbeating to localhost/127.0.0.1:46215] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-17 12:13:46,891 WARN [BP-1557304133-172.31.14.131-1689595854283 heartbeating to localhost/127.0.0.1:46215] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1557304133-172.31.14.131-1689595854283 (Datanode Uuid 0b3c9637-1daf-471d-b2bd-b82b7cf75d3b) service to localhost/127.0.0.1:46215 2023-07-17 12:13:46,892 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58af5705-0594-af5f-981c-fa1d3b267fab/cluster_dbe17dd1-5343-f0e6-c8ea-53484480c8b1/dfs/data/data3/current/BP-1557304133-172.31.14.131-1689595854283] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-17 12:13:46,893 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58af5705-0594-af5f-981c-fa1d3b267fab/cluster_dbe17dd1-5343-f0e6-c8ea-53484480c8b1/dfs/data/data4/current/BP-1557304133-172.31.14.131-1689595854283] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-17 12:13:46,894 WARN [Listener at jenkins-hbase4.apache.org/44127] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-17 12:13:46,904 INFO [Listener at jenkins-hbase4.apache.org/44127] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-17 12:13:47,008 WARN [BP-1557304133-172.31.14.131-1689595854283 heartbeating to localhost/127.0.0.1:46215] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-17 12:13:47,008 WARN [BP-1557304133-172.31.14.131-1689595854283 heartbeating to localhost/127.0.0.1:46215] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1557304133-172.31.14.131-1689595854283 (Datanode Uuid d5207fdc-f249-451d-bf35-df0d5e2c2b7d) service to localhost/127.0.0.1:46215 2023-07-17 12:13:47,009 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58af5705-0594-af5f-981c-fa1d3b267fab/cluster_dbe17dd1-5343-f0e6-c8ea-53484480c8b1/dfs/data/data1/current/BP-1557304133-172.31.14.131-1689595854283] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-17 12:13:47,009 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58af5705-0594-af5f-981c-fa1d3b267fab/cluster_dbe17dd1-5343-f0e6-c8ea-53484480c8b1/dfs/data/data2/current/BP-1557304133-172.31.14.131-1689595854283] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-17 12:13:47,033 INFO [Listener at jenkins-hbase4.apache.org/44127] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-17 12:13:47,162 INFO [Listener at jenkins-hbase4.apache.org/44127] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-07-17 12:13:47,254 INFO [Listener at jenkins-hbase4.apache.org/44127] hbase.HBaseTestingUtility(1293): Minicluster is down