2023-07-24 23:06:02,595 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestExportSnapshot timeout: 13 mins 2023-07-24 23:06:02,846 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/40a10de8-ef1a-d60f-e3da-b5fca02ca095 2023-07-24 23:06:02,847 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestSecureExportSnapshot timeout: 13 mins 2023-07-24 23:06:02,883 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-07-24 23:06:03,136 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=3, rsPorts=, rsClass=null, numDataNodes=3, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-07-24 23:06:03,137 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/40a10de8-ef1a-d60f-e3da-b5fca02ca095/cluster_8078c43e-6fde-7452-062d-548ef0e9fbe8, deleteOnExit=true 2023-07-24 23:06:03,137 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-07-24 23:06:03,138 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/40a10de8-ef1a-d60f-e3da-b5fca02ca095/test.cache.data in system properties and HBase conf 2023-07-24 23:06:03,138 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/40a10de8-ef1a-d60f-e3da-b5fca02ca095/hadoop.tmp.dir in system properties and HBase conf 2023-07-24 23:06:03,139 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/40a10de8-ef1a-d60f-e3da-b5fca02ca095/hadoop.log.dir in system properties and HBase conf 2023-07-24 23:06:03,139 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/40a10de8-ef1a-d60f-e3da-b5fca02ca095/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-24 23:06:03,140 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/40a10de8-ef1a-d60f-e3da-b5fca02ca095/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-24 23:06:03,140 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-24 23:06:03,532 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-07-24 23:06:03,537 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/40a10de8-ef1a-d60f-e3da-b5fca02ca095/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-24 23:06:03,538 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/40a10de8-ef1a-d60f-e3da-b5fca02ca095/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-24 23:06:03,538 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/40a10de8-ef1a-d60f-e3da-b5fca02ca095/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-24 23:06:03,538 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/40a10de8-ef1a-d60f-e3da-b5fca02ca095/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-24 23:06:03,539 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/40a10de8-ef1a-d60f-e3da-b5fca02ca095/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-24 23:06:03,539 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/40a10de8-ef1a-d60f-e3da-b5fca02ca095/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-24 23:06:03,540 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/40a10de8-ef1a-d60f-e3da-b5fca02ca095/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-24 23:06:03,540 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/40a10de8-ef1a-d60f-e3da-b5fca02ca095/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-24 23:06:03,541 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/40a10de8-ef1a-d60f-e3da-b5fca02ca095/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-24 23:06:03,541 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/40a10de8-ef1a-d60f-e3da-b5fca02ca095/nfs.dump.dir in system properties and HBase conf 2023-07-24 23:06:03,541 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/40a10de8-ef1a-d60f-e3da-b5fca02ca095/java.io.tmpdir in system properties and HBase conf 2023-07-24 23:06:03,542 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/40a10de8-ef1a-d60f-e3da-b5fca02ca095/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-24 23:06:03,542 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/40a10de8-ef1a-d60f-e3da-b5fca02ca095/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-24 23:06:03,543 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/40a10de8-ef1a-d60f-e3da-b5fca02ca095/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-07-24 23:06:04,149 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-24 23:06:04,153 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-24 23:06:04,423 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-07-24 23:06:04,602 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-07-24 23:06:04,620 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-24 23:06:04,656 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-07-24 23:06:04,689 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/40a10de8-ef1a-d60f-e3da-b5fca02ca095/java.io.tmpdir/Jetty_localhost_41545_hdfs____jreutf/webapp 2023-07-24 23:06:04,844 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:41545 2023-07-24 23:06:04,880 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-24 23:06:04,881 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-24 23:06:05,446 WARN [Listener at localhost/37611] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-24 23:06:05,542 WARN [Listener at localhost/37611] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-24 23:06:05,562 WARN [Listener at localhost/37611] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-24 23:06:05,570 INFO [Listener at localhost/37611] log.Slf4jLog(67): jetty-6.1.26 2023-07-24 23:06:05,575 INFO [Listener at localhost/37611] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/40a10de8-ef1a-d60f-e3da-b5fca02ca095/java.io.tmpdir/Jetty_localhost_44033_datanode____ar9ddj/webapp 2023-07-24 23:06:05,683 INFO [Listener at localhost/37611] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:44033 2023-07-24 23:06:06,213 WARN [Listener at localhost/44289] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-24 23:06:06,273 WARN [Listener at localhost/44289] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-24 23:06:06,282 WARN [Listener at localhost/44289] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-24 23:06:06,284 INFO [Listener at localhost/44289] log.Slf4jLog(67): jetty-6.1.26 2023-07-24 23:06:06,289 INFO [Listener at localhost/44289] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/40a10de8-ef1a-d60f-e3da-b5fca02ca095/java.io.tmpdir/Jetty_localhost_38325_datanode____s1zyjc/webapp 2023-07-24 23:06:06,419 INFO [Listener at localhost/44289] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:38325 2023-07-24 23:06:06,446 WARN [Listener at localhost/45179] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-24 23:06:06,496 WARN [Listener at localhost/45179] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-24 23:06:06,510 WARN [Listener at localhost/45179] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-24 23:06:06,513 INFO [Listener at localhost/45179] log.Slf4jLog(67): jetty-6.1.26 2023-07-24 23:06:06,539 INFO [Listener at localhost/45179] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/40a10de8-ef1a-d60f-e3da-b5fca02ca095/java.io.tmpdir/Jetty_localhost_39997_datanode____txxd94/webapp 2023-07-24 23:06:06,683 INFO [Listener at localhost/45179] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:39997 2023-07-24 23:06:06,725 WARN [Listener at localhost/35321] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-24 23:06:06,988 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xc47614c43f0b22eb: Processing first storage report for DS-66e6fea1-5a80-4bc6-b43a-474a66b9400c from datanode b5027cd5-49e0-442c-b538-32219f13e7ec 2023-07-24 23:06:06,990 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xc47614c43f0b22eb: from storage DS-66e6fea1-5a80-4bc6-b43a-474a66b9400c node DatanodeRegistration(127.0.0.1:36657, datanodeUuid=b5027cd5-49e0-442c-b538-32219f13e7ec, infoPort=36199, infoSecurePort=0, ipcPort=45179, storageInfo=lv=-57;cid=testClusterID;nsid=1343369283;c=1690239964228), blocks: 0, hasStaleStorage: true, processing time: 2 msecs, invalidatedBlocks: 0 2023-07-24 23:06:06,991 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x11376350b6cfe7e2: Processing first storage report for DS-f8e20b7b-3643-4c92-b6c4-0340e1d89c6b from datanode 412770a8-1c86-4606-af47-63555c1c339e 2023-07-24 23:06:06,991 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x11376350b6cfe7e2: from storage DS-f8e20b7b-3643-4c92-b6c4-0340e1d89c6b node DatanodeRegistration(127.0.0.1:40129, datanodeUuid=412770a8-1c86-4606-af47-63555c1c339e, infoPort=44295, infoSecurePort=0, ipcPort=44289, storageInfo=lv=-57;cid=testClusterID;nsid=1343369283;c=1690239964228), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-24 23:06:06,991 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xc47614c43f0b22eb: Processing first storage report for DS-43d37b45-9f14-4d24-b31a-efd2787d6d02 from datanode b5027cd5-49e0-442c-b538-32219f13e7ec 2023-07-24 23:06:06,991 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xc47614c43f0b22eb: from storage DS-43d37b45-9f14-4d24-b31a-efd2787d6d02 node DatanodeRegistration(127.0.0.1:36657, datanodeUuid=b5027cd5-49e0-442c-b538-32219f13e7ec, infoPort=36199, infoSecurePort=0, ipcPort=45179, storageInfo=lv=-57;cid=testClusterID;nsid=1343369283;c=1690239964228), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-24 23:06:06,991 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x11376350b6cfe7e2: Processing first storage report for DS-5a2a372d-e43b-4f33-a942-b7b3ad701536 from datanode 412770a8-1c86-4606-af47-63555c1c339e 2023-07-24 23:06:06,992 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x11376350b6cfe7e2: from storage DS-5a2a372d-e43b-4f33-a942-b7b3ad701536 node DatanodeRegistration(127.0.0.1:40129, datanodeUuid=412770a8-1c86-4606-af47-63555c1c339e, infoPort=44295, infoSecurePort=0, ipcPort=44289, storageInfo=lv=-57;cid=testClusterID;nsid=1343369283;c=1690239964228), blocks: 0, hasStaleStorage: false, processing time: 1 msecs, invalidatedBlocks: 0 2023-07-24 23:06:07,052 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xda39aa34775792f3: Processing first storage report for DS-04e90ef6-6ea5-4593-9443-06063165d08a from datanode b06a4373-d70b-4af2-84a5-113626559784 2023-07-24 23:06:07,052 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xda39aa34775792f3: from storage DS-04e90ef6-6ea5-4593-9443-06063165d08a node DatanodeRegistration(127.0.0.1:41237, datanodeUuid=b06a4373-d70b-4af2-84a5-113626559784, infoPort=37907, infoSecurePort=0, ipcPort=35321, storageInfo=lv=-57;cid=testClusterID;nsid=1343369283;c=1690239964228), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-24 23:06:07,052 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xda39aa34775792f3: Processing first storage report for DS-47e72433-9ee2-4bd8-92ad-80f1315cb45a from datanode b06a4373-d70b-4af2-84a5-113626559784 2023-07-24 23:06:07,052 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xda39aa34775792f3: from storage DS-47e72433-9ee2-4bd8-92ad-80f1315cb45a node DatanodeRegistration(127.0.0.1:41237, datanodeUuid=b06a4373-d70b-4af2-84a5-113626559784, infoPort=37907, infoSecurePort=0, ipcPort=35321, storageInfo=lv=-57;cid=testClusterID;nsid=1343369283;c=1690239964228), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-24 23:06:07,252 DEBUG [Listener at localhost/35321] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/40a10de8-ef1a-d60f-e3da-b5fca02ca095 2023-07-24 23:06:07,373 INFO [Listener at localhost/35321] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/40a10de8-ef1a-d60f-e3da-b5fca02ca095/cluster_8078c43e-6fde-7452-062d-548ef0e9fbe8/zookeeper_0, clientPort=52881, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/40a10de8-ef1a-d60f-e3da-b5fca02ca095/cluster_8078c43e-6fde-7452-062d-548ef0e9fbe8/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/40a10de8-ef1a-d60f-e3da-b5fca02ca095/cluster_8078c43e-6fde-7452-062d-548ef0e9fbe8/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-07-24 23:06:07,397 INFO [Listener at localhost/35321] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=52881 2023-07-24 23:06:07,408 INFO [Listener at localhost/35321] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-24 23:06:07,412 INFO [Listener at localhost/35321] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-24 23:06:08,108 INFO [Listener at localhost/35321] util.FSUtils(471): Created version file at hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb with version=8 2023-07-24 23:06:08,108 INFO [Listener at localhost/35321] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/hbase-staging 2023-07-24 23:06:08,487 INFO [Listener at localhost/35321] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-07-24 23:06:09,099 INFO [Listener at localhost/35321] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-07-24 23:06:09,135 INFO [Listener at localhost/35321] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-24 23:06:09,135 INFO [Listener at localhost/35321] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-24 23:06:09,136 INFO [Listener at localhost/35321] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-24 23:06:09,136 INFO [Listener at localhost/35321] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-24 23:06:09,136 INFO [Listener at localhost/35321] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-24 23:06:09,337 INFO [Listener at localhost/35321] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-07-24 23:06:09,416 DEBUG [Listener at localhost/35321] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-07-24 23:06:09,543 INFO [Listener at localhost/35321] ipc.NettyRpcServer(120): Bind to /172.31.14.131:37213 2023-07-24 23:06:09,559 INFO [Listener at localhost/35321] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-24 23:06:09,560 INFO [Listener at localhost/35321] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-24 23:06:09,587 INFO [Listener at localhost/35321] zookeeper.RecoverableZooKeeper(93): Process identifier=master:37213 connecting to ZooKeeper ensemble=127.0.0.1:52881 2023-07-24 23:06:09,640 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:372130x0, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-24 23:06:09,644 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:37213-0x1019995a36f0000 connected 2023-07-24 23:06:09,685 DEBUG [Listener at localhost/35321] zookeeper.ZKUtil(164): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-24 23:06:09,687 DEBUG [Listener at localhost/35321] zookeeper.ZKUtil(164): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-24 23:06:09,706 DEBUG [Listener at localhost/35321] zookeeper.ZKUtil(164): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-24 23:06:09,718 DEBUG [Listener at localhost/35321] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=37213 2023-07-24 23:06:09,718 DEBUG [Listener at localhost/35321] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=37213 2023-07-24 23:06:09,719 DEBUG [Listener at localhost/35321] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=37213 2023-07-24 23:06:09,719 DEBUG [Listener at localhost/35321] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=37213 2023-07-24 23:06:09,719 DEBUG [Listener at localhost/35321] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=37213 2023-07-24 23:06:09,726 INFO [Listener at localhost/35321] master.HMaster(444): hbase.rootdir=hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb, hbase.cluster.distributed=false 2023-07-24 23:06:09,802 INFO [Listener at localhost/35321] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-24 23:06:09,802 INFO [Listener at localhost/35321] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-24 23:06:09,803 INFO [Listener at localhost/35321] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-24 23:06:09,803 INFO [Listener at localhost/35321] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-24 23:06:09,803 INFO [Listener at localhost/35321] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-24 23:06:09,803 INFO [Listener at localhost/35321] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-24 23:06:09,810 INFO [Listener at localhost/35321] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-24 23:06:09,814 INFO [Listener at localhost/35321] ipc.NettyRpcServer(120): Bind to /172.31.14.131:39595 2023-07-24 23:06:09,817 INFO [Listener at localhost/35321] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-24 23:06:09,827 DEBUG [Listener at localhost/35321] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-24 23:06:09,828 INFO [Listener at localhost/35321] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-24 23:06:09,831 INFO [Listener at localhost/35321] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-24 23:06:09,834 INFO [Listener at localhost/35321] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:39595 connecting to ZooKeeper ensemble=127.0.0.1:52881 2023-07-24 23:06:09,842 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:395950x0, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-24 23:06:09,844 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:39595-0x1019995a36f0001 connected 2023-07-24 23:06:09,844 DEBUG [Listener at localhost/35321] zookeeper.ZKUtil(164): regionserver:39595-0x1019995a36f0001, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-24 23:06:09,847 DEBUG [Listener at localhost/35321] zookeeper.ZKUtil(164): regionserver:39595-0x1019995a36f0001, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-24 23:06:09,848 DEBUG [Listener at localhost/35321] zookeeper.ZKUtil(164): regionserver:39595-0x1019995a36f0001, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-24 23:06:09,849 DEBUG [Listener at localhost/35321] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=39595 2023-07-24 23:06:09,849 DEBUG [Listener at localhost/35321] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=39595 2023-07-24 23:06:09,852 DEBUG [Listener at localhost/35321] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=39595 2023-07-24 23:06:09,855 DEBUG [Listener at localhost/35321] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=39595 2023-07-24 23:06:09,858 DEBUG [Listener at localhost/35321] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=39595 2023-07-24 23:06:09,874 INFO [Listener at localhost/35321] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-24 23:06:09,875 INFO [Listener at localhost/35321] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-24 23:06:09,875 INFO [Listener at localhost/35321] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-24 23:06:09,876 INFO [Listener at localhost/35321] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-24 23:06:09,876 INFO [Listener at localhost/35321] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-24 23:06:09,876 INFO [Listener at localhost/35321] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-24 23:06:09,876 INFO [Listener at localhost/35321] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-24 23:06:09,879 INFO [Listener at localhost/35321] ipc.NettyRpcServer(120): Bind to /172.31.14.131:39013 2023-07-24 23:06:09,880 INFO [Listener at localhost/35321] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-24 23:06:09,894 DEBUG [Listener at localhost/35321] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-24 23:06:09,895 INFO [Listener at localhost/35321] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-24 23:06:09,899 INFO [Listener at localhost/35321] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-24 23:06:09,902 INFO [Listener at localhost/35321] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:39013 connecting to ZooKeeper ensemble=127.0.0.1:52881 2023-07-24 23:06:09,915 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:390130x0, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-24 23:06:09,916 DEBUG [Listener at localhost/35321] zookeeper.ZKUtil(164): regionserver:390130x0, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-24 23:06:09,917 DEBUG [Listener at localhost/35321] zookeeper.ZKUtil(164): regionserver:390130x0, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-24 23:06:09,918 DEBUG [Listener at localhost/35321] zookeeper.ZKUtil(164): regionserver:390130x0, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-24 23:06:09,919 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:39013-0x1019995a36f0002 connected 2023-07-24 23:06:09,922 DEBUG [Listener at localhost/35321] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=39013 2023-07-24 23:06:09,926 DEBUG [Listener at localhost/35321] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=39013 2023-07-24 23:06:09,934 DEBUG [Listener at localhost/35321] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=39013 2023-07-24 23:06:09,941 DEBUG [Listener at localhost/35321] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=39013 2023-07-24 23:06:09,942 DEBUG [Listener at localhost/35321] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=39013 2023-07-24 23:06:09,957 INFO [Listener at localhost/35321] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-24 23:06:09,958 INFO [Listener at localhost/35321] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-24 23:06:09,958 INFO [Listener at localhost/35321] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-24 23:06:09,958 INFO [Listener at localhost/35321] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-24 23:06:09,958 INFO [Listener at localhost/35321] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-24 23:06:09,958 INFO [Listener at localhost/35321] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-24 23:06:09,958 INFO [Listener at localhost/35321] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-24 23:06:09,960 INFO [Listener at localhost/35321] ipc.NettyRpcServer(120): Bind to /172.31.14.131:33227 2023-07-24 23:06:09,961 INFO [Listener at localhost/35321] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-24 23:06:09,966 DEBUG [Listener at localhost/35321] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-24 23:06:09,968 INFO [Listener at localhost/35321] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-24 23:06:09,969 INFO [Listener at localhost/35321] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-24 23:06:09,970 INFO [Listener at localhost/35321] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:33227 connecting to ZooKeeper ensemble=127.0.0.1:52881 2023-07-24 23:06:09,975 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:332270x0, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-24 23:06:09,977 DEBUG [Listener at localhost/35321] zookeeper.ZKUtil(164): regionserver:332270x0, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-24 23:06:09,978 DEBUG [Listener at localhost/35321] zookeeper.ZKUtil(164): regionserver:332270x0, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-24 23:06:09,978 DEBUG [Listener at localhost/35321] zookeeper.ZKUtil(164): regionserver:332270x0, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-24 23:06:09,982 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:33227-0x1019995a36f0003 connected 2023-07-24 23:06:09,982 DEBUG [Listener at localhost/35321] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=33227 2023-07-24 23:06:09,982 DEBUG [Listener at localhost/35321] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=33227 2023-07-24 23:06:09,985 DEBUG [Listener at localhost/35321] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=33227 2023-07-24 23:06:09,987 DEBUG [Listener at localhost/35321] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=33227 2023-07-24 23:06:09,989 DEBUG [Listener at localhost/35321] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=33227 2023-07-24 23:06:09,992 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,37213,1690239968296 2023-07-24 23:06:10,001 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-24 23:06:10,003 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,37213,1690239968296 2023-07-24 23:06:10,030 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:39013-0x1019995a36f0002, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-24 23:06:10,030 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:33227-0x1019995a36f0003, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-24 23:06:10,030 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-24 23:06:10,031 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:39595-0x1019995a36f0001, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-24 23:06:10,032 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-24 23:06:10,033 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-24 23:06:10,035 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-24 23:06:10,035 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,37213,1690239968296 from backup master directory 2023-07-24 23:06:10,040 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,37213,1690239968296 2023-07-24 23:06:10,040 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-24 23:06:10,041 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-24 23:06:10,041 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,37213,1690239968296 2023-07-24 23:06:10,045 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-07-24 23:06:10,046 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-07-24 23:06:10,203 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/hbase.id with ID: add73be0-0a36-41fd-84bb-cb040e0337c3 2023-07-24 23:06:10,248 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-24 23:06:10,267 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-24 23:06:10,328 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x6779f1ce to 127.0.0.1:52881 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 23:06:10,366 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@26e321c3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 23:06:10,393 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-24 23:06:10,395 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-07-24 23:06:10,416 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-07-24 23:06:10,416 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-07-24 23:06:10,418 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-24 23:06:10,423 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-24 23:06:10,425 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-24 23:06:10,464 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/MasterData/data/master/store-tmp 2023-07-24 23:06:10,526 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 23:06:10,527 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-24 23:06:10,527 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-24 23:06:10,527 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-24 23:06:10,527 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-24 23:06:10,527 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-24 23:06:10,527 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-24 23:06:10,527 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-24 23:06:10,529 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/MasterData/WALs/jenkins-hbase4.apache.org,37213,1690239968296 2023-07-24 23:06:10,555 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C37213%2C1690239968296, suffix=, logDir=hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/MasterData/WALs/jenkins-hbase4.apache.org,37213,1690239968296, archiveDir=hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/MasterData/oldWALs, maxLogs=10 2023-07-24 23:06:10,649 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36657,DS-66e6fea1-5a80-4bc6-b43a-474a66b9400c,DISK] 2023-07-24 23:06:10,649 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40129,DS-f8e20b7b-3643-4c92-b6c4-0340e1d89c6b,DISK] 2023-07-24 23:06:10,649 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41237,DS-04e90ef6-6ea5-4593-9443-06063165d08a,DISK] 2023-07-24 23:06:10,663 DEBUG [RS-EventLoopGroup-5-1] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-24 23:06:10,749 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/MasterData/WALs/jenkins-hbase4.apache.org,37213,1690239968296/jenkins-hbase4.apache.org%2C37213%2C1690239968296.1690239970568 2023-07-24 23:06:10,750 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:40129,DS-f8e20b7b-3643-4c92-b6c4-0340e1d89c6b,DISK], DatanodeInfoWithStorage[127.0.0.1:41237,DS-04e90ef6-6ea5-4593-9443-06063165d08a,DISK], DatanodeInfoWithStorage[127.0.0.1:36657,DS-66e6fea1-5a80-4bc6-b43a-474a66b9400c,DISK]] 2023-07-24 23:06:10,751 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-07-24 23:06:10,751 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 23:06:10,760 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-07-24 23:06:10,761 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-07-24 23:06:10,854 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-07-24 23:06:10,862 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-07-24 23:06:10,893 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-07-24 23:06:10,907 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 23:06:10,914 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-24 23:06:10,917 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-24 23:06:10,937 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-07-24 23:06:10,943 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-24 23:06:10,945 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69690925, jitterRate=0.03847570717334747}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-24 23:06:10,945 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-24 23:06:10,947 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-07-24 23:06:10,973 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-07-24 23:06:10,973 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-07-24 23:06:10,976 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-07-24 23:06:10,978 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 1 msec 2023-07-24 23:06:11,018 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 39 msec 2023-07-24 23:06:11,019 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-07-24 23:06:11,052 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-07-24 23:06:11,059 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-07-24 23:06:11,088 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-07-24 23:06:11,093 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-07-24 23:06:11,095 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-07-24 23:06:11,102 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-07-24 23:06:11,107 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-07-24 23:06:11,111 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-24 23:06:11,113 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-07-24 23:06:11,114 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-07-24 23:06:11,128 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-07-24 23:06:11,135 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:33227-0x1019995a36f0003, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-24 23:06:11,135 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:39595-0x1019995a36f0001, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-24 23:06:11,135 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:39013-0x1019995a36f0002, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-24 23:06:11,135 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-24 23:06:11,136 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-24 23:06:11,136 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,37213,1690239968296, sessionid=0x1019995a36f0000, setting cluster-up flag (Was=false) 2023-07-24 23:06:11,161 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-24 23:06:11,167 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-07-24 23:06:11,171 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,37213,1690239968296 2023-07-24 23:06:11,180 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-24 23:06:11,188 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-07-24 23:06:11,192 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,37213,1690239968296 2023-07-24 23:06:11,196 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.hbase-snapshot/.tmp 2023-07-24 23:06:11,309 INFO [RS:2;jenkins-hbase4:33227] regionserver.HRegionServer(951): ClusterId : add73be0-0a36-41fd-84bb-cb040e0337c3 2023-07-24 23:06:11,309 INFO [RS:1;jenkins-hbase4:39013] regionserver.HRegionServer(951): ClusterId : add73be0-0a36-41fd-84bb-cb040e0337c3 2023-07-24 23:06:11,309 INFO [RS:0;jenkins-hbase4:39595] regionserver.HRegionServer(951): ClusterId : add73be0-0a36-41fd-84bb-cb040e0337c3 2023-07-24 23:06:11,322 DEBUG [RS:0;jenkins-hbase4:39595] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-24 23:06:11,323 DEBUG [RS:1;jenkins-hbase4:39013] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-24 23:06:11,322 DEBUG [RS:2;jenkins-hbase4:33227] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-24 23:06:11,335 DEBUG [RS:2;jenkins-hbase4:33227] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-24 23:06:11,335 DEBUG [RS:2;jenkins-hbase4:33227] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-24 23:06:11,335 DEBUG [RS:0;jenkins-hbase4:39595] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-24 23:06:11,335 DEBUG [RS:0;jenkins-hbase4:39595] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-24 23:06:11,345 DEBUG [RS:1;jenkins-hbase4:39013] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-24 23:06:11,345 DEBUG [RS:1;jenkins-hbase4:39013] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-24 23:06:11,347 DEBUG [RS:0;jenkins-hbase4:39595] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-24 23:06:11,348 DEBUG [RS:0;jenkins-hbase4:39595] zookeeper.ReadOnlyZKClient(139): Connect 0x49d307de to 127.0.0.1:52881 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 23:06:11,350 DEBUG [RS:1;jenkins-hbase4:39013] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-24 23:06:11,350 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2930): Registered master coprocessor service: service=AccessControlService 2023-07-24 23:06:11,356 DEBUG [RS:2;jenkins-hbase4:33227] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-24 23:06:11,356 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 23:06:11,357 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver loaded, priority=536870912. 2023-07-24 23:06:11,369 DEBUG [RS:1;jenkins-hbase4:39013] zookeeper.ReadOnlyZKClient(139): Connect 0x07011121 to 127.0.0.1:52881 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 23:06:11,383 DEBUG [RS:2;jenkins-hbase4:33227] zookeeper.ReadOnlyZKClient(139): Connect 0x77dfde30 to 127.0.0.1:52881 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 23:06:11,403 DEBUG [RS:0;jenkins-hbase4:39595] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4a50a660, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 23:06:11,404 DEBUG [RS:0;jenkins-hbase4:39595] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@468e6637, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-24 23:06:11,423 DEBUG [RS:2;jenkins-hbase4:33227] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5f99e43a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 23:06:11,423 DEBUG [RS:1;jenkins-hbase4:39013] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5395484, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 23:06:11,423 DEBUG [RS:2;jenkins-hbase4:33227] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@79cc1b2c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-24 23:06:11,424 DEBUG [RS:1;jenkins-hbase4:39013] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@10880d51, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-24 23:06:11,442 DEBUG [RS:2;jenkins-hbase4:33227] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:2;jenkins-hbase4:33227 2023-07-24 23:06:11,442 DEBUG [RS:0;jenkins-hbase4:39595] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:39595 2023-07-24 23:06:11,444 DEBUG [RS:1;jenkins-hbase4:39013] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:39013 2023-07-24 23:06:11,449 INFO [RS:0;jenkins-hbase4:39595] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-24 23:06:11,449 INFO [RS:0;jenkins-hbase4:39595] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-24 23:06:11,449 DEBUG [RS:0;jenkins-hbase4:39595] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-24 23:06:11,449 INFO [RS:1;jenkins-hbase4:39013] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-24 23:06:11,450 INFO [RS:1;jenkins-hbase4:39013] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-24 23:06:11,449 INFO [RS:2;jenkins-hbase4:33227] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-24 23:06:11,451 DEBUG [RS:1;jenkins-hbase4:39013] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-24 23:06:11,451 INFO [RS:2;jenkins-hbase4:33227] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-24 23:06:11,451 DEBUG [RS:2;jenkins-hbase4:33227] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-24 23:06:11,451 INFO [RS:0;jenkins-hbase4:39595] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 23:06:11,452 INFO [RS:2;jenkins-hbase4:33227] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 23:06:11,457 DEBUG [RS:2;jenkins-hbase4:33227] regionserver.HRegionServer(1022): About to register with Master. 2023-07-24 23:06:11,451 INFO [RS:1;jenkins-hbase4:39013] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 23:06:11,457 DEBUG [RS:0;jenkins-hbase4:39595] regionserver.HRegionServer(1022): About to register with Master. 2023-07-24 23:06:11,458 DEBUG [RS:1;jenkins-hbase4:39013] regionserver.HRegionServer(1022): About to register with Master. 2023-07-24 23:06:11,461 INFO [RS:2;jenkins-hbase4:33227] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,37213,1690239968296 with isa=jenkins-hbase4.apache.org/172.31.14.131:33227, startcode=1690239969957 2023-07-24 23:06:11,461 INFO [RS:1;jenkins-hbase4:39013] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,37213,1690239968296 with isa=jenkins-hbase4.apache.org/172.31.14.131:39013, startcode=1690239969874 2023-07-24 23:06:11,461 INFO [RS:0;jenkins-hbase4:39595] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,37213,1690239968296 with isa=jenkins-hbase4.apache.org/172.31.14.131:39595, startcode=1690239969801 2023-07-24 23:06:11,487 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-07-24 23:06:11,490 DEBUG [RS:1;jenkins-hbase4:39013] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-24 23:06:11,490 DEBUG [RS:2;jenkins-hbase4:33227] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-24 23:06:11,490 DEBUG [RS:0;jenkins-hbase4:39595] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-24 23:06:11,502 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-24 23:06:11,502 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-24 23:06:11,502 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-24 23:06:11,503 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-24 23:06:11,503 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-07-24 23:06:11,503 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 23:06:11,503 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-24 23:06:11,503 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 23:06:11,507 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1690240001506 2023-07-24 23:06:11,510 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-07-24 23:06:11,512 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-07-24 23:06:11,513 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-07-24 23:06:11,519 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-24 23:06:11,522 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-07-24 23:06:11,531 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-07-24 23:06:11,533 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-07-24 23:06:11,533 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-07-24 23:06:11,534 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-07-24 23:06:11,548 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-24 23:06:11,551 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-07-24 23:06:11,553 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-07-24 23:06:11,553 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-07-24 23:06:11,560 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-07-24 23:06:11,561 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-07-24 23:06:11,564 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39535, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-07-24 23:06:11,564 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46139, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-07-24 23:06:11,565 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1690239971563,5,FailOnTimeoutGroup] 2023-07-24 23:06:11,564 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39791, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-07-24 23:06:11,568 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1690239971566,5,FailOnTimeoutGroup] 2023-07-24 23:06:11,568 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-24 23:06:11,571 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-07-24 23:06:11,573 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-07-24 23:06:11,573 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-07-24 23:06:11,583 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37213] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,39595,1690239969801 2023-07-24 23:06:11,606 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37213] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:06:11,607 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37213] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,39013,1690239969874 2023-07-24 23:06:11,616 DEBUG [RS:0;jenkins-hbase4:39595] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb 2023-07-24 23:06:11,616 DEBUG [RS:1;jenkins-hbase4:39013] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb 2023-07-24 23:06:11,617 DEBUG [RS:2;jenkins-hbase4:33227] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb 2023-07-24 23:06:11,617 DEBUG [RS:1;jenkins-hbase4:39013] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:37611 2023-07-24 23:06:11,616 DEBUG [RS:0;jenkins-hbase4:39595] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:37611 2023-07-24 23:06:11,617 DEBUG [RS:1;jenkins-hbase4:39013] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-24 23:06:11,617 DEBUG [RS:2;jenkins-hbase4:33227] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:37611 2023-07-24 23:06:11,617 DEBUG [RS:0;jenkins-hbase4:39595] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-24 23:06:11,617 DEBUG [RS:2;jenkins-hbase4:33227] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-24 23:06:11,618 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-24 23:06:11,620 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-24 23:06:11,620 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb 2023-07-24 23:06:11,625 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-24 23:06:11,629 DEBUG [RS:0;jenkins-hbase4:39595] zookeeper.ZKUtil(162): regionserver:39595-0x1019995a36f0001, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39595,1690239969801 2023-07-24 23:06:11,629 WARN [RS:0;jenkins-hbase4:39595] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-24 23:06:11,629 INFO [RS:0;jenkins-hbase4:39595] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-24 23:06:11,629 DEBUG [RS:0;jenkins-hbase4:39595] regionserver.HRegionServer(1948): logDir=hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/WALs/jenkins-hbase4.apache.org,39595,1690239969801 2023-07-24 23:06:11,629 DEBUG [RS:2;jenkins-hbase4:33227] zookeeper.ZKUtil(162): regionserver:33227-0x1019995a36f0003, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:06:11,630 WARN [RS:2;jenkins-hbase4:33227] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-24 23:06:11,630 DEBUG [RS:1;jenkins-hbase4:39013] zookeeper.ZKUtil(162): regionserver:39013-0x1019995a36f0002, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39013,1690239969874 2023-07-24 23:06:11,630 WARN [RS:1;jenkins-hbase4:39013] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-24 23:06:11,630 INFO [RS:2;jenkins-hbase4:33227] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-24 23:06:11,631 DEBUG [RS:2;jenkins-hbase4:33227] regionserver.HRegionServer(1948): logDir=hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/WALs/jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:06:11,632 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,39013,1690239969874] 2023-07-24 23:06:11,632 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,33227,1690239969957] 2023-07-24 23:06:11,632 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,39595,1690239969801] 2023-07-24 23:06:11,631 INFO [RS:1;jenkins-hbase4:39013] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-24 23:06:11,632 DEBUG [RS:1;jenkins-hbase4:39013] regionserver.HRegionServer(1948): logDir=hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/WALs/jenkins-hbase4.apache.org,39013,1690239969874 2023-07-24 23:06:11,686 DEBUG [RS:0;jenkins-hbase4:39595] zookeeper.ZKUtil(162): regionserver:39595-0x1019995a36f0001, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:06:11,686 DEBUG [RS:0;jenkins-hbase4:39595] zookeeper.ZKUtil(162): regionserver:39595-0x1019995a36f0001, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39013,1690239969874 2023-07-24 23:06:11,687 DEBUG [RS:0;jenkins-hbase4:39595] zookeeper.ZKUtil(162): regionserver:39595-0x1019995a36f0001, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39595,1690239969801 2023-07-24 23:06:11,692 DEBUG [RS:1;jenkins-hbase4:39013] zookeeper.ZKUtil(162): regionserver:39013-0x1019995a36f0002, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:06:11,693 DEBUG [RS:1;jenkins-hbase4:39013] zookeeper.ZKUtil(162): regionserver:39013-0x1019995a36f0002, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39013,1690239969874 2023-07-24 23:06:11,694 DEBUG [RS:1;jenkins-hbase4:39013] zookeeper.ZKUtil(162): regionserver:39013-0x1019995a36f0002, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39595,1690239969801 2023-07-24 23:06:11,709 DEBUG [RS:2;jenkins-hbase4:33227] zookeeper.ZKUtil(162): regionserver:33227-0x1019995a36f0003, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:06:11,710 DEBUG [RS:2;jenkins-hbase4:33227] zookeeper.ZKUtil(162): regionserver:33227-0x1019995a36f0003, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39013,1690239969874 2023-07-24 23:06:11,710 DEBUG [RS:2;jenkins-hbase4:33227] zookeeper.ZKUtil(162): regionserver:33227-0x1019995a36f0003, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39595,1690239969801 2023-07-24 23:06:11,716 DEBUG [RS:2;jenkins-hbase4:33227] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-24 23:06:11,722 DEBUG [RS:1;jenkins-hbase4:39013] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-24 23:06:11,722 DEBUG [RS:0;jenkins-hbase4:39595] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-24 23:06:11,757 INFO [RS:0;jenkins-hbase4:39595] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-24 23:06:11,757 INFO [RS:1;jenkins-hbase4:39013] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-24 23:06:11,757 INFO [RS:2;jenkins-hbase4:33227] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-24 23:06:11,765 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 23:06:11,783 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-24 23:06:11,786 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/hbase/meta/1588230740/info 2023-07-24 23:06:11,787 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-24 23:06:11,789 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 23:06:11,789 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-24 23:06:11,793 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/hbase/meta/1588230740/rep_barrier 2023-07-24 23:06:11,794 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-24 23:06:11,797 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 23:06:11,797 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-24 23:06:11,800 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/hbase/meta/1588230740/table 2023-07-24 23:06:11,801 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-24 23:06:11,802 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 23:06:11,808 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/hbase/meta/1588230740 2023-07-24 23:06:11,809 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/hbase/meta/1588230740 2023-07-24 23:06:11,811 INFO [RS:0;jenkins-hbase4:39595] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-24 23:06:11,811 INFO [RS:1;jenkins-hbase4:39013] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-24 23:06:11,815 INFO [RS:2;jenkins-hbase4:33227] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-24 23:06:11,822 INFO [RS:1;jenkins-hbase4:39013] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-24 23:06:11,824 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-24 23:06:11,822 INFO [RS:0;jenkins-hbase4:39595] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-24 23:06:11,831 INFO [RS:0;jenkins-hbase4:39595] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-24 23:06:11,822 INFO [RS:1;jenkins-hbase4:39013] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-24 23:06:11,827 INFO [RS:2;jenkins-hbase4:33227] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-24 23:06:11,832 INFO [RS:2;jenkins-hbase4:33227] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-24 23:06:11,836 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-24 23:06:11,847 INFO [RS:0;jenkins-hbase4:39595] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-24 23:06:11,858 INFO [RS:2;jenkins-hbase4:33227] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-24 23:06:11,862 INFO [RS:1;jenkins-hbase4:39013] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-24 23:06:11,890 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-24 23:06:11,890 INFO [RS:2;jenkins-hbase4:33227] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-24 23:06:11,890 INFO [RS:0;jenkins-hbase4:39595] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-24 23:06:11,890 INFO [RS:1;jenkins-hbase4:39013] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-24 23:06:11,891 DEBUG [RS:0;jenkins-hbase4:39595] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 23:06:11,890 DEBUG [RS:2;jenkins-hbase4:33227] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 23:06:11,892 DEBUG [RS:0;jenkins-hbase4:39595] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 23:06:11,892 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61457559, jitterRate=-0.08421100676059723}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-24 23:06:11,892 DEBUG [RS:0;jenkins-hbase4:39595] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 23:06:11,892 DEBUG [RS:2;jenkins-hbase4:33227] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 23:06:11,892 DEBUG [RS:0;jenkins-hbase4:39595] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 23:06:11,892 DEBUG [RS:2;jenkins-hbase4:33227] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 23:06:11,892 DEBUG [RS:0;jenkins-hbase4:39595] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 23:06:11,892 DEBUG [RS:2;jenkins-hbase4:33227] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 23:06:11,893 DEBUG [RS:0;jenkins-hbase4:39595] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-24 23:06:11,893 DEBUG [RS:2;jenkins-hbase4:33227] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 23:06:11,893 DEBUG [RS:0;jenkins-hbase4:39595] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 23:06:11,893 DEBUG [RS:2;jenkins-hbase4:33227] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-24 23:06:11,893 DEBUG [RS:0;jenkins-hbase4:39595] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 23:06:11,893 DEBUG [RS:2;jenkins-hbase4:33227] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 23:06:11,893 DEBUG [RS:0;jenkins-hbase4:39595] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 23:06:11,893 DEBUG [RS:2;jenkins-hbase4:33227] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 23:06:11,893 DEBUG [RS:0;jenkins-hbase4:39595] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 23:06:11,893 DEBUG [RS:2;jenkins-hbase4:33227] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 23:06:11,893 DEBUG [RS:2;jenkins-hbase4:33227] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 23:06:11,892 DEBUG [RS:1;jenkins-hbase4:39013] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 23:06:11,893 DEBUG [RS:1;jenkins-hbase4:39013] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 23:06:11,894 DEBUG [RS:1;jenkins-hbase4:39013] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 23:06:11,894 DEBUG [RS:1;jenkins-hbase4:39013] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 23:06:11,894 DEBUG [RS:1;jenkins-hbase4:39013] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 23:06:11,894 DEBUG [RS:1;jenkins-hbase4:39013] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-24 23:06:11,894 DEBUG [RS:1;jenkins-hbase4:39013] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 23:06:11,894 DEBUG [RS:1;jenkins-hbase4:39013] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 23:06:11,894 DEBUG [RS:1;jenkins-hbase4:39013] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 23:06:11,894 DEBUG [RS:1;jenkins-hbase4:39013] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 23:06:11,892 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-24 23:06:11,895 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-24 23:06:11,895 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-24 23:06:11,895 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-24 23:06:11,895 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-24 23:06:11,895 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-24 23:06:11,904 INFO [RS:1;jenkins-hbase4:39013] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-24 23:06:11,904 INFO [RS:1;jenkins-hbase4:39013] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-24 23:06:11,905 INFO [RS:1;jenkins-hbase4:39013] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-24 23:06:11,906 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-24 23:06:11,906 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-24 23:06:11,914 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-07-24 23:06:11,914 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-07-24 23:06:11,919 INFO [RS:0;jenkins-hbase4:39595] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-24 23:06:11,919 INFO [RS:0;jenkins-hbase4:39595] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-24 23:06:11,919 INFO [RS:0;jenkins-hbase4:39595] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-24 23:06:11,919 INFO [RS:2;jenkins-hbase4:33227] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-24 23:06:11,920 INFO [RS:2;jenkins-hbase4:33227] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-24 23:06:11,920 INFO [RS:2;jenkins-hbase4:33227] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-24 23:06:11,932 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-07-24 23:06:11,943 INFO [RS:0;jenkins-hbase4:39595] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-24 23:06:11,943 INFO [RS:2;jenkins-hbase4:33227] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-24 23:06:11,943 INFO [RS:1;jenkins-hbase4:39013] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-24 23:06:11,953 INFO [RS:1;jenkins-hbase4:39013] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39013,1690239969874-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-24 23:06:11,954 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-07-24 23:06:11,957 INFO [RS:0;jenkins-hbase4:39595] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39595,1690239969801-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-24 23:06:11,959 INFO [RS:2;jenkins-hbase4:33227] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,33227,1690239969957-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-24 23:06:11,971 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-07-24 23:06:11,983 INFO [RS:0;jenkins-hbase4:39595] regionserver.Replication(203): jenkins-hbase4.apache.org,39595,1690239969801 started 2023-07-24 23:06:11,983 INFO [RS:0;jenkins-hbase4:39595] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,39595,1690239969801, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:39595, sessionid=0x1019995a36f0001 2023-07-24 23:06:11,992 INFO [RS:1;jenkins-hbase4:39013] regionserver.Replication(203): jenkins-hbase4.apache.org,39013,1690239969874 started 2023-07-24 23:06:11,993 INFO [RS:2;jenkins-hbase4:33227] regionserver.Replication(203): jenkins-hbase4.apache.org,33227,1690239969957 started 2023-07-24 23:06:11,993 DEBUG [RS:0;jenkins-hbase4:39595] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-24 23:06:11,993 INFO [RS:2;jenkins-hbase4:33227] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,33227,1690239969957, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:33227, sessionid=0x1019995a36f0003 2023-07-24 23:06:11,993 INFO [RS:1;jenkins-hbase4:39013] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,39013,1690239969874, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:39013, sessionid=0x1019995a36f0002 2023-07-24 23:06:11,993 DEBUG [RS:2;jenkins-hbase4:33227] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-24 23:06:11,993 DEBUG [RS:1;jenkins-hbase4:39013] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-24 23:06:11,993 DEBUG [RS:2;jenkins-hbase4:33227] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:06:11,993 DEBUG [RS:0;jenkins-hbase4:39595] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,39595,1690239969801 2023-07-24 23:06:11,994 DEBUG [RS:2;jenkins-hbase4:33227] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,33227,1690239969957' 2023-07-24 23:06:11,994 DEBUG [RS:1;jenkins-hbase4:39013] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,39013,1690239969874 2023-07-24 23:06:11,995 DEBUG [RS:2;jenkins-hbase4:33227] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-24 23:06:11,994 DEBUG [RS:0;jenkins-hbase4:39595] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,39595,1690239969801' 2023-07-24 23:06:11,995 DEBUG [RS:0;jenkins-hbase4:39595] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-24 23:06:11,995 DEBUG [RS:1;jenkins-hbase4:39013] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,39013,1690239969874' 2023-07-24 23:06:11,995 DEBUG [RS:1;jenkins-hbase4:39013] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-24 23:06:11,996 DEBUG [RS:2;jenkins-hbase4:33227] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-24 23:06:11,996 DEBUG [RS:0;jenkins-hbase4:39595] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-24 23:06:11,996 DEBUG [RS:1;jenkins-hbase4:39013] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-24 23:06:11,998 DEBUG [RS:0;jenkins-hbase4:39595] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-24 23:06:11,998 DEBUG [RS:0;jenkins-hbase4:39595] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-24 23:06:11,998 DEBUG [RS:2;jenkins-hbase4:33227] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-24 23:06:11,998 DEBUG [RS:0;jenkins-hbase4:39595] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,39595,1690239969801 2023-07-24 23:06:11,998 DEBUG [RS:1;jenkins-hbase4:39013] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-24 23:06:11,998 DEBUG [RS:0;jenkins-hbase4:39595] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,39595,1690239969801' 2023-07-24 23:06:11,998 DEBUG [RS:0;jenkins-hbase4:39595] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 23:06:11,998 DEBUG [RS:2;jenkins-hbase4:33227] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-24 23:06:11,998 DEBUG [RS:1;jenkins-hbase4:39013] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-24 23:06:12,003 DEBUG [RS:2;jenkins-hbase4:33227] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:06:11,999 DEBUG [RS:1;jenkins-hbase4:39013] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,39013,1690239969874 2023-07-24 23:06:12,003 DEBUG [RS:2;jenkins-hbase4:33227] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,33227,1690239969957' 2023-07-24 23:06:12,003 DEBUG [RS:2;jenkins-hbase4:33227] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 23:06:12,003 DEBUG [RS:0;jenkins-hbase4:39595] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 23:06:12,003 DEBUG [RS:1;jenkins-hbase4:39013] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,39013,1690239969874' 2023-07-24 23:06:12,003 DEBUG [RS:1;jenkins-hbase4:39013] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 23:06:12,004 DEBUG [RS:2;jenkins-hbase4:33227] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 23:06:12,007 DEBUG [RS:0;jenkins-hbase4:39595] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-24 23:06:12,007 INFO [RS:0;jenkins-hbase4:39595] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-24 23:06:12,007 INFO [RS:0;jenkins-hbase4:39595] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-24 23:06:12,007 DEBUG [RS:1;jenkins-hbase4:39013] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 23:06:12,007 DEBUG [RS:2;jenkins-hbase4:33227] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-24 23:06:12,007 INFO [RS:2;jenkins-hbase4:33227] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-24 23:06:12,009 INFO [RS:2;jenkins-hbase4:33227] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-24 23:06:12,009 DEBUG [RS:1;jenkins-hbase4:39013] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-24 23:06:12,009 INFO [RS:1;jenkins-hbase4:39013] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-24 23:06:12,009 INFO [RS:1;jenkins-hbase4:39013] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-24 23:06:12,123 INFO [RS:1;jenkins-hbase4:39013] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C39013%2C1690239969874, suffix=, logDir=hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/WALs/jenkins-hbase4.apache.org,39013,1690239969874, archiveDir=hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/oldWALs, maxLogs=32 2023-07-24 23:06:12,124 INFO [RS:0;jenkins-hbase4:39595] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C39595%2C1690239969801, suffix=, logDir=hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/WALs/jenkins-hbase4.apache.org,39595,1690239969801, archiveDir=hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/oldWALs, maxLogs=32 2023-07-24 23:06:12,124 DEBUG [jenkins-hbase4:37213] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=3, allServersCount=3 2023-07-24 23:06:12,129 INFO [RS:2;jenkins-hbase4:33227] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C33227%2C1690239969957, suffix=, logDir=hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/WALs/jenkins-hbase4.apache.org,33227,1690239969957, archiveDir=hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/oldWALs, maxLogs=32 2023-07-24 23:06:12,130 DEBUG [jenkins-hbase4:37213] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-24 23:06:12,137 DEBUG [jenkins-hbase4:37213] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-24 23:06:12,137 DEBUG [jenkins-hbase4:37213] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-24 23:06:12,137 DEBUG [jenkins-hbase4:37213] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-24 23:06:12,137 DEBUG [jenkins-hbase4:37213] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-24 23:06:12,141 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,39013,1690239969874, state=OPENING 2023-07-24 23:06:12,151 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-07-24 23:06:12,153 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-24 23:06:12,154 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-24 23:06:12,161 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,39013,1690239969874}] 2023-07-24 23:06:12,210 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41237,DS-04e90ef6-6ea5-4593-9443-06063165d08a,DISK] 2023-07-24 23:06:12,210 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36657,DS-66e6fea1-5a80-4bc6-b43a-474a66b9400c,DISK] 2023-07-24 23:06:12,210 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36657,DS-66e6fea1-5a80-4bc6-b43a-474a66b9400c,DISK] 2023-07-24 23:06:12,211 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40129,DS-f8e20b7b-3643-4c92-b6c4-0340e1d89c6b,DISK] 2023-07-24 23:06:12,212 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40129,DS-f8e20b7b-3643-4c92-b6c4-0340e1d89c6b,DISK] 2023-07-24 23:06:12,213 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40129,DS-f8e20b7b-3643-4c92-b6c4-0340e1d89c6b,DISK] 2023-07-24 23:06:12,213 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36657,DS-66e6fea1-5a80-4bc6-b43a-474a66b9400c,DISK] 2023-07-24 23:06:12,213 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41237,DS-04e90ef6-6ea5-4593-9443-06063165d08a,DISK] 2023-07-24 23:06:12,214 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41237,DS-04e90ef6-6ea5-4593-9443-06063165d08a,DISK] 2023-07-24 23:06:12,246 INFO [RS:0;jenkins-hbase4:39595] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/WALs/jenkins-hbase4.apache.org,39595,1690239969801/jenkins-hbase4.apache.org%2C39595%2C1690239969801.1690239972128 2023-07-24 23:06:12,247 INFO [RS:1;jenkins-hbase4:39013] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/WALs/jenkins-hbase4.apache.org,39013,1690239969874/jenkins-hbase4.apache.org%2C39013%2C1690239969874.1690239972129 2023-07-24 23:06:12,247 INFO [RS:2;jenkins-hbase4:33227] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/WALs/jenkins-hbase4.apache.org,33227,1690239969957/jenkins-hbase4.apache.org%2C33227%2C1690239969957.1690239972131 2023-07-24 23:06:12,248 DEBUG [RS:0;jenkins-hbase4:39595] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:36657,DS-66e6fea1-5a80-4bc6-b43a-474a66b9400c,DISK], DatanodeInfoWithStorage[127.0.0.1:40129,DS-f8e20b7b-3643-4c92-b6c4-0340e1d89c6b,DISK], DatanodeInfoWithStorage[127.0.0.1:41237,DS-04e90ef6-6ea5-4593-9443-06063165d08a,DISK]] 2023-07-24 23:06:12,250 DEBUG [RS:2;jenkins-hbase4:33227] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:36657,DS-66e6fea1-5a80-4bc6-b43a-474a66b9400c,DISK], DatanodeInfoWithStorage[127.0.0.1:40129,DS-f8e20b7b-3643-4c92-b6c4-0340e1d89c6b,DISK], DatanodeInfoWithStorage[127.0.0.1:41237,DS-04e90ef6-6ea5-4593-9443-06063165d08a,DISK]] 2023-07-24 23:06:12,254 DEBUG [RS:1;jenkins-hbase4:39013] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:40129,DS-f8e20b7b-3643-4c92-b6c4-0340e1d89c6b,DISK], DatanodeInfoWithStorage[127.0.0.1:41237,DS-04e90ef6-6ea5-4593-9443-06063165d08a,DISK], DatanodeInfoWithStorage[127.0.0.1:36657,DS-66e6fea1-5a80-4bc6-b43a-474a66b9400c,DISK]] 2023-07-24 23:06:12,434 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,39013,1690239969874 2023-07-24 23:06:12,437 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-24 23:06:12,452 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52252, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-24 23:06:12,498 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-07-24 23:06:12,498 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-24 23:06:12,503 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C39013%2C1690239969874.meta, suffix=.meta, logDir=hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/WALs/jenkins-hbase4.apache.org,39013,1690239969874, archiveDir=hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/oldWALs, maxLogs=32 2023-07-24 23:06:12,527 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41237,DS-04e90ef6-6ea5-4593-9443-06063165d08a,DISK] 2023-07-24 23:06:12,527 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40129,DS-f8e20b7b-3643-4c92-b6c4-0340e1d89c6b,DISK] 2023-07-24 23:06:12,528 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36657,DS-66e6fea1-5a80-4bc6-b43a-474a66b9400c,DISK] 2023-07-24 23:06:12,537 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/WALs/jenkins-hbase4.apache.org,39013,1690239969874/jenkins-hbase4.apache.org%2C39013%2C1690239969874.meta.1690239972505.meta 2023-07-24 23:06:12,538 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:41237,DS-04e90ef6-6ea5-4593-9443-06063165d08a,DISK], DatanodeInfoWithStorage[127.0.0.1:40129,DS-f8e20b7b-3643-4c92-b6c4-0340e1d89c6b,DISK], DatanodeInfoWithStorage[127.0.0.1:36657,DS-66e6fea1-5a80-4bc6-b43a-474a66b9400c,DISK]] 2023-07-24 23:06:12,538 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-07-24 23:06:12,540 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=AccessControlService 2023-07-24 23:06:12,542 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 23:06:12,543 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-07-24 23:06:12,545 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-07-24 23:06:12,547 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-07-24 23:06:12,561 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-07-24 23:06:12,561 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 23:06:12,561 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-07-24 23:06:12,561 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-07-24 23:06:12,565 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-24 23:06:12,567 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/hbase/meta/1588230740/info 2023-07-24 23:06:12,567 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/hbase/meta/1588230740/info 2023-07-24 23:06:12,568 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-24 23:06:12,569 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 23:06:12,569 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-24 23:06:12,571 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/hbase/meta/1588230740/rep_barrier 2023-07-24 23:06:12,571 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/hbase/meta/1588230740/rep_barrier 2023-07-24 23:06:12,571 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-24 23:06:12,572 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 23:06:12,573 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-24 23:06:12,574 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/hbase/meta/1588230740/table 2023-07-24 23:06:12,574 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/hbase/meta/1588230740/table 2023-07-24 23:06:12,575 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-24 23:06:12,576 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 23:06:12,578 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/hbase/meta/1588230740 2023-07-24 23:06:12,581 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/hbase/meta/1588230740 2023-07-24 23:06:12,585 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-24 23:06:12,587 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-24 23:06:12,589 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70322292, jitterRate=0.047883808612823486}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-24 23:06:12,595 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-24 23:06:12,611 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1690239972423 2023-07-24 23:06:12,637 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-07-24 23:06:12,638 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-07-24 23:06:12,641 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,39013,1690239969874, state=OPEN 2023-07-24 23:06:12,644 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-07-24 23:06:12,644 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-24 23:06:12,650 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-07-24 23:06:12,650 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,39013,1690239969874 in 483 msec 2023-07-24 23:06:12,658 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-07-24 23:06:12,659 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 721 msec 2023-07-24 23:06:12,665 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 1.2940 sec 2023-07-24 23:06:12,666 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1690239972665, completionTime=-1 2023-07-24 23:06:12,666 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=3; waited=0ms, expected min=3 server(s), max=3 server(s), master is running 2023-07-24 23:06:12,666 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-07-24 23:06:12,749 DEBUG [hconnection-0x2b6dd434-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 23:06:12,753 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52260, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 23:06:12,782 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=3 2023-07-24 23:06:12,782 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1690240032782 2023-07-24 23:06:12,782 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1690240092782 2023-07-24 23:06:12,782 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 116 msec 2023-07-24 23:06:12,811 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37213,1690239968296-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-24 23:06:12,812 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37213,1690239968296-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-24 23:06:12,812 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37213,1690239968296-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-24 23:06:12,814 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:37213, period=300000, unit=MILLISECONDS is enabled. 2023-07-24 23:06:12,814 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-07-24 23:06:12,820 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-07-24 23:06:12,831 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-07-24 23:06:12,832 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-24 23:06:12,842 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-07-24 23:06:12,844 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-07-24 23:06:12,847 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-24 23:06:12,872 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.tmp/data/hbase/namespace/9774cede2296795241d588aec34e45f8 2023-07-24 23:06:12,874 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.tmp/data/hbase/namespace/9774cede2296795241d588aec34e45f8 empty. 2023-07-24 23:06:12,875 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.tmp/data/hbase/namespace/9774cede2296795241d588aec34e45f8 2023-07-24 23:06:12,875 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-07-24 23:06:12,927 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-07-24 23:06:12,930 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => 9774cede2296795241d588aec34e45f8, NAME => 'hbase:namespace,,1690239972831.9774cede2296795241d588aec34e45f8.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.tmp 2023-07-24 23:06:12,950 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1690239972831.9774cede2296795241d588aec34e45f8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 23:06:12,950 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing 9774cede2296795241d588aec34e45f8, disabling compactions & flushes 2023-07-24 23:06:12,950 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1690239972831.9774cede2296795241d588aec34e45f8. 2023-07-24 23:06:12,950 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1690239972831.9774cede2296795241d588aec34e45f8. 2023-07-24 23:06:12,950 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1690239972831.9774cede2296795241d588aec34e45f8. after waiting 0 ms 2023-07-24 23:06:12,950 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1690239972831.9774cede2296795241d588aec34e45f8. 2023-07-24 23:06:12,950 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1690239972831.9774cede2296795241d588aec34e45f8. 2023-07-24 23:06:12,950 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for 9774cede2296795241d588aec34e45f8: 2023-07-24 23:06:12,957 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-07-24 23:06:12,979 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1690239972831.9774cede2296795241d588aec34e45f8.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1690239972960"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690239972960"}]},"ts":"1690239972960"} 2023-07-24 23:06:13,020 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-24 23:06:13,022 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-24 23:06:13,027 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690239973023"}]},"ts":"1690239973023"} 2023-07-24 23:06:13,033 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-07-24 23:06:13,037 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-24 23:06:13,038 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-24 23:06:13,039 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-24 23:06:13,039 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-24 23:06:13,039 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-24 23:06:13,041 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=9774cede2296795241d588aec34e45f8, ASSIGN}] 2023-07-24 23:06:13,044 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=9774cede2296795241d588aec34e45f8, ASSIGN 2023-07-24 23:06:13,046 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=9774cede2296795241d588aec34e45f8, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33227,1690239969957; forceNewPlan=false, retain=false 2023-07-24 23:06:13,198 INFO [jenkins-hbase4:37213] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-24 23:06:13,200 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=9774cede2296795241d588aec34e45f8, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:06:13,200 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1690239972831.9774cede2296795241d588aec34e45f8.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1690239973199"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690239973199"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690239973199"}]},"ts":"1690239973199"} 2023-07-24 23:06:13,206 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 9774cede2296795241d588aec34e45f8, server=jenkins-hbase4.apache.org,33227,1690239969957}] 2023-07-24 23:06:13,360 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:06:13,361 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-24 23:06:13,365 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40718, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-24 23:06:13,372 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1690239972831.9774cede2296795241d588aec34e45f8. 2023-07-24 23:06:13,373 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 9774cede2296795241d588aec34e45f8, NAME => 'hbase:namespace,,1690239972831.9774cede2296795241d588aec34e45f8.', STARTKEY => '', ENDKEY => ''} 2023-07-24 23:06:13,373 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:namespace,,1690239972831.9774cede2296795241d588aec34e45f8. service=AccessControlService 2023-07-24 23:06:13,374 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 23:06:13,375 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 9774cede2296795241d588aec34e45f8 2023-07-24 23:06:13,375 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1690239972831.9774cede2296795241d588aec34e45f8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 23:06:13,375 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 9774cede2296795241d588aec34e45f8 2023-07-24 23:06:13,375 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 9774cede2296795241d588aec34e45f8 2023-07-24 23:06:13,384 INFO [StoreOpener-9774cede2296795241d588aec34e45f8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 9774cede2296795241d588aec34e45f8 2023-07-24 23:06:13,386 DEBUG [StoreOpener-9774cede2296795241d588aec34e45f8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/hbase/namespace/9774cede2296795241d588aec34e45f8/info 2023-07-24 23:06:13,386 DEBUG [StoreOpener-9774cede2296795241d588aec34e45f8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/hbase/namespace/9774cede2296795241d588aec34e45f8/info 2023-07-24 23:06:13,387 INFO [StoreOpener-9774cede2296795241d588aec34e45f8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9774cede2296795241d588aec34e45f8 columnFamilyName info 2023-07-24 23:06:13,389 INFO [StoreOpener-9774cede2296795241d588aec34e45f8-1] regionserver.HStore(310): Store=9774cede2296795241d588aec34e45f8/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 23:06:13,391 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/hbase/namespace/9774cede2296795241d588aec34e45f8 2023-07-24 23:06:13,392 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/hbase/namespace/9774cede2296795241d588aec34e45f8 2023-07-24 23:06:13,397 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 9774cede2296795241d588aec34e45f8 2023-07-24 23:06:13,401 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/hbase/namespace/9774cede2296795241d588aec34e45f8/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-24 23:06:13,402 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 9774cede2296795241d588aec34e45f8; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59145325, jitterRate=-0.11866597831249237}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-24 23:06:13,402 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 9774cede2296795241d588aec34e45f8: 2023-07-24 23:06:13,404 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1690239972831.9774cede2296795241d588aec34e45f8., pid=6, masterSystemTime=1690239973360 2023-07-24 23:06:13,408 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1690239972831.9774cede2296795241d588aec34e45f8. 2023-07-24 23:06:13,409 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1690239972831.9774cede2296795241d588aec34e45f8. 2023-07-24 23:06:13,410 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=9774cede2296795241d588aec34e45f8, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:06:13,411 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1690239972831.9774cede2296795241d588aec34e45f8.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1690239973410"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690239973410"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690239973410"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690239973410"}]},"ts":"1690239973410"} 2023-07-24 23:06:13,420 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-07-24 23:06:13,420 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 9774cede2296795241d588aec34e45f8, server=jenkins-hbase4.apache.org,33227,1690239969957 in 208 msec 2023-07-24 23:06:13,425 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-07-24 23:06:13,426 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=9774cede2296795241d588aec34e45f8, ASSIGN in 379 msec 2023-07-24 23:06:13,428 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-24 23:06:13,428 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690239973428"}]},"ts":"1690239973428"} 2023-07-24 23:06:13,431 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-07-24 23:06:13,436 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-07-24 23:06:13,441 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 603 msec 2023-07-24 23:06:13,448 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-07-24 23:06:13,449 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-07-24 23:06:13,450 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-24 23:06:13,475 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 23:06:13,477 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40726, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 23:06:13,495 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-07-24 23:06:13,518 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-24 23:06:13,525 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 40 msec 2023-07-24 23:06:13,529 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-07-24 23:06:13,542 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-24 23:06:13,549 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 20 msec 2023-07-24 23:06:13,566 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-07-24 23:06:13,570 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-07-24 23:06:13,572 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 3.531sec 2023-07-24 23:06:13,575 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-07-24 23:06:13,577 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-07-24 23:06:13,577 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-07-24 23:06:13,579 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37213,1690239968296-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-07-24 23:06:13,579 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37213,1690239968296-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-07-24 23:06:13,601 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster$4(2112): Client=null/null create 'hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-24 23:06:13,604 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:acl 2023-07-24 23:06:13,607 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_PRE_OPERATION 2023-07-24 23:06:13,608 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-24 23:06:13,611 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(700): Client=null/null procedure request for creating table: namespace: "hbase" qualifier: "acl" procId is: 9 2023-07-24 23:06:13,614 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.tmp/data/hbase/acl/491925dfdedb8219e0d8fb183d9a55b9 2023-07-24 23:06:13,615 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.tmp/data/hbase/acl/491925dfdedb8219e0d8fb183d9a55b9 empty. 2023-07-24 23:06:13,618 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.tmp/data/hbase/acl/491925dfdedb8219e0d8fb183d9a55b9 2023-07-24 23:06:13,619 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived hbase:acl regions 2023-07-24 23:06:13,621 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-24 23:06:13,625 DEBUG [Listener at localhost/35321] zookeeper.ReadOnlyZKClient(139): Connect 0x695cdb1e to 127.0.0.1:52881 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 23:06:13,636 DEBUG [Listener at localhost/35321] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@b7ca875, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 23:06:13,654 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.tmp/data/hbase/acl/.tabledesc/.tableinfo.0000000001 2023-07-24 23:06:13,656 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(7675): creating {ENCODED => 491925dfdedb8219e0d8fb183d9a55b9, NAME => 'hbase:acl,,1690239973596.491925dfdedb8219e0d8fb183d9a55b9.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.tmp 2023-07-24 23:06:13,659 DEBUG [hconnection-0x5fc26c7c-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 23:06:13,675 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52270, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 23:06:13,687 INFO [Listener at localhost/35321] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,37213,1690239968296 2023-07-24 23:06:13,689 INFO [Listener at localhost/35321] hbase.HBaseTestingUtility(2699): Starting mini mapreduce cluster... 2023-07-24 23:06:13,690 INFO [Listener at localhost/35321] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/40a10de8-ef1a-d60f-e3da-b5fca02ca095/test.cache.data in system properties and HBase conf 2023-07-24 23:06:13,690 INFO [Listener at localhost/35321] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/40a10de8-ef1a-d60f-e3da-b5fca02ca095/hadoop.tmp.dir in system properties and HBase conf 2023-07-24 23:06:13,690 INFO [Listener at localhost/35321] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/40a10de8-ef1a-d60f-e3da-b5fca02ca095/hadoop.log.dir in system properties and HBase conf 2023-07-24 23:06:13,690 INFO [Listener at localhost/35321] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/40a10de8-ef1a-d60f-e3da-b5fca02ca095/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-24 23:06:13,691 INFO [Listener at localhost/35321] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/40a10de8-ef1a-d60f-e3da-b5fca02ca095/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-24 23:06:13,691 INFO [Listener at localhost/35321] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-24 23:06:13,691 INFO [Listener at localhost/35321] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/40a10de8-ef1a-d60f-e3da-b5fca02ca095/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-24 23:06:13,691 INFO [Listener at localhost/35321] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/40a10de8-ef1a-d60f-e3da-b5fca02ca095/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-24 23:06:13,691 INFO [Listener at localhost/35321] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/40a10de8-ef1a-d60f-e3da-b5fca02ca095/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-24 23:06:13,692 INFO [Listener at localhost/35321] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/40a10de8-ef1a-d60f-e3da-b5fca02ca095/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-24 23:06:13,692 INFO [Listener at localhost/35321] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/40a10de8-ef1a-d60f-e3da-b5fca02ca095/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-24 23:06:13,692 INFO [Listener at localhost/35321] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/40a10de8-ef1a-d60f-e3da-b5fca02ca095/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-24 23:06:13,692 INFO [Listener at localhost/35321] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/40a10de8-ef1a-d60f-e3da-b5fca02ca095/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-24 23:06:13,693 INFO [Listener at localhost/35321] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/40a10de8-ef1a-d60f-e3da-b5fca02ca095/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-24 23:06:13,693 INFO [Listener at localhost/35321] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/40a10de8-ef1a-d60f-e3da-b5fca02ca095/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-24 23:06:13,693 INFO [Listener at localhost/35321] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/40a10de8-ef1a-d60f-e3da-b5fca02ca095/nfs.dump.dir in system properties and HBase conf 2023-07-24 23:06:13,693 INFO [Listener at localhost/35321] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/40a10de8-ef1a-d60f-e3da-b5fca02ca095/java.io.tmpdir in system properties and HBase conf 2023-07-24 23:06:13,694 INFO [Listener at localhost/35321] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/40a10de8-ef1a-d60f-e3da-b5fca02ca095/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-24 23:06:13,694 INFO [Listener at localhost/35321] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/40a10de8-ef1a-d60f-e3da-b5fca02ca095/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-24 23:06:13,694 INFO [Listener at localhost/35321] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/40a10de8-ef1a-d60f-e3da-b5fca02ca095/fs.s3a.committer.staging.tmp.path in system properties and HBase conf 2023-07-24 23:06:13,697 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(866): Instantiated hbase:acl,,1690239973596.491925dfdedb8219e0d8fb183d9a55b9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 23:06:13,697 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1604): Closing 491925dfdedb8219e0d8fb183d9a55b9, disabling compactions & flushes 2023-07-24 23:06:13,697 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1626): Closing region hbase:acl,,1690239973596.491925dfdedb8219e0d8fb183d9a55b9. 2023-07-24 23:06:13,697 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1690239973596.491925dfdedb8219e0d8fb183d9a55b9. 2023-07-24 23:06:13,697 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1690239973596.491925dfdedb8219e0d8fb183d9a55b9. after waiting 0 ms 2023-07-24 23:06:13,698 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1690239973596.491925dfdedb8219e0d8fb183d9a55b9. 2023-07-24 23:06:13,698 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1838): Closed hbase:acl,,1690239973596.491925dfdedb8219e0d8fb183d9a55b9. 2023-07-24 23:06:13,698 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1558): Region close journal for 491925dfdedb8219e0d8fb183d9a55b9: 2023-07-24 23:06:13,702 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ADD_TO_META 2023-07-24 23:06:13,704 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:acl,,1690239973596.491925dfdedb8219e0d8fb183d9a55b9.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1690239973704"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690239973704"}]},"ts":"1690239973704"} 2023-07-24 23:06:13,707 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-24 23:06:13,708 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-24 23:06:13,709 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690239973709"}]},"ts":"1690239973709"} 2023-07-24 23:06:13,711 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLING in hbase:meta 2023-07-24 23:06:13,718 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-24 23:06:13,719 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-24 23:06:13,719 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-24 23:06:13,719 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-24 23:06:13,719 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-24 23:06:13,719 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=491925dfdedb8219e0d8fb183d9a55b9, ASSIGN}] 2023-07-24 23:06:13,722 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=491925dfdedb8219e0d8fb183d9a55b9, ASSIGN 2023-07-24 23:06:13,727 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:acl, region=491925dfdedb8219e0d8fb183d9a55b9, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33227,1690239969957; forceNewPlan=false, retain=false 2023-07-24 23:06:13,728 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-24 23:06:13,877 INFO [jenkins-hbase4:37213] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-24 23:06:13,878 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=491925dfdedb8219e0d8fb183d9a55b9, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:06:13,879 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:acl,,1690239973596.491925dfdedb8219e0d8fb183d9a55b9.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1690239973878"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690239973878"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690239973878"}]},"ts":"1690239973878"} 2023-07-24 23:06:13,882 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure 491925dfdedb8219e0d8fb183d9a55b9, server=jenkins-hbase4.apache.org,33227,1690239969957}] 2023-07-24 23:06:13,981 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-24 23:06:14,052 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:acl,,1690239973596.491925dfdedb8219e0d8fb183d9a55b9. 2023-07-24 23:06:14,052 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 491925dfdedb8219e0d8fb183d9a55b9, NAME => 'hbase:acl,,1690239973596.491925dfdedb8219e0d8fb183d9a55b9.', STARTKEY => '', ENDKEY => ''} 2023-07-24 23:06:14,052 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:acl,,1690239973596.491925dfdedb8219e0d8fb183d9a55b9. service=AccessControlService 2023-07-24 23:06:14,053 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 23:06:14,053 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table acl 491925dfdedb8219e0d8fb183d9a55b9 2023-07-24 23:06:14,053 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:acl,,1690239973596.491925dfdedb8219e0d8fb183d9a55b9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 23:06:14,053 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 491925dfdedb8219e0d8fb183d9a55b9 2023-07-24 23:06:14,053 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 491925dfdedb8219e0d8fb183d9a55b9 2023-07-24 23:06:14,068 INFO [StoreOpener-491925dfdedb8219e0d8fb183d9a55b9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family l of region 491925dfdedb8219e0d8fb183d9a55b9 2023-07-24 23:06:14,072 DEBUG [StoreOpener-491925dfdedb8219e0d8fb183d9a55b9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/hbase/acl/491925dfdedb8219e0d8fb183d9a55b9/l 2023-07-24 23:06:14,072 DEBUG [StoreOpener-491925dfdedb8219e0d8fb183d9a55b9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/hbase/acl/491925dfdedb8219e0d8fb183d9a55b9/l 2023-07-24 23:06:14,073 INFO [StoreOpener-491925dfdedb8219e0d8fb183d9a55b9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 491925dfdedb8219e0d8fb183d9a55b9 columnFamilyName l 2023-07-24 23:06:14,077 INFO [StoreOpener-491925dfdedb8219e0d8fb183d9a55b9-1] regionserver.HStore(310): Store=491925dfdedb8219e0d8fb183d9a55b9/l, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 23:06:14,081 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/hbase/acl/491925dfdedb8219e0d8fb183d9a55b9 2023-07-24 23:06:14,082 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/hbase/acl/491925dfdedb8219e0d8fb183d9a55b9 2023-07-24 23:06:14,088 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 491925dfdedb8219e0d8fb183d9a55b9 2023-07-24 23:06:14,096 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/hbase/acl/491925dfdedb8219e0d8fb183d9a55b9/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-24 23:06:14,098 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 491925dfdedb8219e0d8fb183d9a55b9; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73852899, jitterRate=0.10049395263195038}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-24 23:06:14,098 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 491925dfdedb8219e0d8fb183d9a55b9: 2023-07-24 23:06:14,102 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:acl,,1690239973596.491925dfdedb8219e0d8fb183d9a55b9., pid=11, masterSystemTime=1690239974039 2023-07-24 23:06:14,106 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:acl,,1690239973596.491925dfdedb8219e0d8fb183d9a55b9. 2023-07-24 23:06:14,106 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:acl,,1690239973596.491925dfdedb8219e0d8fb183d9a55b9. 2023-07-24 23:06:14,107 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=491925dfdedb8219e0d8fb183d9a55b9, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:06:14,108 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:acl,,1690239973596.491925dfdedb8219e0d8fb183d9a55b9.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1690239974107"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690239974107"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690239974107"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690239974107"}]},"ts":"1690239974107"} 2023-07-24 23:06:14,118 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-07-24 23:06:14,118 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure 491925dfdedb8219e0d8fb183d9a55b9, server=jenkins-hbase4.apache.org,33227,1690239969957 in 229 msec 2023-07-24 23:06:14,124 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=10, resume processing ppid=9 2023-07-24 23:06:14,124 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=hbase:acl, region=491925dfdedb8219e0d8fb183d9a55b9, ASSIGN in 399 msec 2023-07-24 23:06:14,126 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-24 23:06:14,126 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690239974126"}]},"ts":"1690239974126"} 2023-07-24 23:06:14,129 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLED in hbase:meta 2023-07-24 23:06:14,132 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_POST_OPERATION 2023-07-24 23:06:14,136 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=9, state=SUCCESS; CreateTableProcedure table=hbase:acl in 531 msec 2023-07-24 23:06:14,282 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-24 23:06:14,282 INFO [master/jenkins-hbase4:0:becomeActiveMaster] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: hbase:acl, procId: 9 completed 2023-07-24 23:06:14,302 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-07-24 23:06:14,992 WARN [Thread-385] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-24 23:06:15,300 INFO [Thread-385] log.Slf4jLog(67): jetty-6.1.26 2023-07-24 23:06:15,306 INFO [Thread-385] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/jobhistory to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/40a10de8-ef1a-d60f-e3da-b5fca02ca095/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_33167_jobhistory____m3a5ff/webapp 2023-07-24 23:06:15,465 INFO [Thread-385] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices as a root resource class 2023-07-24 23:06:15,465 INFO [Thread-385] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver as a provider class 2023-07-24 23:06:15,465 INFO [Thread-385] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-24 23:06:15,468 INFO [Thread-385] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-24 23:06:15,539 INFO [Thread-385] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-24 23:06:15,815 INFO [Thread-385] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-24 23:06:16,240 INFO [Thread-385] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices to GuiceManagedComponentProvider with the scope "PerRequest" 2023-07-24 23:06:16,331 INFO [Thread-385] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:33167 2023-07-24 23:06:16,496 WARN [Listener at jenkins-hbase4.apache.org/37653] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-24 23:06:16,903 WARN [Listener at jenkins-hbase4.apache.org/37653] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-24 23:06:16,904 INFO [Listener at jenkins-hbase4.apache.org/37653] log.Slf4jLog(67): jetty-6.1.26 2023-07-24 23:06:16,912 INFO [Listener at jenkins-hbase4.apache.org/37653] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/cluster to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/40a10de8-ef1a-d60f-e3da-b5fca02ca095/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_34769_cluster____6l551n/webapp 2023-07-24 23:06:16,991 INFO [Listener at jenkins-hbase4.apache.org/37653] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver as a provider class 2023-07-24 23:06:16,992 INFO [Listener at jenkins-hbase4.apache.org/37653] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices as a root resource class 2023-07-24 23:06:16,992 INFO [Listener at jenkins-hbase4.apache.org/37653] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-24 23:06:16,992 INFO [Listener at jenkins-hbase4.apache.org/37653] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-24 23:06:17,004 INFO [Listener at jenkins-hbase4.apache.org/37653] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-24 23:06:17,319 INFO [Listener at jenkins-hbase4.apache.org/37653] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-24 23:06:17,555 INFO [Listener at jenkins-hbase4.apache.org/37653] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-24 23:06:17,591 INFO [Listener at jenkins-hbase4.apache.org/37653] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:34769 2023-07-24 23:06:18,187 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-24 23:06:18,255 WARN [Listener at jenkins-hbase4.apache.org/36211] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-24 23:06:18,292 WARN [Listener at jenkins-hbase4.apache.org/36211] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-24 23:06:18,293 INFO [Listener at jenkins-hbase4.apache.org/36211] log.Slf4jLog(67): jetty-6.1.26 2023-07-24 23:06:18,304 INFO [Listener at jenkins-hbase4.apache.org/36211] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/40a10de8-ef1a-d60f-e3da-b5fca02ca095/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_33799_node____.m0m4y3/webapp 2023-07-24 23:06:18,342 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-07-24 23:06:18,343 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:acl' 2023-07-24 23:06:18,344 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-07-24 23:06:18,372 INFO [Listener at jenkins-hbase4.apache.org/36211] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-07-24 23:06:18,372 INFO [Listener at jenkins-hbase4.apache.org/36211] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-24 23:06:18,372 INFO [Listener at jenkins-hbase4.apache.org/36211] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-07-24 23:06:18,372 INFO [Listener at jenkins-hbase4.apache.org/36211] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-24 23:06:18,382 INFO [Listener at jenkins-hbase4.apache.org/36211] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-24 23:06:18,410 INFO [Listener at jenkins-hbase4.apache.org/36211] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-24 23:06:18,483 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 23:06:18,483 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionServerObservers 2023-07-24 23:06:18,484 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 23:06:18,484 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase MasterObservers 2023-07-24 23:06:18,484 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-24 23:06:18,484 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver Metrics about HBase MasterObservers 2023-07-24 23:06:18,484 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 23:06:18,485 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionObservers 2023-07-24 23:06:18,485 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-24 23:06:18,485 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-07-24 23:06:18,499 INFO [Listener at jenkins-hbase4.apache.org/36211] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-24 23:06:18,513 INFO [Listener at jenkins-hbase4.apache.org/36211] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:33799 2023-07-24 23:06:18,787 WARN [Listener at jenkins-hbase4.apache.org/43617] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-24 23:06:18,795 WARN [Listener at jenkins-hbase4.apache.org/43617] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-24 23:06:18,795 INFO [Listener at jenkins-hbase4.apache.org/43617] log.Slf4jLog(67): jetty-6.1.26 2023-07-24 23:06:18,806 INFO [Listener at jenkins-hbase4.apache.org/43617] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/40a10de8-ef1a-d60f-e3da-b5fca02ca095/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_46621_node____.czg32n/webapp 2023-07-24 23:06:18,866 INFO [Listener at jenkins-hbase4.apache.org/43617] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-07-24 23:06:18,866 INFO [Listener at jenkins-hbase4.apache.org/43617] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-24 23:06:18,866 INFO [Listener at jenkins-hbase4.apache.org/43617] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-07-24 23:06:18,866 INFO [Listener at jenkins-hbase4.apache.org/43617] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-24 23:06:18,875 INFO [Listener at jenkins-hbase4.apache.org/43617] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-24 23:06:18,891 INFO [Listener at jenkins-hbase4.apache.org/43617] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-24 23:06:18,982 INFO [Listener at jenkins-hbase4.apache.org/43617] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-24 23:06:19,001 INFO [Listener at jenkins-hbase4.apache.org/43617] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:46621 2023-07-24 23:06:19,032 INFO [Listener at jenkins-hbase4.apache.org/43617] hbase.HBaseTestingUtility(2726): Mini mapreduce cluster started 2023-07-24 23:06:19,034 INFO [Listener at jenkins-hbase4.apache.org/43617] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2023-07-24 23:06:19,113 INFO [Listener at jenkins-hbase4.apache.org/43617] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testExportWithTargetName Thread=708, OpenFileDescriptor=906, MaxFileDescriptor=60000, SystemLoadAverage=344, ProcessCount=174, AvailableMemoryMB=7711 2023-07-24 23:06:19,113 WARN [Listener at jenkins-hbase4.apache.org/43617] hbase.ResourceChecker(130): Thread=708 is superior to 500 2023-07-24 23:06:19,125 DEBUG [Listener at jenkins-hbase4.apache.org/43617] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-24 23:06:19,132 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60992, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-07-24 23:06:19,139 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-24 23:06:19,142 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] procedure2.ProcedureExecutor(1029): Stored pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportWithTargetName 2023-07-24 23:06:19,145 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_PRE_OPERATION 2023-07-24 23:06:19,145 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportWithTargetName" procId is: 12 2023-07-24 23:06:19,148 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-24 23:06:19,150 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-24 23:06:19,153 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.tmp/data/default/testtb-testExportWithTargetName/563aad54bb156f988e63545967e41553 2023-07-24 23:06:19,153 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.tmp/data/default/testtb-testExportWithTargetName/36437467100446c83969844ad3c54280 2023-07-24 23:06:19,155 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.tmp/data/default/testtb-testExportWithTargetName/563aad54bb156f988e63545967e41553 empty. 2023-07-24 23:06:19,155 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.tmp/data/default/testtb-testExportWithTargetName/36437467100446c83969844ad3c54280 empty. 2023-07-24 23:06:19,156 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.tmp/data/default/testtb-testExportWithTargetName/563aad54bb156f988e63545967e41553 2023-07-24 23:06:19,157 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.tmp/data/default/testtb-testExportWithTargetName/36437467100446c83969844ad3c54280 2023-07-24 23:06:19,157 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-07-24 23:06:19,196 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.tmp/data/default/testtb-testExportWithTargetName/.tabledesc/.tableinfo.0000000001 2023-07-24 23:06:19,198 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(7675): creating {ENCODED => 36437467100446c83969844ad3c54280, NAME => 'testtb-testExportWithTargetName,1,1690239979139.36437467100446c83969844ad3c54280.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.tmp 2023-07-24 23:06:19,198 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(7675): creating {ENCODED => 563aad54bb156f988e63545967e41553, NAME => 'testtb-testExportWithTargetName,,1690239979139.563aad54bb156f988e63545967e41553.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.tmp 2023-07-24 23:06:19,243 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1690239979139.563aad54bb156f988e63545967e41553.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 23:06:19,243 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1690239979139.36437467100446c83969844ad3c54280.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 23:06:19,249 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1604): Closing 36437467100446c83969844ad3c54280, disabling compactions & flushes 2023-07-24 23:06:19,250 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1690239979139.36437467100446c83969844ad3c54280. 2023-07-24 23:06:19,250 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1690239979139.36437467100446c83969844ad3c54280. 2023-07-24 23:06:19,250 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1690239979139.36437467100446c83969844ad3c54280. after waiting 0 ms 2023-07-24 23:06:19,250 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1690239979139.36437467100446c83969844ad3c54280. 2023-07-24 23:06:19,250 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1690239979139.36437467100446c83969844ad3c54280. 2023-07-24 23:06:19,250 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1558): Region close journal for 36437467100446c83969844ad3c54280: 2023-07-24 23:06:19,243 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1604): Closing 563aad54bb156f988e63545967e41553, disabling compactions & flushes 2023-07-24 23:06:19,251 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1690239979139.563aad54bb156f988e63545967e41553. 2023-07-24 23:06:19,251 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1690239979139.563aad54bb156f988e63545967e41553. 2023-07-24 23:06:19,251 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1690239979139.563aad54bb156f988e63545967e41553. after waiting 0 ms 2023-07-24 23:06:19,251 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1690239979139.563aad54bb156f988e63545967e41553. 2023-07-24 23:06:19,251 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1690239979139.563aad54bb156f988e63545967e41553. 2023-07-24 23:06:19,251 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1558): Region close journal for 563aad54bb156f988e63545967e41553: 2023-07-24 23:06:19,255 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-24 23:06:19,258 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ADD_TO_META 2023-07-24 23:06:19,260 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1690239979139.36437467100446c83969844ad3c54280.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690239979259"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690239979259"}]},"ts":"1690239979259"} 2023-07-24 23:06:19,260 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1690239979139.563aad54bb156f988e63545967e41553.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690239979259"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690239979259"}]},"ts":"1690239979259"} 2023-07-24 23:06:19,313 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-24 23:06:19,315 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-24 23:06:19,315 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690239979315"}]},"ts":"1690239979315"} 2023-07-24 23:06:19,318 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLING in hbase:meta 2023-07-24 23:06:19,323 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-24 23:06:19,324 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-24 23:06:19,324 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-24 23:06:19,324 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-24 23:06:19,325 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-24 23:06:19,325 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=563aad54bb156f988e63545967e41553, ASSIGN}, {pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=36437467100446c83969844ad3c54280, ASSIGN}] 2023-07-24 23:06:19,328 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=563aad54bb156f988e63545967e41553, ASSIGN 2023-07-24 23:06:19,328 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=36437467100446c83969844ad3c54280, ASSIGN 2023-07-24 23:06:19,329 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=36437467100446c83969844ad3c54280, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33227,1690239969957; forceNewPlan=false, retain=false 2023-07-24 23:06:19,329 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=563aad54bb156f988e63545967e41553, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39013,1690239969874; forceNewPlan=false, retain=false 2023-07-24 23:06:19,457 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-24 23:06:19,479 INFO [jenkins-hbase4:37213] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-24 23:06:19,482 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=563aad54bb156f988e63545967e41553, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39013,1690239969874 2023-07-24 23:06:19,482 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=36437467100446c83969844ad3c54280, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:06:19,482 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1690239979139.36437467100446c83969844ad3c54280.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690239979481"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690239979481"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690239979481"}]},"ts":"1690239979481"} 2023-07-24 23:06:19,482 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1690239979139.563aad54bb156f988e63545967e41553.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690239979481"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690239979481"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690239979481"}]},"ts":"1690239979481"} 2023-07-24 23:06:19,485 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=15, ppid=14, state=RUNNABLE; OpenRegionProcedure 36437467100446c83969844ad3c54280, server=jenkins-hbase4.apache.org,33227,1690239969957}] 2023-07-24 23:06:19,486 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=13, state=RUNNABLE; OpenRegionProcedure 563aad54bb156f988e63545967e41553, server=jenkins-hbase4.apache.org,39013,1690239969874}] 2023-07-24 23:06:19,649 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,,1690239979139.563aad54bb156f988e63545967e41553. 2023-07-24 23:06:19,649 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 563aad54bb156f988e63545967e41553, NAME => 'testtb-testExportWithTargetName,,1690239979139.563aad54bb156f988e63545967e41553.', STARTKEY => '', ENDKEY => '1'} 2023-07-24 23:06:19,649 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,1,1690239979139.36437467100446c83969844ad3c54280. 2023-07-24 23:06:19,649 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 36437467100446c83969844ad3c54280, NAME => 'testtb-testExportWithTargetName,1,1690239979139.36437467100446c83969844ad3c54280.', STARTKEY => '1', ENDKEY => ''} 2023-07-24 23:06:19,649 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,,1690239979139.563aad54bb156f988e63545967e41553. service=AccessControlService 2023-07-24 23:06:19,649 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,1,1690239979139.36437467100446c83969844ad3c54280. service=AccessControlService 2023-07-24 23:06:19,650 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 23:06:19,650 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName 36437467100446c83969844ad3c54280 2023-07-24 23:06:19,650 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1690239979139.36437467100446c83969844ad3c54280.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 23:06:19,650 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 36437467100446c83969844ad3c54280 2023-07-24 23:06:19,650 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 36437467100446c83969844ad3c54280 2023-07-24 23:06:19,650 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 23:06:19,651 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName 563aad54bb156f988e63545967e41553 2023-07-24 23:06:19,651 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1690239979139.563aad54bb156f988e63545967e41553.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 23:06:19,651 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 563aad54bb156f988e63545967e41553 2023-07-24 23:06:19,651 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 563aad54bb156f988e63545967e41553 2023-07-24 23:06:19,653 INFO [StoreOpener-36437467100446c83969844ad3c54280-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 36437467100446c83969844ad3c54280 2023-07-24 23:06:19,654 INFO [StoreOpener-563aad54bb156f988e63545967e41553-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 563aad54bb156f988e63545967e41553 2023-07-24 23:06:19,656 DEBUG [StoreOpener-36437467100446c83969844ad3c54280-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/default/testtb-testExportWithTargetName/36437467100446c83969844ad3c54280/cf 2023-07-24 23:06:19,656 DEBUG [StoreOpener-36437467100446c83969844ad3c54280-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/default/testtb-testExportWithTargetName/36437467100446c83969844ad3c54280/cf 2023-07-24 23:06:19,658 INFO [StoreOpener-36437467100446c83969844ad3c54280-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 36437467100446c83969844ad3c54280 columnFamilyName cf 2023-07-24 23:06:19,658 DEBUG [StoreOpener-563aad54bb156f988e63545967e41553-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/default/testtb-testExportWithTargetName/563aad54bb156f988e63545967e41553/cf 2023-07-24 23:06:19,658 DEBUG [StoreOpener-563aad54bb156f988e63545967e41553-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/default/testtb-testExportWithTargetName/563aad54bb156f988e63545967e41553/cf 2023-07-24 23:06:19,659 INFO [StoreOpener-563aad54bb156f988e63545967e41553-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 563aad54bb156f988e63545967e41553 columnFamilyName cf 2023-07-24 23:06:19,659 INFO [StoreOpener-36437467100446c83969844ad3c54280-1] regionserver.HStore(310): Store=36437467100446c83969844ad3c54280/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 23:06:19,661 INFO [StoreOpener-563aad54bb156f988e63545967e41553-1] regionserver.HStore(310): Store=563aad54bb156f988e63545967e41553/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 23:06:19,664 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/default/testtb-testExportWithTargetName/36437467100446c83969844ad3c54280 2023-07-24 23:06:19,664 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/default/testtb-testExportWithTargetName/563aad54bb156f988e63545967e41553 2023-07-24 23:06:19,671 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/default/testtb-testExportWithTargetName/563aad54bb156f988e63545967e41553 2023-07-24 23:06:19,671 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/default/testtb-testExportWithTargetName/36437467100446c83969844ad3c54280 2023-07-24 23:06:19,677 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 36437467100446c83969844ad3c54280 2023-07-24 23:06:19,680 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 563aad54bb156f988e63545967e41553 2023-07-24 23:06:19,685 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/default/testtb-testExportWithTargetName/36437467100446c83969844ad3c54280/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-24 23:06:19,686 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 36437467100446c83969844ad3c54280; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64288005, jitterRate=-0.042034074664115906}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-24 23:06:19,687 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 36437467100446c83969844ad3c54280: 2023-07-24 23:06:19,688 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,1,1690239979139.36437467100446c83969844ad3c54280., pid=15, masterSystemTime=1690239979638 2023-07-24 23:06:19,689 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/default/testtb-testExportWithTargetName/563aad54bb156f988e63545967e41553/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-24 23:06:19,690 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 563aad54bb156f988e63545967e41553; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67311365, jitterRate=0.0030175000429153442}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-24 23:06:19,690 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 563aad54bb156f988e63545967e41553: 2023-07-24 23:06:19,691 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,1,1690239979139.36437467100446c83969844ad3c54280. 2023-07-24 23:06:19,691 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,1,1690239979139.36437467100446c83969844ad3c54280. 2023-07-24 23:06:19,692 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=36437467100446c83969844ad3c54280, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:06:19,693 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,1,1690239979139.36437467100446c83969844ad3c54280.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690239979692"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690239979692"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690239979692"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690239979692"}]},"ts":"1690239979692"} 2023-07-24 23:06:19,696 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,,1690239979139.563aad54bb156f988e63545967e41553., pid=16, masterSystemTime=1690239979638 2023-07-24 23:06:19,700 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,,1690239979139.563aad54bb156f988e63545967e41553. 2023-07-24 23:06:19,701 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,,1690239979139.563aad54bb156f988e63545967e41553. 2023-07-24 23:06:19,701 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=563aad54bb156f988e63545967e41553, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39013,1690239969874 2023-07-24 23:06:19,703 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,,1690239979139.563aad54bb156f988e63545967e41553.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690239979701"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690239979701"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690239979701"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690239979701"}]},"ts":"1690239979701"} 2023-07-24 23:06:19,704 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=15, resume processing ppid=14 2023-07-24 23:06:19,704 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=14, state=SUCCESS; OpenRegionProcedure 36437467100446c83969844ad3c54280, server=jenkins-hbase4.apache.org,33227,1690239969957 in 212 msec 2023-07-24 23:06:19,708 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=36437467100446c83969844ad3c54280, ASSIGN in 379 msec 2023-07-24 23:06:19,712 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=13 2023-07-24 23:06:19,712 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=13, state=SUCCESS; OpenRegionProcedure 563aad54bb156f988e63545967e41553, server=jenkins-hbase4.apache.org,39013,1690239969874 in 220 msec 2023-07-24 23:06:19,715 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=13, resume processing ppid=12 2023-07-24 23:06:19,715 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=563aad54bb156f988e63545967e41553, ASSIGN in 387 msec 2023-07-24 23:06:19,716 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-24 23:06:19,716 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690239979716"}]},"ts":"1690239979716"} 2023-07-24 23:06:19,718 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLED in hbase:meta 2023-07-24 23:06:19,721 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_POST_OPERATION 2023-07-24 23:06:19,726 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportWithTargetName jenkins: RWXCA 2023-07-24 23:06:19,738 DEBUG [hconnection-0x2b5645cf-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 23:06:19,742 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52282, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=ClientService 2023-07-24 23:06:19,753 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33227] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-24 23:06:19,758 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-24 23:06:19,792 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:39595-0x1019995a36f0001, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-24 23:06:19,792 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:33227-0x1019995a36f0003, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-24 23:06:19,792 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-24 23:06:19,792 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-24 23:06:19,795 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:39013-0x1019995a36f0002, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-24 23:06:19,801 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-24 23:06:19,801 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-24 23:06:19,801 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-24 23:06:19,803 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-24 23:06:19,807 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=12, state=SUCCESS; CreateTableProcedure table=testtb-testExportWithTargetName in 664 msec 2023-07-24 23:06:20,260 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-24 23:06:20,261 INFO [Listener at jenkins-hbase4.apache.org/43617] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportWithTargetName, procId: 12 completed 2023-07-24 23:06:20,261 DEBUG [Listener at jenkins-hbase4.apache.org/43617] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testExportWithTargetName get assigned. Timeout = 60000ms 2023-07-24 23:06:20,263 INFO [Listener at jenkins-hbase4.apache.org/43617] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-24 23:06:20,268 INFO [Listener at jenkins-hbase4.apache.org/43617] hbase.HBaseTestingUtility(3484): All regions for table testtb-testExportWithTargetName assigned to meta. Checking AM states. 2023-07-24 23:06:20,269 INFO [Listener at jenkins-hbase4.apache.org/43617] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-24 23:06:20,269 INFO [Listener at jenkins-hbase4.apache.org/43617] hbase.HBaseTestingUtility(3504): All regions for table testtb-testExportWithTargetName assigned. 2023-07-24 23:06:20,289 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-24 23:06:20,289 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690239980289 (current time:1690239980289). 2023-07-24 23:06:20,289 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-24 23:06:20,289 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] zookeeper.ReadOnlyZKClient(139): Connect 0x219e8e23 to 127.0.0.1:52881 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 23:06:20,302 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4ad6de4c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 23:06:20,305 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 23:06:20,309 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52284, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 23:06:20,311 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x219e8e23 to 127.0.0.1:52881 2023-07-24 23:06:20,311 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 23:06:20,313 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] zookeeper.ReadOnlyZKClient(139): Connect 0x1f06a5a6 to 127.0.0.1:52881 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 23:06:20,320 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@442b787d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 23:06:20,323 DEBUG [hconnection-0x27ff0c9c-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 23:06:20,324 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58680, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 23:06:20,328 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 23:06:20,331 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50608, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 23:06:20,332 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1f06a5a6 to 127.0.0.1:52881 2023-07-24 23:06:20,332 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 23:06:20,333 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-24 23:06:20,364 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-24 23:06:20,365 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-24 23:06:20,395 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] procedure2.ProcedureExecutor(1029): Stored pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-24 23:06:20,397 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-24 23:06:20,398 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=17, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1690240580398 2023-07-24 23:06:20,398 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-24 23:06:20,398 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-07-24 23:06:20,405 DEBUG [Listener at jenkins-hbase4.apache.org/43617] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-24 23:06:20,405 DEBUG [Listener at jenkins-hbase4.apache.org/43617] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-24 23:06:20,406 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-24 23:06:20,408 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=17, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-24 23:06:20,411 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=17, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 23 msec 2023-07-24 23:06:20,412 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-24 23:06:20,413 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1690240580413 2023-07-24 23:06:20,475 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportWithTargetName 2023-07-24 23:06:20,483 INFO [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportWithTargetName' 2023-07-24 23:06:20,483 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 23:06:20,484 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' 2023-07-24 23:06:20,484 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-07-24 23:06:20,486 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-24 23:06:20,486 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-24 23:06:20,494 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:39595-0x1019995a36f0001, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 23:06:20,494 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:39013-0x1019995a36f0002, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 23:06:20,494 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:06:20,494 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:33227-0x1019995a36f0003, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 23:06:20,494 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 23:06:20,494 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 23:06:20,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 23:06:20,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 23:06:20,494 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 23:06:20,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 23:06:20,494 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:06:20,494 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39013,1690239969874 2023-07-24 23:06:20,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-24 23:06:20,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-24 23:06:20,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-24 23:06:20,495 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39013,1690239969874 2023-07-24 23:06:20,496 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33227-0x1019995a36f0003, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-24 23:06:20,496 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39013-0x1019995a36f0002, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-24 23:06:20,495 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39595-0x1019995a36f0001, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-24 23:06:20,497 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-24 23:06:20,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-24 23:06:20,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-24 23:06:20,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-24 23:06:20,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-24 23:06:20,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-24 23:06:20,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-24 23:06:20,503 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-24 23:06:20,503 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-24 23:06:20,503 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-24 23:06:20,505 DEBUG [Listener at jenkins-hbase4.apache.org/43617] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 23:06:20,508 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-24 23:06:20,510 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-24 23:06:20,511 DEBUG [Listener at jenkins-hbase4.apache.org/43617] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-24 23:06:20,512 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-24 23:06:20,512 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-24 23:06:20,513 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-24 23:06:20,515 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1690239969801' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-24 23:06:20,515 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1690239969801' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 23:06:20,519 DEBUG [member: 'jenkins-hbase4.apache.org,39013,1690239969874' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-24 23:06:20,519 DEBUG [member: 'jenkins-hbase4.apache.org,39013,1690239969874' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 23:06:20,521 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1690239969801' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-24 23:06:20,521 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-24 23:06:20,521 DEBUG [member: 'jenkins-hbase4.apache.org,39013,1690239969874' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-24 23:06:20,522 DEBUG [member: 'jenkins-hbase4.apache.org,39013,1690239969874' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-24 23:06:20,521 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1690239969801' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-24 23:06:20,523 DEBUG [member: 'jenkins-hbase4.apache.org,39013,1690239969874' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39013,1690239969874' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-24 23:06:20,522 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 23:06:20,523 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1690239969801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39595,1690239969801' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-24 23:06:20,523 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-24 23:06:20,524 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-24 23:06:20,524 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33227,1690239969957' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-24 23:06:20,527 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39013,1690239969874 2023-07-24 23:06:20,528 DEBUG [member: 'jenkins-hbase4.apache.org,39013,1690239969874' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-24 23:06:20,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39013,1690239969874 2023-07-24 23:06:20,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 23:06:20,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 23:06:20,529 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:06:20,530 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1690239969801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-24 23:06:20,530 DEBUG [member: 'jenkins-hbase4.apache.org,39013,1690239969874' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39013-0x1019995a36f0002, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-24 23:06:20,530 DEBUG [member: 'jenkins-hbase4.apache.org,39013,1690239969874' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 23:06:20,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 23:06:20,530 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1690239969801' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39595-0x1019995a36f0001, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-24 23:06:20,530 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1690239969801' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 23:06:20,530 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-24 23:06:20,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 23:06:20,531 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33227-0x1019995a36f0003, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-24 23:06:20,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-24 23:06:20,531 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 23:06:20,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:06:20,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39013,1690239969874 2023-07-24 23:06:20,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39595,1690239969801 2023-07-24 23:06:20,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 23:06:20,533 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39013,1690239969874' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-07-24 23:06:20,533 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@48f8ecfc[Count = 1] remaining members to acquire global barrier 2023-07-24 23:06:20,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:06:20,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 23:06:20,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 23:06:20,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 23:06:20,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 23:06:20,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-24 23:06:20,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:06:20,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39013,1690239969874 2023-07-24 23:06:20,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39595,1690239969801 2023-07-24 23:06:20,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 23:06:20,542 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33227,1690239969957' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-07-24 23:06:20,542 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@48f8ecfc[Count = 0] remaining members to acquire global barrier 2023-07-24 23:06:20,542 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-07-24 23:06:20,542 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-24 23:06:20,545 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:39595-0x1019995a36f0001, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-24 23:06:20,545 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:39013-0x1019995a36f0002, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-24 23:06:20,545 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-24 23:06:20,545 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-24 23:06:20,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-24 23:06:20,545 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:33227-0x1019995a36f0003, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-24 23:06:20,545 DEBUG [member: 'jenkins-hbase4.apache.org,39013,1690239969874' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-24 23:06:20,546 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-24 23:06:20,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-24 23:06:20,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-24 23:06:20,546 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-24 23:06:20,546 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39013,1690239969874 2023-07-24 23:06:20,546 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:06:20,547 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-24 23:06:20,550 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1690239969801' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-24 23:06:20,551 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1690239969801' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-24 23:06:20,551 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1690239969801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,39595,1690239969801' in zk 2023-07-24 23:06:20,572 DEBUG [member: 'jenkins-hbase4.apache.org,39013,1690239969874' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 23:06:20,572 DEBUG [rs(jenkins-hbase4.apache.org,39013,1690239969874)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1690239979139.563aad54bb156f988e63545967e41553. 2023-07-24 23:06:20,572 DEBUG [rs(jenkins-hbase4.apache.org,33227,1690239969957)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1690239979139.36437467100446c83969844ad3c54280. 2023-07-24 23:06:20,572 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1690239969801' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-24 23:06:20,573 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1690239969801' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 23:06:20,573 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1690239969801' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-24 23:06:20,572 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 23:06:20,574 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 23:06:20,572 DEBUG [member: 'jenkins-hbase4.apache.org,39013,1690239969874' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 23:06:20,574 DEBUG [rs(jenkins-hbase4.apache.org,33227,1690239969957)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1690239979139.36437467100446c83969844ad3c54280. started... 2023-07-24 23:06:20,575 DEBUG [rs(jenkins-hbase4.apache.org,39013,1690239969874)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1690239979139.563aad54bb156f988e63545967e41553. started... 2023-07-24 23:06:20,578 DEBUG [rs(jenkins-hbase4.apache.org,39013,1690239969874)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 563aad54bb156f988e63545967e41553: 2023-07-24 23:06:20,580 DEBUG [rs(jenkins-hbase4.apache.org,33227,1690239969957)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 36437467100446c83969844ad3c54280: 2023-07-24 23:06:20,581 DEBUG [rs(jenkins-hbase4.apache.org,39013,1690239969874)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1690239979139.563aad54bb156f988e63545967e41553.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-24 23:06:20,582 DEBUG [rs(jenkins-hbase4.apache.org,33227,1690239969957)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1690239979139.36437467100446c83969844ad3c54280.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-24 23:06:20,588 DEBUG [rs(jenkins-hbase4.apache.org,39013,1690239969874)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 23:06:20,588 DEBUG [rs(jenkins-hbase4.apache.org,33227,1690239969957)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 23:06:20,594 DEBUG [rs(jenkins-hbase4.apache.org,39013,1690239969874)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-24 23:06:20,596 DEBUG [rs(jenkins-hbase4.apache.org,33227,1690239969957)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-24 23:06:20,695 DEBUG [rs(jenkins-hbase4.apache.org,39013,1690239969874)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1690239979139.563aad54bb156f988e63545967e41553. completed. 2023-07-24 23:06:20,695 DEBUG [rs(jenkins-hbase4.apache.org,39013,1690239969874)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1690239979139.563aad54bb156f988e63545967e41553. 2023-07-24 23:06:20,696 DEBUG [member: 'jenkins-hbase4.apache.org,39013,1690239969874' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 23:06:20,697 DEBUG [member: 'jenkins-hbase4.apache.org,39013,1690239969874' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 23:06:20,697 DEBUG [member: 'jenkins-hbase4.apache.org,39013,1690239969874' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39013,1690239969874 2023-07-24 23:06:20,697 DEBUG [member: 'jenkins-hbase4.apache.org,39013,1690239969874' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-24 23:06:20,697 DEBUG [member: 'jenkins-hbase4.apache.org,39013,1690239969874' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,39013,1690239969874' in zk 2023-07-24 23:06:20,700 DEBUG [member: 'jenkins-hbase4.apache.org,39013,1690239969874' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-24 23:06:20,700 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39013,1690239969874 2023-07-24 23:06:20,700 DEBUG [member: 'jenkins-hbase4.apache.org,39013,1690239969874' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 23:06:20,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39013,1690239969874 2023-07-24 23:06:20,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 23:06:20,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 23:06:20,700 DEBUG [rs(jenkins-hbase4.apache.org,33227,1690239969957)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1690239979139.36437467100446c83969844ad3c54280. completed. 2023-07-24 23:06:20,700 DEBUG [member: 'jenkins-hbase4.apache.org,39013,1690239969874' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-24 23:06:20,701 DEBUG [rs(jenkins-hbase4.apache.org,33227,1690239969957)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1690239979139.36437467100446c83969844ad3c54280. 2023-07-24 23:06:20,702 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 23:06:20,702 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 23:06:20,702 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:06:20,702 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-24 23:06:20,702 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,33227,1690239969957' in zk 2023-07-24 23:06:20,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 23:06:20,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 23:06:20,703 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-24 23:06:20,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-24 23:06:20,703 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:06:20,703 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 23:06:20,704 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-24 23:06:20,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:06:20,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39013,1690239969874 2023-07-24 23:06:20,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39595,1690239969801 2023-07-24 23:06:20,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 23:06:20,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-24 23:06:20,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:06:20,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39013,1690239969874 2023-07-24 23:06:20,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39595,1690239969801 2023-07-24 23:06:20,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,39013,1690239969874': 2023-07-24 23:06:20,709 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39013,1690239969874' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-07-24 23:06:20,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:06:20,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 23:06:20,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 23:06:20,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 23:06:20,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 23:06:20,711 DEBUG [Listener at jenkins-hbase4.apache.org/43617] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 23:06:20,712 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-24 23:06:20,712 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-24 23:06:20,713 DEBUG [Listener at jenkins-hbase4.apache.org/43617] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-24 23:06:20,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-24 23:06:20,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:06:20,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39013,1690239969874 2023-07-24 23:06:20,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39595,1690239969801 2023-07-24 23:06:20,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 23:06:20,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-24 23:06:20,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:06:20,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39013,1690239969874 2023-07-24 23:06:20,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39595,1690239969801 2023-07-24 23:06:20,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,33227,1690239969957': 2023-07-24 23:06:20,719 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33227,1690239969957' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-07-24 23:06:20,719 INFO [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportWithTargetName' execution completed 2023-07-24 23:06:20,720 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-24 23:06:20,720 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-24 23:06:20,720 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportWithTargetName 2023-07-24 23:06:20,720 INFO [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-24 23:06:20,723 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:39013-0x1019995a36f0002, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-24 23:06:20,723 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-24 23:06:20,723 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:39595-0x1019995a36f0001, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-24 23:06:20,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-24 23:06:20,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 23:06:20,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 23:06:20,724 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-24 23:06:20,724 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:39595-0x1019995a36f0001, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 23:06:20,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-24 23:06:20,724 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-24 23:06:20,724 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:33227-0x1019995a36f0003, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-24 23:06:20,724 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:33227-0x1019995a36f0003, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 23:06:20,724 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-24 23:06:20,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-24 23:06:20,723 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:39013-0x1019995a36f0002, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 23:06:20,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 23:06:20,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-24 23:06:20,725 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 23:06:20,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 23:06:20,725 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:06:20,725 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 23:06:20,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 23:06:20,725 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 23:06:20,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-24 23:06:20,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 23:06:20,725 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39013,1690239969874 2023-07-24 23:06:20,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-24 23:06:20,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-24 23:06:20,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 23:06:20,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-24 23:06:20,726 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39595,1690239969801 2023-07-24 23:06:20,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-24 23:06:20,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:06:20,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39013,1690239969874 2023-07-24 23:06:20,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39595,1690239969801 2023-07-24 23:06:20,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 23:06:20,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-24 23:06:20,729 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:06:20,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:06:20,729 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39013,1690239969874 2023-07-24 23:06:20,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39013,1690239969874 2023-07-24 23:06:20,730 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39595,1690239969801 2023-07-24 23:06:20,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39595,1690239969801 2023-07-24 23:06:20,765 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39595,1690239969801 2023-07-24 23:06:20,765 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:39013-0x1019995a36f0002, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 23:06:20,765 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:33227-0x1019995a36f0003, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 23:06:20,765 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 23:06:20,765 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 23:06:20,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 23:06:20,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 23:06:20,765 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:39595-0x1019995a36f0001, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 23:06:20,765 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:39595-0x1019995a36f0001, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 23:06:20,765 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-24 23:06:20,765 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:39013-0x1019995a36f0002, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 23:06:20,765 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39013,1690239969874 2023-07-24 23:06:20,765 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:06:20,765 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 23:06:20,765 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportWithTargetName 2023-07-24 23:06:20,765 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 23:06:20,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 23:06:20,766 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportWithTargetName 2023-07-24 23:06:20,765 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-24 23:06:20,766 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39595,1690239969801 2023-07-24 23:06:20,766 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 23:06:20,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 23:06:20,766 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-24 23:06:20,766 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39013,1690239969874 2023-07-24 23:06:20,766 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:06:20,766 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-24 23:06:20,766 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-24 23:06:20,766 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:33227-0x1019995a36f0003, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 23:06:20,766 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 23:06:20,766 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 23:06:20,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 23:06:20,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 23:06:20,775 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-24 23:06:20,861 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName to hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.hbase-snapshot/emptySnaptb0-testExportWithTargetName 2023-07-24 23:06:20,927 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-07-24 23:06:20,927 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-24 23:06:20,927 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-24 23:06:20,928 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1690239980399Consolidate snapshot: emptySnaptb0-testExportWithTargetName at 1690239980766 (+367 ms)Loading Region manifests for emptySnaptb0-testExportWithTargetName at 1690239980766Writing data manifest for emptySnaptb0-testExportWithTargetName at 1690239980798 (+32 ms)Verifying snapshot: emptySnaptb0-testExportWithTargetName at 1690239980841 (+43 ms)Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1690239980927 (+86 ms) 2023-07-24 23:06:20,930 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-24 23:06:20,933 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 529 msec 2023-07-24 23:06:21,013 DEBUG [Listener at jenkins-hbase4.apache.org/43617] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 23:06:21,017 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-24 23:06:21,017 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-24 23:06:21,035 DEBUG [htable-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 23:06:21,036 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39013] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,,1690239979139.563aad54bb156f988e63545967e41553. with WAL disabled. Data may be lost in the event of a crash. 2023-07-24 23:06:21,039 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50618, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 23:06:21,041 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33227] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,1,1690239979139.36437467100446c83969844ad3c54280. with WAL disabled. Data may be lost in the event of a crash. 2023-07-24 23:06:21,045 DEBUG [Listener at jenkins-hbase4.apache.org/43617] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-07-24 23:06:21,046 DEBUG [Listener at jenkins-hbase4.apache.org/43617] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1690239979139.563aad54bb156f988e63545967e41553. 2023-07-24 23:06:21,048 INFO [Listener at jenkins-hbase4.apache.org/43617] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-24 23:06:21,074 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-24 23:06:21,074 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690239981074 (current time:1690239981074). 2023-07-24 23:06:21,074 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-24 23:06:21,074 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] zookeeper.ReadOnlyZKClient(139): Connect 0x3304827b to 127.0.0.1:52881 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 23:06:21,080 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@733ffb8a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 23:06:21,081 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 23:06:21,083 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58688, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 23:06:21,084 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3304827b to 127.0.0.1:52881 2023-07-24 23:06:21,085 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 23:06:21,085 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] zookeeper.ReadOnlyZKClient(139): Connect 0x5f8c9927 to 127.0.0.1:52881 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 23:06:21,090 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@488ccff7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 23:06:21,092 DEBUG [hconnection-0x44e39ec7-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 23:06:21,094 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58698, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 23:06:21,098 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 23:06:21,101 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50628, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 23:06:21,102 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5f8c9927 to 127.0.0.1:52881 2023-07-24 23:06:21,102 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 23:06:21,102 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-24 23:06:21,103 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-24 23:06:21,103 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-24 23:06:21,107 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] procedure2.ProcedureExecutor(1029): Stored pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-24 23:06:21,108 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-24 23:06:21,110 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=19, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1690240581110 2023-07-24 23:06:21,110 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-24 23:06:21,110 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-07-24 23:06:21,111 DEBUG [Listener at jenkins-hbase4.apache.org/43617] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-24 23:06:21,112 DEBUG [Listener at jenkins-hbase4.apache.org/43617] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-24 23:06:21,113 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=19, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-24 23:06:21,113 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-24 23:06:21,115 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=19, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 8 msec 2023-07-24 23:06:21,116 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-24 23:06:21,116 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=20, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1690240581116 2023-07-24 23:06:21,137 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportWithTargetName 2023-07-24 23:06:21,137 INFO [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportWithTargetName' 2023-07-24 23:06:21,137 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 23:06:21,139 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportWithTargetName' starting 'acquire' 2023-07-24 23:06:21,139 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-07-24 23:06:21,140 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-24 23:06:21,140 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-24 23:06:21,141 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:39013-0x1019995a36f0002, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 23:06:21,141 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:06:21,141 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 23:06:21,141 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:39595-0x1019995a36f0001, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 23:06:21,141 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:33227-0x1019995a36f0003, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 23:06:21,142 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 23:06:21,142 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 23:06:21,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 23:06:21,142 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:06:21,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 23:06:21,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 23:06:21,142 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39013,1690239969874 2023-07-24 23:06:21,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-24 23:06:21,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-24 23:06:21,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-24 23:06:21,143 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39013,1690239969874 2023-07-24 23:06:21,143 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-24 23:06:21,143 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39013-0x1019995a36f0002, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-24 23:06:21,143 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33227-0x1019995a36f0003, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-24 23:06:21,143 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39595-0x1019995a36f0001, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-24 23:06:21,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-24 23:06:21,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-24 23:06:21,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-24 23:06:21,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-24 23:06:21,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-24 23:06:21,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-24 23:06:21,144 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-24 23:06:21,144 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-24 23:06:21,144 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-24 23:06:21,144 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-24 23:06:21,144 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-24 23:06:21,144 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-24 23:06:21,144 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-24 23:06:21,145 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 23:06:21,144 DEBUG [member: 'jenkins-hbase4.apache.org,39013,1690239969874' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-24 23:06:21,146 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-24 23:06:21,146 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-24 23:06:21,146 DEBUG [member: 'jenkins-hbase4.apache.org,39013,1690239969874' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 23:06:21,145 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1690239969801' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-24 23:06:21,146 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33227,1690239969957' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-24 23:06:21,147 DEBUG [member: 'jenkins-hbase4.apache.org,39013,1690239969874' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-24 23:06:21,147 DEBUG [member: 'jenkins-hbase4.apache.org,39013,1690239969874' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-24 23:06:21,147 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1690239969801' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 23:06:21,147 DEBUG [member: 'jenkins-hbase4.apache.org,39013,1690239969874' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39013,1690239969874' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-24 23:06:21,148 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1690239969801' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-24 23:06:21,148 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1690239969801' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-24 23:06:21,148 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1690239969801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39595,1690239969801' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-24 23:06:21,151 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-24 23:06:21,151 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:06:21,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:06:21,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 23:06:21,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 23:06:21,152 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39013,1690239969874 2023-07-24 23:06:21,152 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1690239969801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-24 23:06:21,152 DEBUG [member: 'jenkins-hbase4.apache.org,39013,1690239969874' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-24 23:06:21,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 23:06:21,152 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33227-0x1019995a36f0003, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-24 23:06:21,152 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 23:06:21,152 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1690239969801' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39595-0x1019995a36f0001, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-24 23:06:21,152 DEBUG [member: 'jenkins-hbase4.apache.org,39013,1690239969874' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39013-0x1019995a36f0002, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-24 23:06:21,152 DEBUG [member: 'jenkins-hbase4.apache.org,39013,1690239969874' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 23:06:21,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 23:06:21,152 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1690239969801' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 23:06:21,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-24 23:06:21,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:06:21,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39013,1690239969874 2023-07-24 23:06:21,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39595,1690239969801 2023-07-24 23:06:21,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 23:06:21,154 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33227,1690239969957' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-07-24 23:06:21,155 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@19e587f4[Count = 1] remaining members to acquire global barrier 2023-07-24 23:06:21,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39013,1690239969874 2023-07-24 23:06:21,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 23:06:21,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 23:06:21,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 23:06:21,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 23:06:21,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-24 23:06:21,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:06:21,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39013,1690239969874 2023-07-24 23:06:21,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39595,1690239969801 2023-07-24 23:06:21,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 23:06:21,158 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39013,1690239969874' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-07-24 23:06:21,158 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@19e587f4[Count = 0] remaining members to acquire global barrier 2023-07-24 23:06:21,158 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-07-24 23:06:21,158 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-24 23:06:21,163 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:33227-0x1019995a36f0003, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-24 23:06:21,163 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-24 23:06:21,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-24 23:06:21,163 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:39013-0x1019995a36f0002, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-24 23:06:21,163 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-24 23:06:21,163 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-24 23:06:21,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-24 23:06:21,163 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:39595-0x1019995a36f0001, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-24 23:06:21,163 DEBUG [member: 'jenkins-hbase4.apache.org,39013,1690239969874' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-24 23:06:21,163 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-24 23:06:21,163 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:06:21,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-24 23:06:21,164 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1690239969801' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-24 23:06:21,164 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1690239969801' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-24 23:06:21,164 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1690239969801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,39595,1690239969801' in zk 2023-07-24 23:06:21,164 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39013,1690239969874 2023-07-24 23:06:21,164 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-24 23:06:21,164 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 23:06:21,164 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 23:06:21,164 DEBUG [rs(jenkins-hbase4.apache.org,33227,1690239969957)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1690239979139.36437467100446c83969844ad3c54280. 2023-07-24 23:06:21,164 DEBUG [member: 'jenkins-hbase4.apache.org,39013,1690239969874' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 23:06:21,164 DEBUG [member: 'jenkins-hbase4.apache.org,39013,1690239969874' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 23:06:21,164 DEBUG [rs(jenkins-hbase4.apache.org,39013,1690239969874)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1690239979139.563aad54bb156f988e63545967e41553. 2023-07-24 23:06:21,164 DEBUG [rs(jenkins-hbase4.apache.org,33227,1690239969957)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1690239979139.36437467100446c83969844ad3c54280. started... 2023-07-24 23:06:21,165 DEBUG [rs(jenkins-hbase4.apache.org,39013,1690239969874)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1690239979139.563aad54bb156f988e63545967e41553. started... 2023-07-24 23:06:21,165 INFO [rs(jenkins-hbase4.apache.org,39013,1690239969874)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 563aad54bb156f988e63545967e41553 1/1 column families, dataSize=333 B heapSize=976 B 2023-07-24 23:06:21,165 INFO [rs(jenkins-hbase4.apache.org,33227,1690239969957)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 36437467100446c83969844ad3c54280 1/1 column families, dataSize=2.93 KB heapSize=6.58 KB 2023-07-24 23:06:21,168 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1690239969801' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-24 23:06:21,168 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1690239969801' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 23:06:21,168 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1690239969801' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-24 23:06:21,212 DEBUG [Listener at jenkins-hbase4.apache.org/43617] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 23:06:21,213 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-24 23:06:21,213 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-24 23:06:21,214 DEBUG [Listener at jenkins-hbase4.apache.org/43617] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-24 23:06:21,281 INFO [rs(jenkins-hbase4.apache.org,33227,1690239969957)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=2.93 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/default/testtb-testExportWithTargetName/36437467100446c83969844ad3c54280/.tmp/cf/9a24e3ccdc2f4881bda4b59db36b612a 2023-07-24 23:06:21,291 INFO [rs(jenkins-hbase4.apache.org,39013,1690239969874)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=333 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/default/testtb-testExportWithTargetName/563aad54bb156f988e63545967e41553/.tmp/cf/24b4b9d1d15747e9ba3d85beb74e0432 2023-07-24 23:06:21,343 DEBUG [rs(jenkins-hbase4.apache.org,39013,1690239969874)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/default/testtb-testExportWithTargetName/563aad54bb156f988e63545967e41553/.tmp/cf/24b4b9d1d15747e9ba3d85beb74e0432 as hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/default/testtb-testExportWithTargetName/563aad54bb156f988e63545967e41553/cf/24b4b9d1d15747e9ba3d85beb74e0432 2023-07-24 23:06:21,343 DEBUG [rs(jenkins-hbase4.apache.org,33227,1690239969957)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/default/testtb-testExportWithTargetName/36437467100446c83969844ad3c54280/.tmp/cf/9a24e3ccdc2f4881bda4b59db36b612a as hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/default/testtb-testExportWithTargetName/36437467100446c83969844ad3c54280/cf/9a24e3ccdc2f4881bda4b59db36b612a 2023-07-24 23:06:21,353 INFO [rs(jenkins-hbase4.apache.org,33227,1690239969957)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/default/testtb-testExportWithTargetName/36437467100446c83969844ad3c54280/cf/9a24e3ccdc2f4881bda4b59db36b612a, entries=45, sequenceid=6, filesize=7.9 K 2023-07-24 23:06:21,356 INFO [rs(jenkins-hbase4.apache.org,33227,1690239969957)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.93 KB/3003, heapSize ~6.56 KB/6720, currentSize=0 B/0 for 36437467100446c83969844ad3c54280 in 191ms, sequenceid=6, compaction requested=false 2023-07-24 23:06:21,356 DEBUG [rs(jenkins-hbase4.apache.org,33227,1690239969957)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-07-24 23:06:21,356 INFO [rs(jenkins-hbase4.apache.org,39013,1690239969874)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/default/testtb-testExportWithTargetName/563aad54bb156f988e63545967e41553/cf/24b4b9d1d15747e9ba3d85beb74e0432, entries=5, sequenceid=6, filesize=5.2 K 2023-07-24 23:06:21,361 DEBUG [rs(jenkins-hbase4.apache.org,33227,1690239969957)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 36437467100446c83969844ad3c54280: 2023-07-24 23:06:21,364 DEBUG [rs(jenkins-hbase4.apache.org,33227,1690239969957)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1690239979139.36437467100446c83969844ad3c54280.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-24 23:06:21,364 DEBUG [rs(jenkins-hbase4.apache.org,33227,1690239969957)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 23:06:21,364 DEBUG [rs(jenkins-hbase4.apache.org,33227,1690239969957)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/default/testtb-testExportWithTargetName/36437467100446c83969844ad3c54280/cf/9a24e3ccdc2f4881bda4b59db36b612a] hfiles 2023-07-24 23:06:21,364 DEBUG [rs(jenkins-hbase4.apache.org,33227,1690239969957)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/default/testtb-testExportWithTargetName/36437467100446c83969844ad3c54280/cf/9a24e3ccdc2f4881bda4b59db36b612a for snapshot=snaptb0-testExportWithTargetName 2023-07-24 23:06:21,364 INFO [rs(jenkins-hbase4.apache.org,39013,1690239969874)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~333 B/333, heapSize ~960 B/960, currentSize=0 B/0 for 563aad54bb156f988e63545967e41553 in 199ms, sequenceid=6, compaction requested=false 2023-07-24 23:06:21,365 DEBUG [rs(jenkins-hbase4.apache.org,39013,1690239969874)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 563aad54bb156f988e63545967e41553: 2023-07-24 23:06:21,366 DEBUG [rs(jenkins-hbase4.apache.org,39013,1690239969874)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1690239979139.563aad54bb156f988e63545967e41553.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-24 23:06:21,366 DEBUG [rs(jenkins-hbase4.apache.org,39013,1690239969874)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 23:06:21,366 DEBUG [rs(jenkins-hbase4.apache.org,39013,1690239969874)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/default/testtb-testExportWithTargetName/563aad54bb156f988e63545967e41553/cf/24b4b9d1d15747e9ba3d85beb74e0432] hfiles 2023-07-24 23:06:21,366 DEBUG [rs(jenkins-hbase4.apache.org,39013,1690239969874)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/default/testtb-testExportWithTargetName/563aad54bb156f988e63545967e41553/cf/24b4b9d1d15747e9ba3d85beb74e0432 for snapshot=snaptb0-testExportWithTargetName 2023-07-24 23:06:21,396 DEBUG [rs(jenkins-hbase4.apache.org,39013,1690239969874)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1690239979139.563aad54bb156f988e63545967e41553. completed. 2023-07-24 23:06:21,397 DEBUG [rs(jenkins-hbase4.apache.org,39013,1690239969874)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1690239979139.563aad54bb156f988e63545967e41553. 2023-07-24 23:06:21,397 DEBUG [member: 'jenkins-hbase4.apache.org,39013,1690239969874' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 23:06:21,397 DEBUG [member: 'jenkins-hbase4.apache.org,39013,1690239969874' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 23:06:21,397 DEBUG [member: 'jenkins-hbase4.apache.org,39013,1690239969874' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39013,1690239969874 2023-07-24 23:06:21,397 DEBUG [member: 'jenkins-hbase4.apache.org,39013,1690239969874' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-24 23:06:21,397 DEBUG [member: 'jenkins-hbase4.apache.org,39013,1690239969874' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,39013,1690239969874' in zk 2023-07-24 23:06:21,397 DEBUG [rs(jenkins-hbase4.apache.org,33227,1690239969957)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1690239979139.36437467100446c83969844ad3c54280. completed. 2023-07-24 23:06:21,397 DEBUG [rs(jenkins-hbase4.apache.org,33227,1690239969957)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1690239979139.36437467100446c83969844ad3c54280. 2023-07-24 23:06:21,397 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 23:06:21,397 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 23:06:21,397 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:06:21,398 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-24 23:06:21,398 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,33227,1690239969957' in zk 2023-07-24 23:06:21,399 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39013,1690239969874 2023-07-24 23:06:21,399 DEBUG [member: 'jenkins-hbase4.apache.org,39013,1690239969874' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-24 23:06:21,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39013,1690239969874 2023-07-24 23:06:21,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 23:06:21,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 23:06:21,400 DEBUG [member: 'jenkins-hbase4.apache.org,39013,1690239969874' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 23:06:21,400 DEBUG [member: 'jenkins-hbase4.apache.org,39013,1690239969874' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-24 23:06:21,401 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:06:21,401 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-24 23:06:21,401 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 23:06:21,401 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-24 23:06:21,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 23:06:21,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 23:06:21,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-24 23:06:21,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:06:21,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39013,1690239969874 2023-07-24 23:06:21,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39595,1690239969801 2023-07-24 23:06:21,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 23:06:21,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-24 23:06:21,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:06:21,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39013,1690239969874 2023-07-24 23:06:21,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39595,1690239969801 2023-07-24 23:06:21,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,39013,1690239969874': 2023-07-24 23:06:21,408 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39013,1690239969874' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-07-24 23:06:21,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:06:21,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 23:06:21,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 23:06:21,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 23:06:21,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 23:06:21,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-24 23:06:21,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:06:21,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39013,1690239969874 2023-07-24 23:06:21,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39595,1690239969801 2023-07-24 23:06:21,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 23:06:21,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-24 23:06:21,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:06:21,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39013,1690239969874 2023-07-24 23:06:21,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39595,1690239969801 2023-07-24 23:06:21,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,33227,1690239969957': 2023-07-24 23:06:21,413 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33227,1690239969957' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-07-24 23:06:21,413 INFO [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportWithTargetName' execution completed 2023-07-24 23:06:21,413 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-24 23:06:21,413 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-24 23:06:21,413 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportWithTargetName 2023-07-24 23:06:21,413 INFO [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-24 23:06:21,414 DEBUG [Listener at jenkins-hbase4.apache.org/43617] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 23:06:21,415 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-24 23:06:21,415 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-24 23:06:21,416 DEBUG [Listener at jenkins-hbase4.apache.org/43617] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-24 23:06:21,416 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-24 23:06:21,416 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:39013-0x1019995a36f0002, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-24 23:06:21,417 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:33227-0x1019995a36f0003, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-24 23:06:21,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-24 23:06:21,417 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:33227-0x1019995a36f0003, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 23:06:21,416 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:39595-0x1019995a36f0001, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-24 23:06:21,417 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-24 23:06:21,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 23:06:21,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 23:06:21,417 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-24 23:06:21,417 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:39013-0x1019995a36f0002, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 23:06:21,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-24 23:06:21,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-24 23:06:21,417 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-24 23:06:21,417 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:39595-0x1019995a36f0001, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 23:06:21,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-24 23:06:21,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 23:06:21,418 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:06:21,418 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 23:06:21,418 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 23:06:21,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 23:06:21,418 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 23:06:21,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 23:06:21,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 23:06:21,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-24 23:06:21,418 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39013,1690239969874 2023-07-24 23:06:21,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-24 23:06:21,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-24 23:06:21,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-24 23:06:21,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 23:06:21,419 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39595,1690239969801 2023-07-24 23:06:21,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-24 23:06:21,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:06:21,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39013,1690239969874 2023-07-24 23:06:21,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39595,1690239969801 2023-07-24 23:06:21,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 23:06:21,422 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:06:21,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-24 23:06:21,422 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39013,1690239969874 2023-07-24 23:06:21,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:06:21,422 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39595,1690239969801 2023-07-24 23:06:21,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39013,1690239969874 2023-07-24 23:06:21,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39595,1690239969801 2023-07-24 23:06:21,435 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39595,1690239969801 2023-07-24 23:06:21,435 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:39595-0x1019995a36f0001, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 23:06:21,435 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:39013-0x1019995a36f0002, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 23:06:21,435 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 23:06:21,435 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-24 23:06:21,435 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:39013-0x1019995a36f0002, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 23:06:21,435 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 23:06:21,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 23:06:21,435 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:33227-0x1019995a36f0003, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 23:06:21,435 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:33227-0x1019995a36f0003, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 23:06:21,435 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportWithTargetName 2023-07-24 23:06:21,435 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39013,1690239969874 2023-07-24 23:06:21,436 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportWithTargetName 2023-07-24 23:06:21,435 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:39595-0x1019995a36f0001, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 23:06:21,436 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 23:06:21,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 23:06:21,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 23:06:21,436 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:06:21,436 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 23:06:21,435 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 23:06:21,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 23:06:21,436 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-24 23:06:21,438 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39595,1690239969801 2023-07-24 23:06:21,438 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-24 23:06:21,438 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39013,1690239969874 2023-07-24 23:06:21,438 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:06:21,438 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-24 23:06:21,438 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-24 23:06:21,438 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 23:06:21,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 23:06:21,438 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-24 23:06:21,438 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 23:06:21,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 23:06:21,477 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName to hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-07-24 23:06:21,520 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-07-24 23:06:21,520 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-24 23:06:21,521 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-24 23:06:21,521 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1690239981110Consolidate snapshot: snaptb0-testExportWithTargetName at 1690239981436 (+326 ms)Loading Region manifests for snaptb0-testExportWithTargetName at 1690239981436Writing data manifest for snaptb0-testExportWithTargetName at 1690239981442 (+6 ms)Verifying snapshot: snaptb0-testExportWithTargetName at 1690239981465 (+23 ms)Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1690239981520 (+55 ms) 2023-07-24 23:06:21,522 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=20, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-24 23:06:21,524 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=20, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 411 msec 2023-07-24 23:06:21,716 DEBUG [Listener at jenkins-hbase4.apache.org/43617] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 23:06:21,719 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-24 23:06:21,719 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-24 23:06:21,719 INFO [Listener at jenkins-hbase4.apache.org/43617] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/export-test/export-1690239981719 2023-07-24 23:06:21,720 INFO [Listener at jenkins-hbase4.apache.org/43617] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:37611, tgtDir=hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/export-test/export-1690239981719, rawTgtDir=hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/export-test/export-1690239981719, srcFsUri=hdfs://localhost:37611, srcDir=hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb 2023-07-24 23:06:21,759 DEBUG [Listener at jenkins-hbase4.apache.org/43617] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:37611, inputRoot=hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb 2023-07-24 23:06:21,759 DEBUG [Listener at jenkins-hbase4.apache.org/43617] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-563784563_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/export-test/export-1690239981719, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/export-test/export-1690239981719/.hbase-snapshot/.tmp/testExportWithTargetName 2023-07-24 23:06:21,759 INFO [Listener at jenkins-hbase4.apache.org/43617] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:37611, inputRoot=hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb, snapshotDir=hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.hbase-snapshot/snaptb0-testExportWithTargetName. 2023-07-24 23:06:21,777 INFO [Listener at jenkins-hbase4.apache.org/43617] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.hbase-snapshot/snaptb0-testExportWithTargetName to hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/export-test/export-1690239981719/.hbase-snapshot/.tmp/testExportWithTargetName 2023-07-24 23:06:21,845 DEBUG [Listener at jenkins-hbase4.apache.org/43617] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-24 23:06:21,846 DEBUG [Listener at jenkins-hbase4.apache.org/43617] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-24 23:06:21,847 DEBUG [Listener at jenkins-hbase4.apache.org/43617] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-24 23:06:21,847 DEBUG [Listener at jenkins-hbase4.apache.org/43617] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-24 23:06:21,847 DEBUG [Listener at jenkins-hbase4.apache.org/43617] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-24 23:06:21,848 DEBUG [Listener at jenkins-hbase4.apache.org/43617] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-24 23:06:21,848 DEBUG [Listener at jenkins-hbase4.apache.org/43617] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-24 23:06:21,932 DEBUG [Listener at jenkins-hbase4.apache.org/43617] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/40a10de8-ef1a-d60f-e3da-b5fca02ca095/hadoop-4712342227986314751.jar 2023-07-24 23:06:21,933 DEBUG [Listener at jenkins-hbase4.apache.org/43617] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-24 23:06:21,934 DEBUG [Listener at jenkins-hbase4.apache.org/43617] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-24 23:06:21,935 DEBUG [Listener at jenkins-hbase4.apache.org/43617] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-24 23:06:21,935 DEBUG [Listener at jenkins-hbase4.apache.org/43617] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-24 23:06:21,936 DEBUG [Listener at jenkins-hbase4.apache.org/43617] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-24 23:06:21,936 DEBUG [Listener at jenkins-hbase4.apache.org/43617] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-24 23:06:21,937 DEBUG [Listener at jenkins-hbase4.apache.org/43617] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-24 23:06:21,937 DEBUG [Listener at jenkins-hbase4.apache.org/43617] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-24 23:06:21,938 DEBUG [Listener at jenkins-hbase4.apache.org/43617] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-24 23:06:21,938 DEBUG [Listener at jenkins-hbase4.apache.org/43617] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-24 23:06:21,939 DEBUG [Listener at jenkins-hbase4.apache.org/43617] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-24 23:06:21,939 DEBUG [Listener at jenkins-hbase4.apache.org/43617] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-24 23:06:21,940 DEBUG [Listener at jenkins-hbase4.apache.org/43617] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-24 23:06:21,941 DEBUG [Listener at jenkins-hbase4.apache.org/43617] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-24 23:06:21,941 DEBUG [Listener at jenkins-hbase4.apache.org/43617] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-24 23:06:21,942 DEBUG [Listener at jenkins-hbase4.apache.org/43617] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-24 23:06:21,946 DEBUG [Listener at jenkins-hbase4.apache.org/43617] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 23:06:21,947 DEBUG [Listener at jenkins-hbase4.apache.org/43617] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 23:06:21,947 DEBUG [Listener at jenkins-hbase4.apache.org/43617] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 23:06:21,948 DEBUG [Listener at jenkins-hbase4.apache.org/43617] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 23:06:21,948 DEBUG [Listener at jenkins-hbase4.apache.org/43617] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 23:06:21,950 DEBUG [Listener at jenkins-hbase4.apache.org/43617] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 23:06:21,951 DEBUG [Listener at jenkins-hbase4.apache.org/43617] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 23:06:23,369 WARN [Listener at jenkins-hbase4.apache.org/43617] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-24 23:06:23,375 INFO [Listener at jenkins-hbase4.apache.org/43617] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportWithTargetName' hfile list 2023-07-24 23:06:23,387 DEBUG [Listener at jenkins-hbase4.apache.org/43617] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-24 23:06:23,991 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-24 23:06:23,994 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-24 23:06:24,233 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690239977721_0001_000001 (auth:SIMPLE) 2023-07-24 23:06:25,159 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-24 23:06:29,660 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690239977721_0001_000001 (auth:SIMPLE) 2023-07-24 23:06:31,937 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690239977721_0001_000001 (auth:SIMPLE) 2023-07-24 23:06:35,026 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690239977721_0001_000001 (auth:SIMPLE) 2023-07-24 23:06:36,381 INFO [Listener at jenkins-hbase4.apache.org/43617] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-24 23:06:36,385 INFO [Listener at jenkins-hbase4.apache.org/43617] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-24 23:06:36,394 INFO [Listener at jenkins-hbase4.apache.org/43617] snapshot.ExportSnapshot(1127): Export Completed: testExportWithTargetName 2023-07-24 23:06:36,394 INFO [Listener at jenkins-hbase4.apache.org/43617] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-24 23:06:36,395 INFO [Listener at jenkins-hbase4.apache.org/43617] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-24 23:06:36,395 DEBUG [Listener at jenkins-hbase4.apache.org/43617] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1273988721_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.hbase-snapshot/snaptb0-testExportWithTargetName at hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-07-24 23:06:36,396 DEBUG [Listener at jenkins-hbase4.apache.org/43617] snapshot.TestExportSnapshot(367): hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.hbase-snapshot/snaptb0-testExportWithTargetName/.snapshotinfo 2023-07-24 23:06:36,396 DEBUG [Listener at jenkins-hbase4.apache.org/43617] snapshot.TestExportSnapshot(367): hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.hbase-snapshot/snaptb0-testExportWithTargetName/data.manifest 2023-07-24 23:06:36,396 DEBUG [Listener at jenkins-hbase4.apache.org/43617] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1273988721_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/export-test/export-1690239981719/.hbase-snapshot/testExportWithTargetName at hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/export-test/export-1690239981719/.hbase-snapshot/testExportWithTargetName 2023-07-24 23:06:36,397 DEBUG [Listener at jenkins-hbase4.apache.org/43617] snapshot.TestExportSnapshot(367): hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/export-test/export-1690239981719/.hbase-snapshot/testExportWithTargetName/.snapshotinfo 2023-07-24 23:06:36,397 DEBUG [Listener at jenkins-hbase4.apache.org/43617] snapshot.TestExportSnapshot(367): hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/export-test/export-1690239981719/.hbase-snapshot/testExportWithTargetName/data.manifest 2023-07-24 23:06:36,407 INFO [Listener at jenkins-hbase4.apache.org/43617] client.HBaseAdmin$15(890): Started disable of testtb-testExportWithTargetName 2023-07-24 23:06:36,412 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportWithTargetName 2023-07-24 23:06:36,423 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] procedure2.ProcedureExecutor(1029): Stored pid=21, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportWithTargetName 2023-07-24 23:06:36,427 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690239996427"}]},"ts":"1690239996427"} 2023-07-24 23:06:36,428 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-24 23:06:36,429 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLING in hbase:meta 2023-07-24 23:06:36,431 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testExportWithTargetName to state=DISABLING 2023-07-24 23:06:36,433 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=563aad54bb156f988e63545967e41553, UNASSIGN}, {pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=36437467100446c83969844ad3c54280, UNASSIGN}] 2023-07-24 23:06:36,435 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=563aad54bb156f988e63545967e41553, UNASSIGN 2023-07-24 23:06:36,435 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=36437467100446c83969844ad3c54280, UNASSIGN 2023-07-24 23:06:36,436 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=563aad54bb156f988e63545967e41553, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39013,1690239969874 2023-07-24 23:06:36,436 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=36437467100446c83969844ad3c54280, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:06:36,436 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1690239979139.563aad54bb156f988e63545967e41553.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690239996436"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690239996436"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690239996436"}]},"ts":"1690239996436"} 2023-07-24 23:06:36,436 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1690239979139.36437467100446c83969844ad3c54280.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690239996436"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690239996436"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690239996436"}]},"ts":"1690239996436"} 2023-07-24 23:06:36,438 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=22, state=RUNNABLE; CloseRegionProcedure 563aad54bb156f988e63545967e41553, server=jenkins-hbase4.apache.org,39013,1690239969874}] 2023-07-24 23:06:36,439 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=23, state=RUNNABLE; CloseRegionProcedure 36437467100446c83969844ad3c54280, server=jenkins-hbase4.apache.org,33227,1690239969957}] 2023-07-24 23:06:36,529 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-24 23:06:36,598 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 36437467100446c83969844ad3c54280 2023-07-24 23:06:36,598 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 563aad54bb156f988e63545967e41553 2023-07-24 23:06:36,598 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 36437467100446c83969844ad3c54280, disabling compactions & flushes 2023-07-24 23:06:36,598 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 563aad54bb156f988e63545967e41553, disabling compactions & flushes 2023-07-24 23:06:36,598 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1690239979139.36437467100446c83969844ad3c54280. 2023-07-24 23:06:36,598 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1690239979139.563aad54bb156f988e63545967e41553. 2023-07-24 23:06:36,598 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1690239979139.36437467100446c83969844ad3c54280. 2023-07-24 23:06:36,598 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1690239979139.563aad54bb156f988e63545967e41553. 2023-07-24 23:06:36,598 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1690239979139.36437467100446c83969844ad3c54280. after waiting 0 ms 2023-07-24 23:06:36,598 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1690239979139.563aad54bb156f988e63545967e41553. after waiting 0 ms 2023-07-24 23:06:36,598 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1690239979139.36437467100446c83969844ad3c54280. 2023-07-24 23:06:36,598 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1690239979139.563aad54bb156f988e63545967e41553. 2023-07-24 23:06:36,612 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/default/testtb-testExportWithTargetName/563aad54bb156f988e63545967e41553/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-24 23:06:36,612 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/default/testtb-testExportWithTargetName/36437467100446c83969844ad3c54280/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-24 23:06:36,613 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 23:06:36,613 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 23:06:36,614 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1690239979139.563aad54bb156f988e63545967e41553. 2023-07-24 23:06:36,614 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1690239979139.36437467100446c83969844ad3c54280. 2023-07-24 23:06:36,614 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 563aad54bb156f988e63545967e41553: 2023-07-24 23:06:36,614 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 36437467100446c83969844ad3c54280: 2023-07-24 23:06:36,617 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 36437467100446c83969844ad3c54280 2023-07-24 23:06:36,617 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=36437467100446c83969844ad3c54280, regionState=CLOSED 2023-07-24 23:06:36,617 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1690239979139.36437467100446c83969844ad3c54280.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690239996617"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690239996617"}]},"ts":"1690239996617"} 2023-07-24 23:06:36,618 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 563aad54bb156f988e63545967e41553 2023-07-24 23:06:36,619 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=563aad54bb156f988e63545967e41553, regionState=CLOSED 2023-07-24 23:06:36,619 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1690239979139.563aad54bb156f988e63545967e41553.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690239996619"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690239996619"}]},"ts":"1690239996619"} 2023-07-24 23:06:36,624 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=23 2023-07-24 23:06:36,624 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=23, state=SUCCESS; CloseRegionProcedure 36437467100446c83969844ad3c54280, server=jenkins-hbase4.apache.org,33227,1690239969957 in 182 msec 2023-07-24 23:06:36,625 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=22 2023-07-24 23:06:36,625 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=22, state=SUCCESS; CloseRegionProcedure 563aad54bb156f988e63545967e41553, server=jenkins-hbase4.apache.org,39013,1690239969874 in 184 msec 2023-07-24 23:06:36,626 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=36437467100446c83969844ad3c54280, UNASSIGN in 191 msec 2023-07-24 23:06:36,627 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=22, resume processing ppid=21 2023-07-24 23:06:36,628 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=563aad54bb156f988e63545967e41553, UNASSIGN in 192 msec 2023-07-24 23:06:36,629 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690239996628"}]},"ts":"1690239996628"} 2023-07-24 23:06:36,630 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLED in hbase:meta 2023-07-24 23:06:36,632 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testExportWithTargetName to state=DISABLED 2023-07-24 23:06:36,637 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=21, state=SUCCESS; DisableTableProcedure table=testtb-testExportWithTargetName in 217 msec 2023-07-24 23:06:36,731 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-24 23:06:36,731 INFO [Listener at jenkins-hbase4.apache.org/43617] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportWithTargetName, procId: 21 completed 2023-07-24 23:06:36,736 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportWithTargetName 2023-07-24 23:06:36,743 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] procedure2.ProcedureExecutor(1029): Stored pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-24 23:06:36,746 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-24 23:06:36,747 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportWithTargetName 2023-07-24 23:06:36,748 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=26, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-24 23:06:36,751 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33227] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportWithTargetName 2023-07-24 23:06:36,754 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.tmp/data/default/testtb-testExportWithTargetName/563aad54bb156f988e63545967e41553 2023-07-24 23:06:36,754 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.tmp/data/default/testtb-testExportWithTargetName/36437467100446c83969844ad3c54280 2023-07-24 23:06:36,756 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:39595-0x1019995a36f0001, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-24 23:06:36,756 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:33227-0x1019995a36f0003, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-24 23:06:36,756 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:39013-0x1019995a36f0002, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-24 23:06:36,756 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-24 23:06:36,757 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:33227-0x1019995a36f0003, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 23:06:36,757 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:39595-0x1019995a36f0001, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 23:06:36,758 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:39013-0x1019995a36f0002, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 23:06:36,758 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-07-24 23:06:36,758 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-07-24 23:06:36,758 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-24 23:06:36,758 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-07-24 23:06:36,758 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-24 23:06:36,758 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-24 23:06:36,758 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 23:06:36,758 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-07-24 23:06:36,758 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-24 23:06:36,760 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.tmp/data/default/testtb-testExportWithTargetName/36437467100446c83969844ad3c54280/cf, FileablePath, hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.tmp/data/default/testtb-testExportWithTargetName/36437467100446c83969844ad3c54280/recovered.edits] 2023-07-24 23:06:36,760 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.tmp/data/default/testtb-testExportWithTargetName/563aad54bb156f988e63545967e41553/cf, FileablePath, hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.tmp/data/default/testtb-testExportWithTargetName/563aad54bb156f988e63545967e41553/recovered.edits] 2023-07-24 23:06:36,762 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-07-24 23:06:36,769 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.tmp/data/default/testtb-testExportWithTargetName/36437467100446c83969844ad3c54280/cf/9a24e3ccdc2f4881bda4b59db36b612a to hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/archive/data/default/testtb-testExportWithTargetName/36437467100446c83969844ad3c54280/cf/9a24e3ccdc2f4881bda4b59db36b612a 2023-07-24 23:06:36,769 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.tmp/data/default/testtb-testExportWithTargetName/563aad54bb156f988e63545967e41553/cf/24b4b9d1d15747e9ba3d85beb74e0432 to hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/archive/data/default/testtb-testExportWithTargetName/563aad54bb156f988e63545967e41553/cf/24b4b9d1d15747e9ba3d85beb74e0432 2023-07-24 23:06:36,773 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.tmp/data/default/testtb-testExportWithTargetName/36437467100446c83969844ad3c54280/recovered.edits/9.seqid to hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/archive/data/default/testtb-testExportWithTargetName/36437467100446c83969844ad3c54280/recovered.edits/9.seqid 2023-07-24 23:06:36,773 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.tmp/data/default/testtb-testExportWithTargetName/563aad54bb156f988e63545967e41553/recovered.edits/9.seqid to hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/archive/data/default/testtb-testExportWithTargetName/563aad54bb156f988e63545967e41553/recovered.edits/9.seqid 2023-07-24 23:06:36,774 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.tmp/data/default/testtb-testExportWithTargetName/36437467100446c83969844ad3c54280 2023-07-24 23:06:36,774 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.tmp/data/default/testtb-testExportWithTargetName/563aad54bb156f988e63545967e41553 2023-07-24 23:06:36,774 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-07-24 23:06:36,778 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=26, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-24 23:06:36,800 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportWithTargetName from hbase:meta 2023-07-24 23:06:36,803 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportWithTargetName' descriptor. 2023-07-24 23:06:36,805 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=26, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-24 23:06:36,805 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportWithTargetName' from region states. 2023-07-24 23:06:36,805 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,,1690239979139.563aad54bb156f988e63545967e41553.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690239996805"}]},"ts":"9223372036854775807"} 2023-07-24 23:06:36,806 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,1,1690239979139.36437467100446c83969844ad3c54280.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690239996805"}]},"ts":"9223372036854775807"} 2023-07-24 23:06:36,808 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-24 23:06:36,808 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 563aad54bb156f988e63545967e41553, NAME => 'testtb-testExportWithTargetName,,1690239979139.563aad54bb156f988e63545967e41553.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 36437467100446c83969844ad3c54280, NAME => 'testtb-testExportWithTargetName,1,1690239979139.36437467100446c83969844ad3c54280.', STARTKEY => '1', ENDKEY => ''}] 2023-07-24 23:06:36,808 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportWithTargetName' as deleted. 2023-07-24 23:06:36,808 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1690239996808"}]},"ts":"9223372036854775807"} 2023-07-24 23:06:36,810 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportWithTargetName state from META 2023-07-24 23:06:36,813 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=26, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-24 23:06:36,815 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=26, state=SUCCESS; DeleteTableProcedure table=testtb-testExportWithTargetName in 76 msec 2023-07-24 23:06:36,864 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-07-24 23:06:36,864 INFO [Listener at jenkins-hbase4.apache.org/43617] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportWithTargetName, procId: 26 completed 2023-07-24 23:06:36,883 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportWithTargetName" 2023-07-24 23:06:36,885 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportWithTargetName 2023-07-24 23:06:36,888 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportWithTargetName" 2023-07-24 23:06:36,890 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportWithTargetName 2023-07-24 23:06:36,918 INFO [Listener at jenkins-hbase4.apache.org/43617] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testExportWithTargetName Thread=752 (was 708) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/40a10de8-ef1a-d60f-e3da-b5fca02ca095/cluster_8078c43e-6fde-7452-062d-548ef0e9fbe8/dfs/data/data4/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x2b6dd434-shared-pool-11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/40a10de8-ef1a-d60f-e3da-b5fca02ca095/cluster_8078c43e-6fde-7452-062d-548ef0e9fbe8/dfs/data/data3/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x2b6dd434-shared-pool-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1273988721_17 at /127.0.0.1:45248 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,39595,1690239969801' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Container metrics unregistration java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/40a10de8-ef1a-d60f-e3da-b5fca02ca095/cluster_8078c43e-6fde-7452-062d-548ef0e9fbe8/dfs/data/data6/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x2b6dd434-shared-pool-12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x2b6dd434-shared-pool-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1273988721_17 at /127.0.0.1:59574 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1284 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: HFileArchiver-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MutableQuantiles-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_473223116_1 at /127.0.0.1:60566 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/40a10de8-ef1a-d60f-e3da-b5fca02ca095/cluster_8078c43e-6fde-7452-062d-548ef0e9fbe8/dfs/data/data5/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (717546083) connection to jenkins-hbase4.apache.org/172.31.14.131:40351 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1273988721_17 at /127.0.0.1:60594 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #0 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.read1(BufferedReader.java:212) java.io.BufferedReader.read(BufferedReader.java:286) org.apache.hadoop.util.Shell$ShellCommandExecutor.parseExecResult(Shell.java:1229) org.apache.hadoop.util.Shell.runCommand(Shell.java:984) org.apache.hadoop.util.Shell.run(Shell.java:884) org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:1216) org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:294) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.launchContainer(ContainerLaunch.java:442) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:293) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:97) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/40a10de8-ef1a-d60f-e3da-b5fca02ca095/cluster_8078c43e-6fde-7452-062d-548ef0e9fbe8/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (717546083) connection to jenkins-hbase4.apache.org/172.31.14.131:42547 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: ContainersLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,39013,1690239969874' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/40a10de8-ef1a-d60f-e3da-b5fca02ca095/cluster_8078c43e-6fde-7452-062d-548ef0e9fbe8/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=915 (was 906) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=393 (was 344) - SystemLoadAverage LEAK? -, ProcessCount=180 (was 174) - ProcessCount LEAK? -, AvailableMemoryMB=5899 (was 7711) 2023-07-24 23:06:36,919 WARN [Listener at jenkins-hbase4.apache.org/43617] hbase.ResourceChecker(130): Thread=752 is superior to 500 2023-07-24 23:06:36,941 INFO [Listener at jenkins-hbase4.apache.org/43617] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testExportFileSystemState Thread=752, OpenFileDescriptor=915, MaxFileDescriptor=60000, SystemLoadAverage=393, ProcessCount=180, AvailableMemoryMB=5898 2023-07-24 23:06:36,941 WARN [Listener at jenkins-hbase4.apache.org/43617] hbase.ResourceChecker(130): Thread=752 is superior to 500 2023-07-24 23:06:36,943 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-24 23:06:36,946 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] procedure2.ProcedureExecutor(1029): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemState 2023-07-24 23:06:36,949 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-07-24 23:06:36,949 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemState" procId is: 27 2023-07-24 23:06:36,951 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-24 23:06:36,951 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-24 23:06:36,954 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.tmp/data/default/testtb-testExportFileSystemState/b4a26e79d5e698e94df128593a1e7d27 2023-07-24 23:06:36,954 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.tmp/data/default/testtb-testExportFileSystemState/90a5bc53b4f91ea984fc64e704e395cb 2023-07-24 23:06:36,955 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.tmp/data/default/testtb-testExportFileSystemState/90a5bc53b4f91ea984fc64e704e395cb empty. 2023-07-24 23:06:36,955 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.tmp/data/default/testtb-testExportFileSystemState/b4a26e79d5e698e94df128593a1e7d27 empty. 2023-07-24 23:06:36,956 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.tmp/data/default/testtb-testExportFileSystemState/90a5bc53b4f91ea984fc64e704e395cb 2023-07-24 23:06:36,956 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.tmp/data/default/testtb-testExportFileSystemState/b4a26e79d5e698e94df128593a1e7d27 2023-07-24 23:06:36,956 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-07-24 23:06:36,982 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.tmp/data/default/testtb-testExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-07-24 23:06:36,984 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => b4a26e79d5e698e94df128593a1e7d27, NAME => 'testtb-testExportFileSystemState,,1690239996943.b4a26e79d5e698e94df128593a1e7d27.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.tmp 2023-07-24 23:06:36,984 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => 90a5bc53b4f91ea984fc64e704e395cb, NAME => 'testtb-testExportFileSystemState,1,1690239996943.90a5bc53b4f91ea984fc64e704e395cb.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.tmp 2023-07-24 23:06:37,017 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1690239996943.b4a26e79d5e698e94df128593a1e7d27.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 23:06:37,019 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1690239996943.90a5bc53b4f91ea984fc64e704e395cb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 23:06:37,022 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing b4a26e79d5e698e94df128593a1e7d27, disabling compactions & flushes 2023-07-24 23:06:37,022 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1690239996943.b4a26e79d5e698e94df128593a1e7d27. 2023-07-24 23:06:37,022 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing 90a5bc53b4f91ea984fc64e704e395cb, disabling compactions & flushes 2023-07-24 23:06:37,022 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1690239996943.b4a26e79d5e698e94df128593a1e7d27. 2023-07-24 23:06:37,022 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1690239996943.90a5bc53b4f91ea984fc64e704e395cb. 2023-07-24 23:06:37,022 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1690239996943.b4a26e79d5e698e94df128593a1e7d27. after waiting 0 ms 2023-07-24 23:06:37,022 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1690239996943.90a5bc53b4f91ea984fc64e704e395cb. 2023-07-24 23:06:37,022 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1690239996943.b4a26e79d5e698e94df128593a1e7d27. 2023-07-24 23:06:37,022 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1690239996943.b4a26e79d5e698e94df128593a1e7d27. 2023-07-24 23:06:37,022 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1690239996943.90a5bc53b4f91ea984fc64e704e395cb. after waiting 0 ms 2023-07-24 23:06:37,023 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for b4a26e79d5e698e94df128593a1e7d27: 2023-07-24 23:06:37,023 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1690239996943.90a5bc53b4f91ea984fc64e704e395cb. 2023-07-24 23:06:37,023 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1690239996943.90a5bc53b4f91ea984fc64e704e395cb. 2023-07-24 23:06:37,023 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for 90a5bc53b4f91ea984fc64e704e395cb: 2023-07-24 23:06:37,028 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-07-24 23:06:37,029 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1690239996943.b4a26e79d5e698e94df128593a1e7d27.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690239997029"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690239997029"}]},"ts":"1690239997029"} 2023-07-24 23:06:37,029 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1690239996943.90a5bc53b4f91ea984fc64e704e395cb.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690239997029"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690239997029"}]},"ts":"1690239997029"} 2023-07-24 23:06:37,032 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-24 23:06:37,034 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-24 23:06:37,035 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690239997035"}]},"ts":"1690239997035"} 2023-07-24 23:06:37,040 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLING in hbase:meta 2023-07-24 23:06:37,045 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-24 23:06:37,046 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-24 23:06:37,046 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-24 23:06:37,046 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-24 23:06:37,046 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-24 23:06:37,047 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=b4a26e79d5e698e94df128593a1e7d27, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=90a5bc53b4f91ea984fc64e704e395cb, ASSIGN}] 2023-07-24 23:06:37,050 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=b4a26e79d5e698e94df128593a1e7d27, ASSIGN 2023-07-24 23:06:37,050 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=90a5bc53b4f91ea984fc64e704e395cb, ASSIGN 2023-07-24 23:06:37,052 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-24 23:06:37,053 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=b4a26e79d5e698e94df128593a1e7d27, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33227,1690239969957; forceNewPlan=false, retain=false 2023-07-24 23:06:37,054 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=90a5bc53b4f91ea984fc64e704e395cb, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39013,1690239969874; forceNewPlan=false, retain=false 2023-07-24 23:06:37,203 INFO [jenkins-hbase4:37213] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-24 23:06:37,206 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=b4a26e79d5e698e94df128593a1e7d27, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:06:37,206 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=90a5bc53b4f91ea984fc64e704e395cb, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39013,1690239969874 2023-07-24 23:06:37,206 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1690239996943.b4a26e79d5e698e94df128593a1e7d27.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690239997206"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690239997206"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690239997206"}]},"ts":"1690239997206"} 2023-07-24 23:06:37,206 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1690239996943.90a5bc53b4f91ea984fc64e704e395cb.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690239997206"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690239997206"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690239997206"}]},"ts":"1690239997206"} 2023-07-24 23:06:37,208 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=28, state=RUNNABLE; OpenRegionProcedure b4a26e79d5e698e94df128593a1e7d27, server=jenkins-hbase4.apache.org,33227,1690239969957}] 2023-07-24 23:06:37,209 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=31, ppid=29, state=RUNNABLE; OpenRegionProcedure 90a5bc53b4f91ea984fc64e704e395cb, server=jenkins-hbase4.apache.org,39013,1690239969874}] 2023-07-24 23:06:37,254 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-24 23:06:37,365 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,1,1690239996943.90a5bc53b4f91ea984fc64e704e395cb. 2023-07-24 23:06:37,365 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,,1690239996943.b4a26e79d5e698e94df128593a1e7d27. 2023-07-24 23:06:37,365 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 90a5bc53b4f91ea984fc64e704e395cb, NAME => 'testtb-testExportFileSystemState,1,1690239996943.90a5bc53b4f91ea984fc64e704e395cb.', STARTKEY => '1', ENDKEY => ''} 2023-07-24 23:06:37,365 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => b4a26e79d5e698e94df128593a1e7d27, NAME => 'testtb-testExportFileSystemState,,1690239996943.b4a26e79d5e698e94df128593a1e7d27.', STARTKEY => '', ENDKEY => '1'} 2023-07-24 23:06:37,366 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,1,1690239996943.90a5bc53b4f91ea984fc64e704e395cb. service=AccessControlService 2023-07-24 23:06:37,366 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 23:06:37,366 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,,1690239996943.b4a26e79d5e698e94df128593a1e7d27. service=AccessControlService 2023-07-24 23:06:37,366 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 90a5bc53b4f91ea984fc64e704e395cb 2023-07-24 23:06:37,366 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1690239996943.90a5bc53b4f91ea984fc64e704e395cb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 23:06:37,366 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 23:06:37,366 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 90a5bc53b4f91ea984fc64e704e395cb 2023-07-24 23:06:37,366 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 90a5bc53b4f91ea984fc64e704e395cb 2023-07-24 23:06:37,367 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState b4a26e79d5e698e94df128593a1e7d27 2023-07-24 23:06:37,367 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1690239996943.b4a26e79d5e698e94df128593a1e7d27.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 23:06:37,367 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for b4a26e79d5e698e94df128593a1e7d27 2023-07-24 23:06:37,367 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for b4a26e79d5e698e94df128593a1e7d27 2023-07-24 23:06:37,368 INFO [StoreOpener-90a5bc53b4f91ea984fc64e704e395cb-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 90a5bc53b4f91ea984fc64e704e395cb 2023-07-24 23:06:37,368 INFO [StoreOpener-b4a26e79d5e698e94df128593a1e7d27-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region b4a26e79d5e698e94df128593a1e7d27 2023-07-24 23:06:37,370 DEBUG [StoreOpener-b4a26e79d5e698e94df128593a1e7d27-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/default/testtb-testExportFileSystemState/b4a26e79d5e698e94df128593a1e7d27/cf 2023-07-24 23:06:37,370 DEBUG [StoreOpener-b4a26e79d5e698e94df128593a1e7d27-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/default/testtb-testExportFileSystemState/b4a26e79d5e698e94df128593a1e7d27/cf 2023-07-24 23:06:37,370 INFO [StoreOpener-b4a26e79d5e698e94df128593a1e7d27-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b4a26e79d5e698e94df128593a1e7d27 columnFamilyName cf 2023-07-24 23:06:37,371 INFO [StoreOpener-b4a26e79d5e698e94df128593a1e7d27-1] regionserver.HStore(310): Store=b4a26e79d5e698e94df128593a1e7d27/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 23:06:37,371 DEBUG [StoreOpener-90a5bc53b4f91ea984fc64e704e395cb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/default/testtb-testExportFileSystemState/90a5bc53b4f91ea984fc64e704e395cb/cf 2023-07-24 23:06:37,373 DEBUG [StoreOpener-90a5bc53b4f91ea984fc64e704e395cb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/default/testtb-testExportFileSystemState/90a5bc53b4f91ea984fc64e704e395cb/cf 2023-07-24 23:06:37,373 INFO [StoreOpener-90a5bc53b4f91ea984fc64e704e395cb-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 90a5bc53b4f91ea984fc64e704e395cb columnFamilyName cf 2023-07-24 23:06:37,373 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/default/testtb-testExportFileSystemState/b4a26e79d5e698e94df128593a1e7d27 2023-07-24 23:06:37,374 INFO [StoreOpener-90a5bc53b4f91ea984fc64e704e395cb-1] regionserver.HStore(310): Store=90a5bc53b4f91ea984fc64e704e395cb/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 23:06:37,375 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/default/testtb-testExportFileSystemState/b4a26e79d5e698e94df128593a1e7d27 2023-07-24 23:06:37,376 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/default/testtb-testExportFileSystemState/90a5bc53b4f91ea984fc64e704e395cb 2023-07-24 23:06:37,376 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/default/testtb-testExportFileSystemState/90a5bc53b4f91ea984fc64e704e395cb 2023-07-24 23:06:37,379 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for b4a26e79d5e698e94df128593a1e7d27 2023-07-24 23:06:37,379 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 90a5bc53b4f91ea984fc64e704e395cb 2023-07-24 23:06:37,382 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/default/testtb-testExportFileSystemState/b4a26e79d5e698e94df128593a1e7d27/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-24 23:06:37,382 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/default/testtb-testExportFileSystemState/90a5bc53b4f91ea984fc64e704e395cb/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-24 23:06:37,382 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened b4a26e79d5e698e94df128593a1e7d27; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72147453, jitterRate=0.07508082687854767}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-24 23:06:37,382 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for b4a26e79d5e698e94df128593a1e7d27: 2023-07-24 23:06:37,383 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 90a5bc53b4f91ea984fc64e704e395cb; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60827144, jitterRate=-0.0936049222946167}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-24 23:06:37,383 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 90a5bc53b4f91ea984fc64e704e395cb: 2023-07-24 23:06:37,384 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,,1690239996943.b4a26e79d5e698e94df128593a1e7d27., pid=30, masterSystemTime=1690239997361 2023-07-24 23:06:37,384 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,1,1690239996943.90a5bc53b4f91ea984fc64e704e395cb., pid=31, masterSystemTime=1690239997361 2023-07-24 23:06:37,386 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,,1690239996943.b4a26e79d5e698e94df128593a1e7d27. 2023-07-24 23:06:37,386 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,,1690239996943.b4a26e79d5e698e94df128593a1e7d27. 2023-07-24 23:06:37,387 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=b4a26e79d5e698e94df128593a1e7d27, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:06:37,387 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,1,1690239996943.90a5bc53b4f91ea984fc64e704e395cb. 2023-07-24 23:06:37,387 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,,1690239996943.b4a26e79d5e698e94df128593a1e7d27.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690239997387"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690239997387"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690239997387"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690239997387"}]},"ts":"1690239997387"} 2023-07-24 23:06:37,387 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,1,1690239996943.90a5bc53b4f91ea984fc64e704e395cb. 2023-07-24 23:06:37,388 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=90a5bc53b4f91ea984fc64e704e395cb, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39013,1690239969874 2023-07-24 23:06:37,389 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,1,1690239996943.90a5bc53b4f91ea984fc64e704e395cb.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690239997388"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690239997388"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690239997388"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690239997388"}]},"ts":"1690239997388"} 2023-07-24 23:06:37,393 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=28 2023-07-24 23:06:37,393 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=28, state=SUCCESS; OpenRegionProcedure b4a26e79d5e698e94df128593a1e7d27, server=jenkins-hbase4.apache.org,33227,1690239969957 in 182 msec 2023-07-24 23:06:37,394 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=31, resume processing ppid=29 2023-07-24 23:06:37,396 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=31, ppid=29, state=SUCCESS; OpenRegionProcedure 90a5bc53b4f91ea984fc64e704e395cb, server=jenkins-hbase4.apache.org,39013,1690239969874 in 182 msec 2023-07-24 23:06:37,397 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=b4a26e79d5e698e94df128593a1e7d27, ASSIGN in 346 msec 2023-07-24 23:06:37,399 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=29, resume processing ppid=27 2023-07-24 23:06:37,399 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=90a5bc53b4f91ea984fc64e704e395cb, ASSIGN in 348 msec 2023-07-24 23:06:37,400 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-24 23:06:37,400 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690239997400"}]},"ts":"1690239997400"} 2023-07-24 23:06:37,402 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLED in hbase:meta 2023-07-24 23:06:37,406 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-07-24 23:06:37,406 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemState jenkins: RWXCA 2023-07-24 23:06:37,409 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33227] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-24 23:06:37,410 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:39595-0x1019995a36f0001, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 23:06:37,410 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 23:06:37,410 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:33227-0x1019995a36f0003, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 23:06:37,410 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:39013-0x1019995a36f0002, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 23:06:37,412 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-24 23:06:37,412 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-24 23:06:37,412 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-24 23:06:37,414 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-24 23:06:37,415 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemState in 467 msec 2023-07-24 23:06:37,556 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-24 23:06:37,556 INFO [Listener at jenkins-hbase4.apache.org/43617] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemState, procId: 27 completed 2023-07-24 23:06:37,556 DEBUG [Listener at jenkins-hbase4.apache.org/43617] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testExportFileSystemState get assigned. Timeout = 60000ms 2023-07-24 23:06:37,557 INFO [Listener at jenkins-hbase4.apache.org/43617] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-24 23:06:37,561 INFO [Listener at jenkins-hbase4.apache.org/43617] hbase.HBaseTestingUtility(3484): All regions for table testtb-testExportFileSystemState assigned to meta. Checking AM states. 2023-07-24 23:06:37,561 INFO [Listener at jenkins-hbase4.apache.org/43617] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-24 23:06:37,562 INFO [Listener at jenkins-hbase4.apache.org/43617] hbase.HBaseTestingUtility(3504): All regions for table testtb-testExportFileSystemState assigned. 2023-07-24 23:06:37,566 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-24 23:06:37,566 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690239997566 (current time:1690239997566). 2023-07-24 23:06:37,566 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-24 23:06:37,566 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] zookeeper.ReadOnlyZKClient(139): Connect 0x3fd34269 to 127.0.0.1:52881 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 23:06:37,574 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1f6a342d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 23:06:37,575 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 23:06:37,576 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34862, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 23:06:37,578 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3fd34269 to 127.0.0.1:52881 2023-07-24 23:06:37,578 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 23:06:37,578 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] zookeeper.ReadOnlyZKClient(139): Connect 0x20a47301 to 127.0.0.1:52881 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 23:06:37,585 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@541ad76, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 23:06:37,586 DEBUG [hconnection-0x4bc42aaf-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 23:06:37,589 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34878, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 23:06:37,598 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 23:06:37,601 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42246, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 23:06:37,602 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x20a47301 to 127.0.0.1:52881 2023-07-24 23:06:37,603 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 23:06:37,603 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-24 23:06:37,604 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-24 23:06:37,604 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-24 23:06:37,606 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-24 23:06:37,608 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-24 23:06:37,609 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1690240597609 2023-07-24 23:06:37,609 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-07-24 23:06:37,609 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-24 23:06:37,610 DEBUG [Listener at jenkins-hbase4.apache.org/43617] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-24 23:06:37,611 DEBUG [Listener at jenkins-hbase4.apache.org/43617] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-24 23:06:37,612 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-24 23:06:37,612 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-24 23:06:37,615 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 7 msec 2023-07-24 23:06:37,616 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-24 23:06:37,619 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=33, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1690240597619 2023-07-24 23:06:37,639 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemState 2023-07-24 23:06:37,639 INFO [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemState' 2023-07-24 23:06:37,639 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 23:06:37,641 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' 2023-07-24 23:06:37,642 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-07-24 23:06:37,642 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-24 23:06:37,642 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-24 23:06:37,644 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:39595-0x1019995a36f0001, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 23:06:37,644 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:33227-0x1019995a36f0003, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 23:06:37,644 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:39013-0x1019995a36f0002, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 23:06:37,644 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 23:06:37,644 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:06:37,644 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 23:06:37,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 23:06:37,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 23:06:37,644 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 23:06:37,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 23:06:37,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-24 23:06:37,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-24 23:06:37,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-24 23:06:37,645 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:06:37,645 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39013,1690239969874 2023-07-24 23:06:37,645 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39595-0x1019995a36f0001, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-24 23:06:37,645 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39013-0x1019995a36f0002, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-24 23:06:37,645 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33227-0x1019995a36f0003, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-24 23:06:37,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-24 23:06:37,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-24 23:06:37,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-24 23:06:37,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-24 23:06:37,646 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-24 23:06:37,646 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-24 23:06:37,646 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-24 23:06:37,646 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1690239969801' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-24 23:06:37,646 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1690239969801' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 23:06:37,646 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-24 23:06:37,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-24 23:06:37,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-24 23:06:37,656 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39013,1690239969874 2023-07-24 23:06:37,656 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-24 23:06:37,656 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-24 23:06:37,647 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-24 23:06:37,656 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1690239969801' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-24 23:06:37,657 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 23:06:37,657 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1690239969801' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-24 23:06:37,657 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1690239969801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39595,1690239969801' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-24 23:06:37,660 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-24 23:06:37,660 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-24 23:06:37,660 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33227,1690239969957' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-24 23:06:37,660 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-24 23:06:37,660 DEBUG [member: 'jenkins-hbase4.apache.org,39013,1690239969874' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-24 23:06:37,660 DEBUG [member: 'jenkins-hbase4.apache.org,39013,1690239969874' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 23:06:37,660 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1690239969801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-24 23:06:37,661 DEBUG [member: 'jenkins-hbase4.apache.org,39013,1690239969874' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-24 23:06:37,664 DEBUG [member: 'jenkins-hbase4.apache.org,39013,1690239969874' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-24 23:06:37,664 DEBUG [member: 'jenkins-hbase4.apache.org,39013,1690239969874' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39013,1690239969874' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-24 23:06:37,664 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1690239969801' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39595-0x1019995a36f0001, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-24 23:06:37,664 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1690239969801' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 23:06:37,671 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:06:37,671 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-24 23:06:37,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:06:37,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 23:06:37,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 23:06:37,671 DEBUG [member: 'jenkins-hbase4.apache.org,39013,1690239969874' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-24 23:06:37,671 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39013,1690239969874 2023-07-24 23:06:37,671 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33227-0x1019995a36f0003, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-24 23:06:37,672 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 23:06:37,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 23:06:37,672 DEBUG [member: 'jenkins-hbase4.apache.org,39013,1690239969874' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39013-0x1019995a36f0002, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-24 23:06:37,672 DEBUG [member: 'jenkins-hbase4.apache.org,39013,1690239969874' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 23:06:37,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 23:06:37,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-24 23:06:37,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:06:37,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39013,1690239969874 2023-07-24 23:06:37,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39595,1690239969801 2023-07-24 23:06:37,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 23:06:37,674 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33227,1690239969957' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-07-24 23:06:37,674 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@59cd81e0[Count = 1] remaining members to acquire global barrier 2023-07-24 23:06:37,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39013,1690239969874 2023-07-24 23:06:37,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 23:06:37,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 23:06:37,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 23:06:37,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 23:06:37,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-24 23:06:37,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:06:37,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39013,1690239969874 2023-07-24 23:06:37,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39595,1690239969801 2023-07-24 23:06:37,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 23:06:37,677 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39013,1690239969874' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-07-24 23:06:37,677 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@59cd81e0[Count = 0] remaining members to acquire global barrier 2023-07-24 23:06:37,677 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-07-24 23:06:37,677 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-24 23:06:37,679 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:33227-0x1019995a36f0003, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-24 23:06:37,679 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-24 23:06:37,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-24 23:06:37,679 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:39595-0x1019995a36f0001, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-24 23:06:37,679 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-24 23:06:37,679 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-24 23:06:37,679 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:06:37,679 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:39013-0x1019995a36f0002, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-24 23:06:37,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-24 23:06:37,679 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1690239969801' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-24 23:06:37,679 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1690239969801' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-24 23:06:37,679 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-24 23:06:37,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-24 23:06:37,679 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1690239969801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,39595,1690239969801' in zk 2023-07-24 23:06:37,680 DEBUG [member: 'jenkins-hbase4.apache.org,39013,1690239969874' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-24 23:06:37,680 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39013,1690239969874 2023-07-24 23:06:37,680 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-24 23:06:37,682 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1690239969801' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-24 23:06:37,682 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1690239969801' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 23:06:37,682 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1690239969801' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-24 23:06:37,682 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 23:06:37,684 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 23:06:37,684 DEBUG [rs(jenkins-hbase4.apache.org,33227,1690239969957)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1690239996943.b4a26e79d5e698e94df128593a1e7d27. 2023-07-24 23:06:37,684 DEBUG [rs(jenkins-hbase4.apache.org,33227,1690239969957)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1690239996943.b4a26e79d5e698e94df128593a1e7d27. started... 2023-07-24 23:06:37,692 DEBUG [member: 'jenkins-hbase4.apache.org,39013,1690239969874' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 23:06:37,692 DEBUG [rs(jenkins-hbase4.apache.org,33227,1690239969957)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for b4a26e79d5e698e94df128593a1e7d27: 2023-07-24 23:06:37,692 DEBUG [member: 'jenkins-hbase4.apache.org,39013,1690239969874' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 23:06:37,692 DEBUG [rs(jenkins-hbase4.apache.org,39013,1690239969874)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1690239996943.90a5bc53b4f91ea984fc64e704e395cb. 2023-07-24 23:06:37,692 DEBUG [rs(jenkins-hbase4.apache.org,39013,1690239969874)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1690239996943.90a5bc53b4f91ea984fc64e704e395cb. started... 2023-07-24 23:06:37,692 DEBUG [rs(jenkins-hbase4.apache.org,33227,1690239969957)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1690239996943.b4a26e79d5e698e94df128593a1e7d27.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-24 23:06:37,692 DEBUG [rs(jenkins-hbase4.apache.org,33227,1690239969957)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 23:06:37,692 DEBUG [rs(jenkins-hbase4.apache.org,33227,1690239969957)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-24 23:06:37,694 DEBUG [rs(jenkins-hbase4.apache.org,39013,1690239969874)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 90a5bc53b4f91ea984fc64e704e395cb: 2023-07-24 23:06:37,694 DEBUG [rs(jenkins-hbase4.apache.org,39013,1690239969874)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1690239996943.90a5bc53b4f91ea984fc64e704e395cb.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-24 23:06:37,694 DEBUG [rs(jenkins-hbase4.apache.org,39013,1690239969874)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 23:06:37,694 DEBUG [rs(jenkins-hbase4.apache.org,39013,1690239969874)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-24 23:06:37,711 DEBUG [Listener at jenkins-hbase4.apache.org/43617] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 23:06:37,712 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-24 23:06:37,712 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-24 23:06:37,712 DEBUG [Listener at jenkins-hbase4.apache.org/43617] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-24 23:06:37,715 DEBUG [rs(jenkins-hbase4.apache.org,33227,1690239969957)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1690239996943.b4a26e79d5e698e94df128593a1e7d27. completed. 2023-07-24 23:06:37,715 DEBUG [rs(jenkins-hbase4.apache.org,33227,1690239969957)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1690239996943.b4a26e79d5e698e94df128593a1e7d27. 2023-07-24 23:06:37,715 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 23:06:37,715 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 23:06:37,715 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:06:37,715 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-24 23:06:37,715 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,33227,1690239969957' in zk 2023-07-24 23:06:37,720 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:06:37,720 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-24 23:06:37,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:06:37,720 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 23:06:37,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 23:06:37,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 23:06:37,720 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-24 23:06:37,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 23:06:37,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 23:06:37,723 DEBUG [rs(jenkins-hbase4.apache.org,39013,1690239969874)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1690239996943.90a5bc53b4f91ea984fc64e704e395cb. completed. 2023-07-24 23:06:37,723 DEBUG [rs(jenkins-hbase4.apache.org,39013,1690239969874)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1690239996943.90a5bc53b4f91ea984fc64e704e395cb. 2023-07-24 23:06:37,724 DEBUG [member: 'jenkins-hbase4.apache.org,39013,1690239969874' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 23:06:37,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-24 23:06:37,724 DEBUG [member: 'jenkins-hbase4.apache.org,39013,1690239969874' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 23:06:37,724 DEBUG [member: 'jenkins-hbase4.apache.org,39013,1690239969874' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39013,1690239969874 2023-07-24 23:06:37,724 DEBUG [member: 'jenkins-hbase4.apache.org,39013,1690239969874' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-24 23:06:37,724 DEBUG [member: 'jenkins-hbase4.apache.org,39013,1690239969874' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,39013,1690239969874' in zk 2023-07-24 23:06:37,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:06:37,725 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39013,1690239969874 2023-07-24 23:06:37,725 DEBUG [member: 'jenkins-hbase4.apache.org,39013,1690239969874' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-24 23:06:37,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39013,1690239969874 2023-07-24 23:06:37,725 DEBUG [member: 'jenkins-hbase4.apache.org,39013,1690239969874' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 23:06:37,726 DEBUG [member: 'jenkins-hbase4.apache.org,39013,1690239969874' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-24 23:06:37,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39595,1690239969801 2023-07-24 23:06:37,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 23:06:37,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-24 23:06:37,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:06:37,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39013,1690239969874 2023-07-24 23:06:37,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39595,1690239969801 2023-07-24 23:06:37,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,33227,1690239969957': 2023-07-24 23:06:37,730 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33227,1690239969957' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-24 23:06:37,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39013,1690239969874 2023-07-24 23:06:37,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 23:06:37,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 23:06:37,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 23:06:37,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 23:06:37,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-24 23:06:37,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:06:37,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39013,1690239969874 2023-07-24 23:06:37,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39595,1690239969801 2023-07-24 23:06:37,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 23:06:37,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-24 23:06:37,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:06:37,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39013,1690239969874 2023-07-24 23:06:37,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39595,1690239969801 2023-07-24 23:06:37,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,39013,1690239969874': 2023-07-24 23:06:37,735 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39013,1690239969874' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-24 23:06:37,735 INFO [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemState' execution completed 2023-07-24 23:06:37,735 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-24 23:06:37,735 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-24 23:06:37,735 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemState 2023-07-24 23:06:37,735 INFO [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-24 23:06:37,737 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-24 23:06:37,737 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:33227-0x1019995a36f0003, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-24 23:06:37,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-24 23:06:37,737 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:39013-0x1019995a36f0002, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-24 23:06:37,738 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:39013-0x1019995a36f0002, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 23:06:37,738 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-24 23:06:37,737 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:39595-0x1019995a36f0001, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-24 23:06:37,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-24 23:06:37,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 23:06:37,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 23:06:37,737 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-24 23:06:37,737 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:33227-0x1019995a36f0003, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 23:06:37,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-24 23:06:37,738 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-24 23:06:37,738 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 23:06:37,738 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:39595-0x1019995a36f0001, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 23:06:37,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 23:06:37,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 23:06:37,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-24 23:06:37,738 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 23:06:37,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 23:06:37,739 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:06:37,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-24 23:06:37,739 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 23:06:37,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 23:06:37,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-24 23:06:37,739 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39013,1690239969874 2023-07-24 23:06:37,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-24 23:06:37,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-24 23:06:37,740 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39595,1690239969801 2023-07-24 23:06:37,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 23:06:37,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-24 23:06:37,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:06:37,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39013,1690239969874 2023-07-24 23:06:37,742 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:06:37,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39595,1690239969801 2023-07-24 23:06:37,742 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39013,1690239969874 2023-07-24 23:06:37,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 23:06:37,743 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39595,1690239969801 2023-07-24 23:06:37,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-24 23:06:37,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:06:37,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39013,1690239969874 2023-07-24 23:06:37,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39595,1690239969801 2023-07-24 23:06:37,746 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39595,1690239969801 2023-07-24 23:06:37,746 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-24 23:06:37,746 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39013,1690239969874 2023-07-24 23:06:37,746 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:06:37,746 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 23:06:37,746 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:39013-0x1019995a36f0002, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 23:06:37,746 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:33227-0x1019995a36f0003, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 23:06:37,746 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:39595-0x1019995a36f0001, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 23:06:37,748 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 23:06:37,748 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 23:06:37,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 23:06:37,748 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:39595-0x1019995a36f0001, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 23:06:37,748 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:33227-0x1019995a36f0003, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 23:06:37,748 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 23:06:37,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 23:06:37,748 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:39013-0x1019995a36f0002, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 23:06:37,746 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemState 2023-07-24 23:06:37,748 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemState 2023-07-24 23:06:37,748 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 23:06:37,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 23:06:37,748 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 23:06:37,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 23:06:37,746 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-24 23:06:37,749 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39595,1690239969801 2023-07-24 23:06:37,749 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-24 23:06:37,749 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39013,1690239969874 2023-07-24 23:06:37,749 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:06:37,749 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-24 23:06:37,749 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-24 23:06:37,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 23:06:37,749 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 23:06:37,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 23:06:37,749 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-24 23:06:37,768 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState to hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.hbase-snapshot/emptySnaptb0-testExportFileSystemState 2023-07-24 23:06:37,793 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-07-24 23:06:37,794 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-24 23:06:37,794 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-24 23:06:37,794 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1690239997609Consolidate snapshot: emptySnaptb0-testExportFileSystemState at 1690239997748 (+139 ms)Loading Region manifests for emptySnaptb0-testExportFileSystemState at 1690239997748Writing data manifest for emptySnaptb0-testExportFileSystemState at 1690239997753 (+5 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemState at 1690239997762 (+9 ms)Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1690239997793 (+31 ms) 2023-07-24 23:06:37,797 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=33, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-24 23:06:37,799 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=33, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 187 msec 2023-07-24 23:06:37,913 DEBUG [Listener at jenkins-hbase4.apache.org/43617] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 23:06:37,916 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-24 23:06:37,916 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-24 23:06:37,934 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33227] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,,1690239996943.b4a26e79d5e698e94df128593a1e7d27. with WAL disabled. Data may be lost in the event of a crash. 2023-07-24 23:06:37,936 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39013] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,1,1690239996943.90a5bc53b4f91ea984fc64e704e395cb. with WAL disabled. Data may be lost in the event of a crash. 2023-07-24 23:06:37,944 DEBUG [Listener at jenkins-hbase4.apache.org/43617] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-07-24 23:06:37,944 DEBUG [Listener at jenkins-hbase4.apache.org/43617] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1690239996943.b4a26e79d5e698e94df128593a1e7d27. 2023-07-24 23:06:37,946 INFO [Listener at jenkins-hbase4.apache.org/43617] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-24 23:06:37,960 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-24 23:06:37,960 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690239997960 (current time:1690239997960). 2023-07-24 23:06:37,960 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-24 23:06:37,961 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] zookeeper.ReadOnlyZKClient(139): Connect 0x653b2a06 to 127.0.0.1:52881 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 23:06:37,967 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@dcd08f4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 23:06:37,969 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 23:06:37,971 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34892, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 23:06:37,972 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x653b2a06 to 127.0.0.1:52881 2023-07-24 23:06:37,972 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 23:06:37,973 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] zookeeper.ReadOnlyZKClient(139): Connect 0x14ca1bdd to 127.0.0.1:52881 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 23:06:37,980 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4d724f17, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 23:06:37,982 DEBUG [hconnection-0x42fe1dd7-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 23:06:37,983 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34902, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 23:06:37,987 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 23:06:37,988 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42252, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 23:06:37,989 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x14ca1bdd to 127.0.0.1:52881 2023-07-24 23:06:37,989 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 23:06:37,989 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-24 23:06:37,990 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-24 23:06:37,990 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-24 23:06:37,993 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] procedure2.ProcedureExecutor(1029): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-24 23:06:37,994 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-24 23:06:37,995 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1690240597995 2023-07-24 23:06:37,995 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-07-24 23:06:37,995 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-24 23:06:37,997 DEBUG [Listener at jenkins-hbase4.apache.org/43617] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-24 23:06:37,997 DEBUG [Listener at jenkins-hbase4.apache.org/43617] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-24 23:06:37,998 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-24 23:06:37,998 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-24 23:06:37,999 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 6 msec 2023-07-24 23:06:38,000 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-24 23:06:38,001 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=35, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1690240598001 2023-07-24 23:06:38,013 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemState 2023-07-24 23:06:38,013 INFO [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemState' 2023-07-24 23:06:38,013 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 23:06:38,014 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemState' starting 'acquire' 2023-07-24 23:06:38,014 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-07-24 23:06:38,015 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-24 23:06:38,015 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-24 23:06:38,022 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:39013-0x1019995a36f0002, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 23:06:38,022 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:06:38,022 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 23:06:38,022 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:39595-0x1019995a36f0001, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 23:06:38,022 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:33227-0x1019995a36f0003, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 23:06:38,023 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 23:06:38,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 23:06:38,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 23:06:38,023 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 23:06:38,023 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:06:38,023 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39013,1690239969874 2023-07-24 23:06:38,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 23:06:38,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-24 23:06:38,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-24 23:06:38,023 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39013,1690239969874 2023-07-24 23:06:38,023 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-24 23:06:38,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-24 23:06:38,023 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39595-0x1019995a36f0001, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-24 23:06:38,023 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39013-0x1019995a36f0002, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-24 23:06:38,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-24 23:06:38,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-24 23:06:38,024 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33227-0x1019995a36f0003, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-24 23:06:38,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-24 23:06:38,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-24 23:06:38,024 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-24 23:06:38,024 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-24 23:06:38,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-24 23:06:38,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-24 23:06:38,024 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-24 23:06:38,024 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-24 23:06:38,024 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1690239969801' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-24 23:06:38,024 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1690239969801' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 23:06:38,029 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1690239969801' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-24 23:06:38,029 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1690239969801' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-24 23:06:38,029 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-24 23:06:38,029 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1690239969801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39595,1690239969801' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-24 23:06:38,029 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-24 23:06:38,029 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-24 23:06:38,029 DEBUG [member: 'jenkins-hbase4.apache.org,39013,1690239969874' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-24 23:06:38,029 DEBUG [member: 'jenkins-hbase4.apache.org,39013,1690239969874' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 23:06:38,029 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 23:06:38,030 DEBUG [member: 'jenkins-hbase4.apache.org,39013,1690239969874' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-24 23:06:38,031 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-24 23:06:38,031 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-24 23:06:38,031 DEBUG [member: 'jenkins-hbase4.apache.org,39013,1690239969874' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-24 23:06:38,031 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33227,1690239969957' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-24 23:06:38,031 DEBUG [member: 'jenkins-hbase4.apache.org,39013,1690239969874' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39013,1690239969874' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-24 23:06:38,033 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1690239969801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-24 23:06:38,034 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1690239969801' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39595-0x1019995a36f0001, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-24 23:06:38,034 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39013,1690239969874 2023-07-24 23:06:38,034 DEBUG [member: 'jenkins-hbase4.apache.org,39013,1690239969874' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-24 23:06:38,034 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1690239969801' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 23:06:38,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39013,1690239969874 2023-07-24 23:06:38,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 23:06:38,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 23:06:38,035 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:06:38,035 DEBUG [member: 'jenkins-hbase4.apache.org,39013,1690239969874' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39013-0x1019995a36f0002, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-24 23:06:38,035 DEBUG [member: 'jenkins-hbase4.apache.org,39013,1690239969874' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 23:06:38,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 23:06:38,035 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-24 23:06:38,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 23:06:38,035 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33227-0x1019995a36f0003, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-24 23:06:38,035 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 23:06:38,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-24 23:06:38,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:06:38,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39013,1690239969874 2023-07-24 23:06:38,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39595,1690239969801 2023-07-24 23:06:38,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 23:06:38,037 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39013,1690239969874' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-07-24 23:06:38,037 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1693c124[Count = 1] remaining members to acquire global barrier 2023-07-24 23:06:38,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:06:38,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 23:06:38,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 23:06:38,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 23:06:38,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 23:06:38,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-24 23:06:38,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:06:38,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39013,1690239969874 2023-07-24 23:06:38,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39595,1690239969801 2023-07-24 23:06:38,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 23:06:38,039 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33227,1690239969957' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-07-24 23:06:38,039 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1693c124[Count = 0] remaining members to acquire global barrier 2023-07-24 23:06:38,039 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-07-24 23:06:38,039 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-24 23:06:38,041 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:33227-0x1019995a36f0003, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-24 23:06:38,041 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:39595-0x1019995a36f0001, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-24 23:06:38,042 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-24 23:06:38,042 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-24 23:06:38,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-24 23:06:38,041 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:39013-0x1019995a36f0002, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-24 23:06:38,042 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-24 23:06:38,042 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39013,1690239969874 2023-07-24 23:06:38,042 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-24 23:06:38,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-24 23:06:38,042 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 23:06:38,042 DEBUG [member: 'jenkins-hbase4.apache.org,39013,1690239969874' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-24 23:06:38,042 DEBUG [rs(jenkins-hbase4.apache.org,33227,1690239969957)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1690239996943.b4a26e79d5e698e94df128593a1e7d27. 2023-07-24 23:06:38,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-24 23:06:38,042 DEBUG [rs(jenkins-hbase4.apache.org,33227,1690239969957)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1690239996943.b4a26e79d5e698e94df128593a1e7d27. started... 2023-07-24 23:06:38,042 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 23:06:38,042 DEBUG [rs(jenkins-hbase4.apache.org,39013,1690239969874)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1690239996943.90a5bc53b4f91ea984fc64e704e395cb. 2023-07-24 23:06:38,042 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1690239969801' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-24 23:06:38,042 DEBUG [rs(jenkins-hbase4.apache.org,39013,1690239969874)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1690239996943.90a5bc53b4f91ea984fc64e704e395cb. started... 2023-07-24 23:06:38,042 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1690239969801' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-24 23:06:38,042 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:06:38,043 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-24 23:06:38,042 DEBUG [member: 'jenkins-hbase4.apache.org,39013,1690239969874' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 23:06:38,042 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1690239969801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,39595,1690239969801' in zk 2023-07-24 23:06:38,043 INFO [rs(jenkins-hbase4.apache.org,39013,1690239969874)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 90a5bc53b4f91ea984fc64e704e395cb 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-07-24 23:06:38,042 INFO [rs(jenkins-hbase4.apache.org,33227,1690239969957)-snapshot-pool-0] regionserver.HRegion(2745): Flushing b4a26e79d5e698e94df128593a1e7d27 1/1 column families, dataSize=199 B heapSize=688 B 2023-07-24 23:06:38,043 DEBUG [member: 'jenkins-hbase4.apache.org,39013,1690239969874' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 23:06:38,044 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1690239969801' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-24 23:06:38,044 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1690239969801' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 23:06:38,044 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1690239969801' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-24 23:06:38,058 INFO [rs(jenkins-hbase4.apache.org,33227,1690239969957)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=199 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/default/testtb-testExportFileSystemState/b4a26e79d5e698e94df128593a1e7d27/.tmp/cf/b2ecadc3a6824a57bc1640d20e4f066e 2023-07-24 23:06:38,061 INFO [rs(jenkins-hbase4.apache.org,39013,1690239969874)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.06 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/default/testtb-testExportFileSystemState/90a5bc53b4f91ea984fc64e704e395cb/.tmp/cf/d2fa5738f5cc49ae95ad53bd8d132094 2023-07-24 23:06:38,071 DEBUG [rs(jenkins-hbase4.apache.org,39013,1690239969874)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/default/testtb-testExportFileSystemState/90a5bc53b4f91ea984fc64e704e395cb/.tmp/cf/d2fa5738f5cc49ae95ad53bd8d132094 as hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/default/testtb-testExportFileSystemState/90a5bc53b4f91ea984fc64e704e395cb/cf/d2fa5738f5cc49ae95ad53bd8d132094 2023-07-24 23:06:38,072 DEBUG [rs(jenkins-hbase4.apache.org,33227,1690239969957)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/default/testtb-testExportFileSystemState/b4a26e79d5e698e94df128593a1e7d27/.tmp/cf/b2ecadc3a6824a57bc1640d20e4f066e as hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/default/testtb-testExportFileSystemState/b4a26e79d5e698e94df128593a1e7d27/cf/b2ecadc3a6824a57bc1640d20e4f066e 2023-07-24 23:06:38,084 INFO [rs(jenkins-hbase4.apache.org,33227,1690239969957)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/default/testtb-testExportFileSystemState/b4a26e79d5e698e94df128593a1e7d27/cf/b2ecadc3a6824a57bc1640d20e4f066e, entries=3, sequenceid=6, filesize=5.0 K 2023-07-24 23:06:38,086 INFO [rs(jenkins-hbase4.apache.org,33227,1690239969957)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for b4a26e79d5e698e94df128593a1e7d27 in 44ms, sequenceid=6, compaction requested=false 2023-07-24 23:06:38,086 DEBUG [rs(jenkins-hbase4.apache.org,33227,1690239969957)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemState' 2023-07-24 23:06:38,087 DEBUG [rs(jenkins-hbase4.apache.org,33227,1690239969957)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for b4a26e79d5e698e94df128593a1e7d27: 2023-07-24 23:06:38,087 DEBUG [rs(jenkins-hbase4.apache.org,33227,1690239969957)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1690239996943.b4a26e79d5e698e94df128593a1e7d27.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-24 23:06:38,087 DEBUG [rs(jenkins-hbase4.apache.org,33227,1690239969957)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 23:06:38,088 DEBUG [rs(jenkins-hbase4.apache.org,33227,1690239969957)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/default/testtb-testExportFileSystemState/b4a26e79d5e698e94df128593a1e7d27/cf/b2ecadc3a6824a57bc1640d20e4f066e] hfiles 2023-07-24 23:06:38,088 DEBUG [rs(jenkins-hbase4.apache.org,33227,1690239969957)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/default/testtb-testExportFileSystemState/b4a26e79d5e698e94df128593a1e7d27/cf/b2ecadc3a6824a57bc1640d20e4f066e for snapshot=snaptb0-testExportFileSystemState 2023-07-24 23:06:38,094 INFO [rs(jenkins-hbase4.apache.org,39013,1690239969874)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/default/testtb-testExportFileSystemState/90a5bc53b4f91ea984fc64e704e395cb/cf/d2fa5738f5cc49ae95ad53bd8d132094, entries=47, sequenceid=6, filesize=8 K 2023-07-24 23:06:38,097 DEBUG [Listener at jenkins-hbase4.apache.org/43617] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 23:06:38,097 INFO [rs(jenkins-hbase4.apache.org,39013,1690239969874)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for 90a5bc53b4f91ea984fc64e704e395cb in 54ms, sequenceid=6, compaction requested=false 2023-07-24 23:06:38,107 DEBUG [rs(jenkins-hbase4.apache.org,39013,1690239969874)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 90a5bc53b4f91ea984fc64e704e395cb: 2023-07-24 23:06:38,108 DEBUG [rs(jenkins-hbase4.apache.org,39013,1690239969874)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1690239996943.90a5bc53b4f91ea984fc64e704e395cb.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-24 23:06:38,108 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-24 23:06:38,108 DEBUG [rs(jenkins-hbase4.apache.org,39013,1690239969874)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 23:06:38,108 DEBUG [rs(jenkins-hbase4.apache.org,39013,1690239969874)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/default/testtb-testExportFileSystemState/90a5bc53b4f91ea984fc64e704e395cb/cf/d2fa5738f5cc49ae95ad53bd8d132094] hfiles 2023-07-24 23:06:38,109 DEBUG [rs(jenkins-hbase4.apache.org,39013,1690239969874)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/default/testtb-testExportFileSystemState/90a5bc53b4f91ea984fc64e704e395cb/cf/d2fa5738f5cc49ae95ad53bd8d132094 for snapshot=snaptb0-testExportFileSystemState 2023-07-24 23:06:38,108 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-24 23:06:38,110 DEBUG [Listener at jenkins-hbase4.apache.org/43617] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-24 23:06:38,142 DEBUG [rs(jenkins-hbase4.apache.org,33227,1690239969957)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1690239996943.b4a26e79d5e698e94df128593a1e7d27. completed. 2023-07-24 23:06:38,142 DEBUG [rs(jenkins-hbase4.apache.org,33227,1690239969957)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1690239996943.b4a26e79d5e698e94df128593a1e7d27. 2023-07-24 23:06:38,143 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 23:06:38,143 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 23:06:38,143 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:06:38,143 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-24 23:06:38,143 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,33227,1690239969957' in zk 2023-07-24 23:06:38,147 DEBUG [rs(jenkins-hbase4.apache.org,39013,1690239969874)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1690239996943.90a5bc53b4f91ea984fc64e704e395cb. completed. 2023-07-24 23:06:38,147 DEBUG [rs(jenkins-hbase4.apache.org,39013,1690239969874)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1690239996943.90a5bc53b4f91ea984fc64e704e395cb. 2023-07-24 23:06:38,147 DEBUG [member: 'jenkins-hbase4.apache.org,39013,1690239969874' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 23:06:38,148 DEBUG [member: 'jenkins-hbase4.apache.org,39013,1690239969874' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 23:06:38,148 DEBUG [member: 'jenkins-hbase4.apache.org,39013,1690239969874' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39013,1690239969874 2023-07-24 23:06:38,148 DEBUG [member: 'jenkins-hbase4.apache.org,39013,1690239969874' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-24 23:06:38,148 DEBUG [member: 'jenkins-hbase4.apache.org,39013,1690239969874' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,39013,1690239969874' in zk 2023-07-24 23:06:38,148 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:06:38,148 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-24 23:06:38,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:06:38,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 23:06:38,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 23:06:38,148 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 23:06:38,148 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-24 23:06:38,152 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39013,1690239969874 2023-07-24 23:06:38,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 23:06:38,153 DEBUG [member: 'jenkins-hbase4.apache.org,39013,1690239969874' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-24 23:06:38,153 DEBUG [member: 'jenkins-hbase4.apache.org,39013,1690239969874' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 23:06:38,153 DEBUG [member: 'jenkins-hbase4.apache.org,39013,1690239969874' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-24 23:06:38,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 23:06:38,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-24 23:06:38,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:06:38,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39013,1690239969874 2023-07-24 23:06:38,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39595,1690239969801 2023-07-24 23:06:38,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 23:06:38,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-24 23:06:38,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:06:38,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39013,1690239969874 2023-07-24 23:06:38,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39595,1690239969801 2023-07-24 23:06:38,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,33227,1690239969957': 2023-07-24 23:06:38,157 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33227,1690239969957' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-24 23:06:38,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39013,1690239969874 2023-07-24 23:06:38,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 23:06:38,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 23:06:38,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 23:06:38,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 23:06:38,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-24 23:06:38,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:06:38,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39013,1690239969874 2023-07-24 23:06:38,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39595,1690239969801 2023-07-24 23:06:38,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 23:06:38,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-24 23:06:38,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:06:38,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39013,1690239969874 2023-07-24 23:06:38,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39595,1690239969801 2023-07-24 23:06:38,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,39013,1690239969874': 2023-07-24 23:06:38,161 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39013,1690239969874' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-24 23:06:38,161 INFO [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemState' execution completed 2023-07-24 23:06:38,162 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-24 23:06:38,162 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-24 23:06:38,162 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemState 2023-07-24 23:06:38,162 INFO [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-24 23:06:38,163 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-24 23:06:38,163 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:39013-0x1019995a36f0002, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-24 23:06:38,164 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:39013-0x1019995a36f0002, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 23:06:38,164 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:33227-0x1019995a36f0003, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-24 23:06:38,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-24 23:06:38,164 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-24 23:06:38,164 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-24 23:06:38,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-24 23:06:38,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 23:06:38,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 23:06:38,164 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:39595-0x1019995a36f0001, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-24 23:06:38,164 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:33227-0x1019995a36f0003, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 23:06:38,164 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-24 23:06:38,164 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:39595-0x1019995a36f0001, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 23:06:38,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-24 23:06:38,164 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 23:06:38,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 23:06:38,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-24 23:06:38,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-24 23:06:38,165 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 23:06:38,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 23:06:38,165 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 23:06:38,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 23:06:38,165 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:06:38,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 23:06:38,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-24 23:06:38,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-24 23:06:38,166 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39013,1690239969874 2023-07-24 23:06:38,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-24 23:06:38,167 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39595,1690239969801 2023-07-24 23:06:38,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 23:06:38,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-24 23:06:38,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:06:38,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39013,1690239969874 2023-07-24 23:06:38,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39595,1690239969801 2023-07-24 23:06:38,169 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:06:38,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 23:06:38,170 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39013,1690239969874 2023-07-24 23:06:38,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-24 23:06:38,170 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39595,1690239969801 2023-07-24 23:06:38,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:06:38,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39013,1690239969874 2023-07-24 23:06:38,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39595,1690239969801 2023-07-24 23:06:38,174 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:39013-0x1019995a36f0002, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 23:06:38,174 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:33227-0x1019995a36f0003, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 23:06:38,174 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 23:06:38,174 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 23:06:38,174 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:33227-0x1019995a36f0003, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 23:06:38,174 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39595,1690239969801 2023-07-24 23:06:38,174 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:39595-0x1019995a36f0001, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 23:06:38,174 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:39013-0x1019995a36f0002, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 23:06:38,175 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 23:06:38,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 23:06:38,175 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:39595-0x1019995a36f0001, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 23:06:38,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 23:06:38,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 23:06:38,175 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-24 23:06:38,175 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39013,1690239969874 2023-07-24 23:06:38,175 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:06:38,175 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-24 23:06:38,175 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39595,1690239969801 2023-07-24 23:06:38,175 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-24 23:06:38,175 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39013,1690239969874 2023-07-24 23:06:38,175 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 23:06:38,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 23:06:38,176 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:06:38,176 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 23:06:38,176 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 23:06:38,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 23:06:38,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 23:06:38,176 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-24 23:06:38,176 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-24 23:06:38,176 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 23:06:38,176 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemState 2023-07-24 23:06:38,178 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemState 2023-07-24 23:06:38,181 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-24 23:06:38,207 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState to hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-24 23:06:38,233 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-07-24 23:06:38,233 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-24 23:06:38,234 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-24 23:06:38,234 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1690239997995Consolidate snapshot: snaptb0-testExportFileSystemState at 1690239998178 (+183 ms)Loading Region manifests for snaptb0-testExportFileSystemState at 1690239998179 (+1 ms)Writing data manifest for snaptb0-testExportFileSystemState at 1690239998184 (+5 ms)Verifying snapshot: snaptb0-testExportFileSystemState at 1690239998199 (+15 ms)Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1690239998233 (+34 ms) 2023-07-24 23:06:38,237 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=35, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-24 23:06:38,239 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=35, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 241 msec 2023-07-24 23:06:38,310 DEBUG [Listener at jenkins-hbase4.apache.org/43617] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 23:06:38,313 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-24 23:06:38,313 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-24 23:06:38,314 INFO [Listener at jenkins-hbase4.apache.org/43617] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/export-test/export-1690239998314 2023-07-24 23:06:38,314 INFO [Listener at jenkins-hbase4.apache.org/43617] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:37611, tgtDir=hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/export-test/export-1690239998314, rawTgtDir=hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/export-test/export-1690239998314, srcFsUri=hdfs://localhost:37611, srcDir=hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb 2023-07-24 23:06:38,349 DEBUG [Listener at jenkins-hbase4.apache.org/43617] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:37611, inputRoot=hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb 2023-07-24 23:06:38,350 DEBUG [Listener at jenkins-hbase4.apache.org/43617] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-829026250_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/export-test/export-1690239998314, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/export-test/export-1690239998314/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-24 23:06:38,350 INFO [Listener at jenkins-hbase4.apache.org/43617] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:37611, inputRoot=hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb, snapshotDir=hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.hbase-snapshot/snaptb0-testExportFileSystemState. 2023-07-24 23:06:38,369 INFO [Listener at jenkins-hbase4.apache.org/43617] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.hbase-snapshot/snaptb0-testExportFileSystemState to hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/export-test/export-1690239998314/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-24 23:06:38,471 DEBUG [Listener at jenkins-hbase4.apache.org/43617] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-24 23:06:38,471 DEBUG [Listener at jenkins-hbase4.apache.org/43617] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-24 23:06:38,472 DEBUG [Listener at jenkins-hbase4.apache.org/43617] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-24 23:06:38,472 DEBUG [Listener at jenkins-hbase4.apache.org/43617] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-24 23:06:38,472 DEBUG [Listener at jenkins-hbase4.apache.org/43617] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-24 23:06:38,473 DEBUG [Listener at jenkins-hbase4.apache.org/43617] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-24 23:06:38,473 DEBUG [Listener at jenkins-hbase4.apache.org/43617] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-24 23:06:38,555 DEBUG [Listener at jenkins-hbase4.apache.org/43617] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/40a10de8-ef1a-d60f-e3da-b5fca02ca095/hadoop-7039270860793166687.jar 2023-07-24 23:06:38,556 DEBUG [Listener at jenkins-hbase4.apache.org/43617] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-24 23:06:38,556 DEBUG [Listener at jenkins-hbase4.apache.org/43617] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-24 23:06:38,556 DEBUG [Listener at jenkins-hbase4.apache.org/43617] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-24 23:06:38,557 DEBUG [Listener at jenkins-hbase4.apache.org/43617] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-24 23:06:38,557 DEBUG [Listener at jenkins-hbase4.apache.org/43617] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-24 23:06:38,558 DEBUG [Listener at jenkins-hbase4.apache.org/43617] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-24 23:06:38,558 DEBUG [Listener at jenkins-hbase4.apache.org/43617] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-24 23:06:38,559 DEBUG [Listener at jenkins-hbase4.apache.org/43617] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-24 23:06:38,559 DEBUG [Listener at jenkins-hbase4.apache.org/43617] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-24 23:06:38,560 DEBUG [Listener at jenkins-hbase4.apache.org/43617] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-24 23:06:38,560 DEBUG [Listener at jenkins-hbase4.apache.org/43617] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-24 23:06:38,561 DEBUG [Listener at jenkins-hbase4.apache.org/43617] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-24 23:06:38,561 DEBUG [Listener at jenkins-hbase4.apache.org/43617] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-24 23:06:38,561 DEBUG [Listener at jenkins-hbase4.apache.org/43617] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-24 23:06:38,562 DEBUG [Listener at jenkins-hbase4.apache.org/43617] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-24 23:06:38,563 DEBUG [Listener at jenkins-hbase4.apache.org/43617] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-24 23:06:38,563 DEBUG [Listener at jenkins-hbase4.apache.org/43617] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 23:06:38,563 DEBUG [Listener at jenkins-hbase4.apache.org/43617] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 23:06:38,564 DEBUG [Listener at jenkins-hbase4.apache.org/43617] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 23:06:38,564 DEBUG [Listener at jenkins-hbase4.apache.org/43617] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 23:06:38,565 DEBUG [Listener at jenkins-hbase4.apache.org/43617] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 23:06:38,565 DEBUG [Listener at jenkins-hbase4.apache.org/43617] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 23:06:38,566 DEBUG [Listener at jenkins-hbase4.apache.org/43617] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 23:06:39,464 WARN [Listener at jenkins-hbase4.apache.org/43617] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-24 23:06:39,468 INFO [Listener at jenkins-hbase4.apache.org/43617] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemState' hfile list 2023-07-24 23:06:39,470 DEBUG [Listener at jenkins-hbase4.apache.org/43617] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-24 23:06:41,269 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-24 23:06:41,270 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-24 23:06:41,276 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690239977721_0001_000001 (auth:SIMPLE) 2023-07-24 23:06:41,674 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690239977721_0002_000001 (auth:SIMPLE) 2023-07-24 23:06:42,215 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-24 23:06:46,586 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690239977721_0002_000001 (auth:SIMPLE) 2023-07-24 23:06:48,808 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690239977721_0002_000001 (auth:SIMPLE) 2023-07-24 23:06:51,559 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690239977721_0002_000001 (auth:SIMPLE) 2023-07-24 23:06:52,828 INFO [Listener at jenkins-hbase4.apache.org/43617] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-24 23:06:52,829 INFO [Listener at jenkins-hbase4.apache.org/43617] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-24 23:06:52,838 INFO [Listener at jenkins-hbase4.apache.org/43617] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemState 2023-07-24 23:06:52,838 INFO [Listener at jenkins-hbase4.apache.org/43617] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-24 23:06:52,838 INFO [Listener at jenkins-hbase4.apache.org/43617] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-24 23:06:52,839 DEBUG [Listener at jenkins-hbase4.apache.org/43617] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1273988721_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-24 23:06:52,839 DEBUG [Listener at jenkins-hbase4.apache.org/43617] snapshot.TestExportSnapshot(367): hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-07-24 23:06:52,839 DEBUG [Listener at jenkins-hbase4.apache.org/43617] snapshot.TestExportSnapshot(367): hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-07-24 23:06:52,839 DEBUG [Listener at jenkins-hbase4.apache.org/43617] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1273988721_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/export-test/export-1690239998314/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/export-test/export-1690239998314/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-24 23:06:52,840 DEBUG [Listener at jenkins-hbase4.apache.org/43617] snapshot.TestExportSnapshot(367): hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/export-test/export-1690239998314/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-07-24 23:06:52,840 DEBUG [Listener at jenkins-hbase4.apache.org/43617] snapshot.TestExportSnapshot(367): hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/export-test/export-1690239998314/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-07-24 23:06:52,848 INFO [Listener at jenkins-hbase4.apache.org/43617] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemState 2023-07-24 23:06:52,849 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemState 2023-07-24 23:06:52,851 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] procedure2.ProcedureExecutor(1029): Stored pid=36, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemState 2023-07-24 23:06:52,855 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-24 23:06:52,856 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690240012856"}]},"ts":"1690240012856"} 2023-07-24 23:06:52,857 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLING in hbase:meta 2023-07-24 23:06:52,859 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemState to state=DISABLING 2023-07-24 23:06:52,860 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=b4a26e79d5e698e94df128593a1e7d27, UNASSIGN}, {pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=90a5bc53b4f91ea984fc64e704e395cb, UNASSIGN}] 2023-07-24 23:06:52,862 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=b4a26e79d5e698e94df128593a1e7d27, UNASSIGN 2023-07-24 23:06:52,862 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=90a5bc53b4f91ea984fc64e704e395cb, UNASSIGN 2023-07-24 23:06:52,863 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=b4a26e79d5e698e94df128593a1e7d27, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:06:52,863 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=90a5bc53b4f91ea984fc64e704e395cb, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39013,1690239969874 2023-07-24 23:06:52,863 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1690239996943.b4a26e79d5e698e94df128593a1e7d27.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690240012863"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690240012863"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690240012863"}]},"ts":"1690240012863"} 2023-07-24 23:06:52,863 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1690239996943.90a5bc53b4f91ea984fc64e704e395cb.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690240012863"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690240012863"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690240012863"}]},"ts":"1690240012863"} 2023-07-24 23:06:52,865 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=39, ppid=37, state=RUNNABLE; CloseRegionProcedure b4a26e79d5e698e94df128593a1e7d27, server=jenkins-hbase4.apache.org,33227,1690239969957}] 2023-07-24 23:06:52,865 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=40, ppid=38, state=RUNNABLE; CloseRegionProcedure 90a5bc53b4f91ea984fc64e704e395cb, server=jenkins-hbase4.apache.org,39013,1690239969874}] 2023-07-24 23:06:52,956 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-24 23:06:53,017 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close b4a26e79d5e698e94df128593a1e7d27 2023-07-24 23:06:53,017 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing b4a26e79d5e698e94df128593a1e7d27, disabling compactions & flushes 2023-07-24 23:06:53,017 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1690239996943.b4a26e79d5e698e94df128593a1e7d27. 2023-07-24 23:06:53,017 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1690239996943.b4a26e79d5e698e94df128593a1e7d27. 2023-07-24 23:06:53,017 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1690239996943.b4a26e79d5e698e94df128593a1e7d27. after waiting 0 ms 2023-07-24 23:06:53,017 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1690239996943.b4a26e79d5e698e94df128593a1e7d27. 2023-07-24 23:06:53,021 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 90a5bc53b4f91ea984fc64e704e395cb 2023-07-24 23:06:53,021 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 90a5bc53b4f91ea984fc64e704e395cb, disabling compactions & flushes 2023-07-24 23:06:53,022 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1690239996943.90a5bc53b4f91ea984fc64e704e395cb. 2023-07-24 23:06:53,022 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1690239996943.90a5bc53b4f91ea984fc64e704e395cb. 2023-07-24 23:06:53,022 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1690239996943.90a5bc53b4f91ea984fc64e704e395cb. after waiting 0 ms 2023-07-24 23:06:53,022 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1690239996943.90a5bc53b4f91ea984fc64e704e395cb. 2023-07-24 23:06:53,035 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/default/testtb-testExportFileSystemState/b4a26e79d5e698e94df128593a1e7d27/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-24 23:06:53,036 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/default/testtb-testExportFileSystemState/90a5bc53b4f91ea984fc64e704e395cb/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-24 23:06:53,036 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 23:06:53,037 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1690239996943.b4a26e79d5e698e94df128593a1e7d27. 2023-07-24 23:06:53,037 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 23:06:53,037 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for b4a26e79d5e698e94df128593a1e7d27: 2023-07-24 23:06:53,038 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1690239996943.90a5bc53b4f91ea984fc64e704e395cb. 2023-07-24 23:06:53,038 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 90a5bc53b4f91ea984fc64e704e395cb: 2023-07-24 23:06:53,040 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed b4a26e79d5e698e94df128593a1e7d27 2023-07-24 23:06:53,041 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=b4a26e79d5e698e94df128593a1e7d27, regionState=CLOSED 2023-07-24 23:06:53,041 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1690239996943.b4a26e79d5e698e94df128593a1e7d27.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690240013041"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690240013041"}]},"ts":"1690240013041"} 2023-07-24 23:06:53,041 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 90a5bc53b4f91ea984fc64e704e395cb 2023-07-24 23:06:53,042 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=90a5bc53b4f91ea984fc64e704e395cb, regionState=CLOSED 2023-07-24 23:06:53,042 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1690239996943.90a5bc53b4f91ea984fc64e704e395cb.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690240013042"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690240013042"}]},"ts":"1690240013042"} 2023-07-24 23:06:53,046 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=39, resume processing ppid=37 2023-07-24 23:06:53,047 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=39, ppid=37, state=SUCCESS; CloseRegionProcedure b4a26e79d5e698e94df128593a1e7d27, server=jenkins-hbase4.apache.org,33227,1690239969957 in 179 msec 2023-07-24 23:06:53,052 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=40, resume processing ppid=38 2023-07-24 23:06:53,052 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=38, state=SUCCESS; CloseRegionProcedure 90a5bc53b4f91ea984fc64e704e395cb, server=jenkins-hbase4.apache.org,39013,1690239969874 in 179 msec 2023-07-24 23:06:53,053 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=b4a26e79d5e698e94df128593a1e7d27, UNASSIGN in 187 msec 2023-07-24 23:06:53,055 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=38, resume processing ppid=36 2023-07-24 23:06:53,055 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=38, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=90a5bc53b4f91ea984fc64e704e395cb, UNASSIGN in 192 msec 2023-07-24 23:06:53,056 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690240013056"}]},"ts":"1690240013056"} 2023-07-24 23:06:53,058 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLED in hbase:meta 2023-07-24 23:06:53,060 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemState to state=DISABLED 2023-07-24 23:06:53,063 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=36, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemState in 211 msec 2023-07-24 23:06:53,157 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-24 23:06:53,157 INFO [Listener at jenkins-hbase4.apache.org/43617] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemState, procId: 36 completed 2023-07-24 23:06:53,158 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemState 2023-07-24 23:06:53,159 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] procedure2.ProcedureExecutor(1029): Stored pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-24 23:06:53,162 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-24 23:06:53,162 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemState 2023-07-24 23:06:53,162 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=41, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-24 23:06:53,164 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33227] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemState 2023-07-24 23:06:53,168 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-24 23:06:53,168 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:33227-0x1019995a36f0003, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-24 23:06:53,168 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:39013-0x1019995a36f0002, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-24 23:06:53,168 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:39595-0x1019995a36f0001, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-24 23:06:53,168 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-24 23:06:53,168 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-24 23:06:53,169 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-24 23:06:53,169 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-24 23:06:53,169 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.tmp/data/default/testtb-testExportFileSystemState/b4a26e79d5e698e94df128593a1e7d27 2023-07-24 23:06:53,169 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.tmp/data/default/testtb-testExportFileSystemState/90a5bc53b4f91ea984fc64e704e395cb 2023-07-24 23:06:53,170 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:33227-0x1019995a36f0003, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-24 23:06:53,170 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-24 23:06:53,170 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:33227-0x1019995a36f0003, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 23:06:53,170 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 23:06:53,170 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:39595-0x1019995a36f0001, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-24 23:06:53,170 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:39595-0x1019995a36f0001, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 23:06:53,170 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:39013-0x1019995a36f0002, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-24 23:06:53,171 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:39013-0x1019995a36f0002, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 23:06:53,171 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-07-24 23:06:53,172 DEBUG [HFileArchiver-9] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.tmp/data/default/testtb-testExportFileSystemState/b4a26e79d5e698e94df128593a1e7d27/cf, FileablePath, hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.tmp/data/default/testtb-testExportFileSystemState/b4a26e79d5e698e94df128593a1e7d27/recovered.edits] 2023-07-24 23:06:53,172 DEBUG [HFileArchiver-10] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.tmp/data/default/testtb-testExportFileSystemState/90a5bc53b4f91ea984fc64e704e395cb/cf, FileablePath, hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.tmp/data/default/testtb-testExportFileSystemState/90a5bc53b4f91ea984fc64e704e395cb/recovered.edits] 2023-07-24 23:06:53,176 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.tmp/data/default/testtb-testExportFileSystemState/b4a26e79d5e698e94df128593a1e7d27/cf/b2ecadc3a6824a57bc1640d20e4f066e to hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/archive/data/default/testtb-testExportFileSystemState/b4a26e79d5e698e94df128593a1e7d27/cf/b2ecadc3a6824a57bc1640d20e4f066e 2023-07-24 23:06:53,176 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.tmp/data/default/testtb-testExportFileSystemState/90a5bc53b4f91ea984fc64e704e395cb/cf/d2fa5738f5cc49ae95ad53bd8d132094 to hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/archive/data/default/testtb-testExportFileSystemState/90a5bc53b4f91ea984fc64e704e395cb/cf/d2fa5738f5cc49ae95ad53bd8d132094 2023-07-24 23:06:53,180 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.tmp/data/default/testtb-testExportFileSystemState/b4a26e79d5e698e94df128593a1e7d27/recovered.edits/9.seqid to hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/archive/data/default/testtb-testExportFileSystemState/b4a26e79d5e698e94df128593a1e7d27/recovered.edits/9.seqid 2023-07-24 23:06:53,181 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.tmp/data/default/testtb-testExportFileSystemState/90a5bc53b4f91ea984fc64e704e395cb/recovered.edits/9.seqid to hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/archive/data/default/testtb-testExportFileSystemState/90a5bc53b4f91ea984fc64e704e395cb/recovered.edits/9.seqid 2023-07-24 23:06:53,183 DEBUG [HFileArchiver-9] backup.HFileArchiver(596): Deleted hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.tmp/data/default/testtb-testExportFileSystemState/b4a26e79d5e698e94df128593a1e7d27 2023-07-24 23:06:53,183 DEBUG [HFileArchiver-10] backup.HFileArchiver(596): Deleted hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.tmp/data/default/testtb-testExportFileSystemState/90a5bc53b4f91ea984fc64e704e395cb 2023-07-24 23:06:53,183 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-07-24 23:06:53,186 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=41, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-24 23:06:53,188 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemState from hbase:meta 2023-07-24 23:06:53,190 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemState' descriptor. 2023-07-24 23:06:53,191 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=41, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-24 23:06:53,191 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemState' from region states. 2023-07-24 23:06:53,191 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,,1690239996943.b4a26e79d5e698e94df128593a1e7d27.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690240013191"}]},"ts":"9223372036854775807"} 2023-07-24 23:06:53,191 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,1,1690239996943.90a5bc53b4f91ea984fc64e704e395cb.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690240013191"}]},"ts":"9223372036854775807"} 2023-07-24 23:06:53,193 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-24 23:06:53,194 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => b4a26e79d5e698e94df128593a1e7d27, NAME => 'testtb-testExportFileSystemState,,1690239996943.b4a26e79d5e698e94df128593a1e7d27.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 90a5bc53b4f91ea984fc64e704e395cb, NAME => 'testtb-testExportFileSystemState,1,1690239996943.90a5bc53b4f91ea984fc64e704e395cb.', STARTKEY => '1', ENDKEY => ''}] 2023-07-24 23:06:53,194 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemState' as deleted. 2023-07-24 23:06:53,194 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1690240013194"}]},"ts":"9223372036854775807"} 2023-07-24 23:06:53,195 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemState state from META 2023-07-24 23:06:53,197 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=41, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-24 23:06:53,199 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=41, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemState in 39 msec 2023-07-24 23:06:53,273 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-07-24 23:06:53,273 INFO [Listener at jenkins-hbase4.apache.org/43617] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemState, procId: 41 completed 2023-07-24 23:06:53,281 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemState" 2023-07-24 23:06:53,283 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemState 2023-07-24 23:06:53,285 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemState" 2023-07-24 23:06:53,287 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemState 2023-07-24 23:06:53,312 INFO [Listener at jenkins-hbase4.apache.org/43617] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testExportFileSystemState Thread=763 (was 752) Potentially hanging thread: hconnection-0x2b6dd434-shared-pool-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x2b6dd434-shared-pool-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_725160086_1 at /127.0.0.1:37666 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x2b6dd434-shared-pool-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x2b6dd434-shared-pool-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1273988721_17 at /127.0.0.1:37660 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1950 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: ApplicationMasterLauncher #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (717546083) connection to jenkins-hbase4.apache.org/172.31.14.131:36211 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_725160086_1 at /127.0.0.1:37640 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1273988721_17 at /127.0.0.1:47106 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (717546083) connection to jenkins-hbase4.apache.org/172.31.14.131:41949 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) - Thread LEAK? -, OpenFileDescriptor=916 (was 915) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=380 (was 393), ProcessCount=180 (was 180), AvailableMemoryMB=5741 (was 5898) 2023-07-24 23:06:53,312 WARN [Listener at jenkins-hbase4.apache.org/43617] hbase.ResourceChecker(130): Thread=763 is superior to 500 2023-07-24 23:06:53,332 INFO [Listener at jenkins-hbase4.apache.org/43617] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testConsecutiveExports Thread=763, OpenFileDescriptor=916, MaxFileDescriptor=60000, SystemLoadAverage=380, ProcessCount=180, AvailableMemoryMB=5741 2023-07-24 23:06:53,332 WARN [Listener at jenkins-hbase4.apache.org/43617] hbase.ResourceChecker(130): Thread=763 is superior to 500 2023-07-24 23:06:53,334 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-24 23:06:53,336 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] procedure2.ProcedureExecutor(1029): Stored pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testConsecutiveExports 2023-07-24 23:06:53,339 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_PRE_OPERATION 2023-07-24 23:06:53,339 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testConsecutiveExports" procId is: 42 2023-07-24 23:06:53,340 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-24 23:06:53,340 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-24 23:06:53,343 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.tmp/data/default/testtb-testConsecutiveExports/4071de5bf0c3dcfd1b6532e183c7fedc 2023-07-24 23:06:53,343 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.tmp/data/default/testtb-testConsecutiveExports/15c6c16ea0ab741de57ebe82df90050d 2023-07-24 23:06:53,344 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.tmp/data/default/testtb-testConsecutiveExports/4071de5bf0c3dcfd1b6532e183c7fedc empty. 2023-07-24 23:06:53,344 DEBUG [HFileArchiver-12] backup.HFileArchiver(153): Directory hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.tmp/data/default/testtb-testConsecutiveExports/15c6c16ea0ab741de57ebe82df90050d empty. 2023-07-24 23:06:53,344 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.tmp/data/default/testtb-testConsecutiveExports/4071de5bf0c3dcfd1b6532e183c7fedc 2023-07-24 23:06:53,344 DEBUG [HFileArchiver-12] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.tmp/data/default/testtb-testConsecutiveExports/15c6c16ea0ab741de57ebe82df90050d 2023-07-24 23:06:53,345 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-07-24 23:06:53,368 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.tmp/data/default/testtb-testConsecutiveExports/.tabledesc/.tableinfo.0000000001 2023-07-24 23:06:53,370 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(7675): creating {ENCODED => 4071de5bf0c3dcfd1b6532e183c7fedc, NAME => 'testtb-testConsecutiveExports,,1690240013333.4071de5bf0c3dcfd1b6532e183c7fedc.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.tmp 2023-07-24 23:06:53,371 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(7675): creating {ENCODED => 15c6c16ea0ab741de57ebe82df90050d, NAME => 'testtb-testConsecutiveExports,1,1690240013333.15c6c16ea0ab741de57ebe82df90050d.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.tmp 2023-07-24 23:06:53,387 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1690240013333.4071de5bf0c3dcfd1b6532e183c7fedc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 23:06:53,391 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1604): Closing 4071de5bf0c3dcfd1b6532e183c7fedc, disabling compactions & flushes 2023-07-24 23:06:53,391 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1690240013333.4071de5bf0c3dcfd1b6532e183c7fedc. 2023-07-24 23:06:53,391 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1690240013333.4071de5bf0c3dcfd1b6532e183c7fedc. 2023-07-24 23:06:53,391 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1690240013333.4071de5bf0c3dcfd1b6532e183c7fedc. after waiting 0 ms 2023-07-24 23:06:53,391 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1690240013333.4071de5bf0c3dcfd1b6532e183c7fedc. 2023-07-24 23:06:53,391 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1690240013333.4071de5bf0c3dcfd1b6532e183c7fedc. 2023-07-24 23:06:53,391 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1558): Region close journal for 4071de5bf0c3dcfd1b6532e183c7fedc: 2023-07-24 23:06:53,394 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1690240013333.15c6c16ea0ab741de57ebe82df90050d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 23:06:53,395 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1604): Closing 15c6c16ea0ab741de57ebe82df90050d, disabling compactions & flushes 2023-07-24 23:06:53,395 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1690240013333.15c6c16ea0ab741de57ebe82df90050d. 2023-07-24 23:06:53,395 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1690240013333.15c6c16ea0ab741de57ebe82df90050d. 2023-07-24 23:06:53,395 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1690240013333.15c6c16ea0ab741de57ebe82df90050d. after waiting 0 ms 2023-07-24 23:06:53,395 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1690240013333.15c6c16ea0ab741de57ebe82df90050d. 2023-07-24 23:06:53,395 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1690240013333.15c6c16ea0ab741de57ebe82df90050d. 2023-07-24 23:06:53,395 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1558): Region close journal for 15c6c16ea0ab741de57ebe82df90050d: 2023-07-24 23:06:53,399 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ADD_TO_META 2023-07-24 23:06:53,400 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1690240013333.4071de5bf0c3dcfd1b6532e183c7fedc.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690240013400"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690240013400"}]},"ts":"1690240013400"} 2023-07-24 23:06:53,400 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1690240013333.15c6c16ea0ab741de57ebe82df90050d.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690240013400"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690240013400"}]},"ts":"1690240013400"} 2023-07-24 23:06:53,402 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-24 23:06:53,404 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-24 23:06:53,404 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690240013404"}]},"ts":"1690240013404"} 2023-07-24 23:06:53,405 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLING in hbase:meta 2023-07-24 23:06:53,409 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-24 23:06:53,411 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-24 23:06:53,411 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-24 23:06:53,411 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-24 23:06:53,411 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-24 23:06:53,411 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=4071de5bf0c3dcfd1b6532e183c7fedc, ASSIGN}, {pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=15c6c16ea0ab741de57ebe82df90050d, ASSIGN}] 2023-07-24 23:06:53,414 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=15c6c16ea0ab741de57ebe82df90050d, ASSIGN 2023-07-24 23:06:53,414 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=4071de5bf0c3dcfd1b6532e183c7fedc, ASSIGN 2023-07-24 23:06:53,415 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=15c6c16ea0ab741de57ebe82df90050d, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33227,1690239969957; forceNewPlan=false, retain=false 2023-07-24 23:06:53,415 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=4071de5bf0c3dcfd1b6532e183c7fedc, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39595,1690239969801; forceNewPlan=false, retain=false 2023-07-24 23:06:53,441 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-24 23:06:53,565 INFO [jenkins-hbase4:37213] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-24 23:06:53,568 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=4071de5bf0c3dcfd1b6532e183c7fedc, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39595,1690239969801 2023-07-24 23:06:53,568 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=15c6c16ea0ab741de57ebe82df90050d, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:06:53,568 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1690240013333.4071de5bf0c3dcfd1b6532e183c7fedc.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690240013568"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690240013568"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690240013568"}]},"ts":"1690240013568"} 2023-07-24 23:06:53,568 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1690240013333.15c6c16ea0ab741de57ebe82df90050d.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690240013568"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690240013568"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690240013568"}]},"ts":"1690240013568"} 2023-07-24 23:06:53,570 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=43, state=RUNNABLE; OpenRegionProcedure 4071de5bf0c3dcfd1b6532e183c7fedc, server=jenkins-hbase4.apache.org,39595,1690239969801}] 2023-07-24 23:06:53,571 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=44, state=RUNNABLE; OpenRegionProcedure 15c6c16ea0ab741de57ebe82df90050d, server=jenkins-hbase4.apache.org,33227,1690239969957}] 2023-07-24 23:06:53,643 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-24 23:06:53,723 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,39595,1690239969801 2023-07-24 23:06:53,723 DEBUG [RSProcedureDispatcher-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-24 23:06:53,728 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57674, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-24 23:06:53,729 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,1,1690240013333.15c6c16ea0ab741de57ebe82df90050d. 2023-07-24 23:06:53,730 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 15c6c16ea0ab741de57ebe82df90050d, NAME => 'testtb-testConsecutiveExports,1,1690240013333.15c6c16ea0ab741de57ebe82df90050d.', STARTKEY => '1', ENDKEY => ''} 2023-07-24 23:06:53,730 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,1,1690240013333.15c6c16ea0ab741de57ebe82df90050d. service=AccessControlService 2023-07-24 23:06:53,731 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 23:06:53,731 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports 15c6c16ea0ab741de57ebe82df90050d 2023-07-24 23:06:53,732 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1690240013333.15c6c16ea0ab741de57ebe82df90050d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 23:06:53,732 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 15c6c16ea0ab741de57ebe82df90050d 2023-07-24 23:06:53,732 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 15c6c16ea0ab741de57ebe82df90050d 2023-07-24 23:06:53,733 INFO [StoreOpener-15c6c16ea0ab741de57ebe82df90050d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 15c6c16ea0ab741de57ebe82df90050d 2023-07-24 23:06:53,734 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,,1690240013333.4071de5bf0c3dcfd1b6532e183c7fedc. 2023-07-24 23:06:53,734 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 4071de5bf0c3dcfd1b6532e183c7fedc, NAME => 'testtb-testConsecutiveExports,,1690240013333.4071de5bf0c3dcfd1b6532e183c7fedc.', STARTKEY => '', ENDKEY => '1'} 2023-07-24 23:06:53,734 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,,1690240013333.4071de5bf0c3dcfd1b6532e183c7fedc. service=AccessControlService 2023-07-24 23:06:53,734 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 23:06:53,734 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports 4071de5bf0c3dcfd1b6532e183c7fedc 2023-07-24 23:06:53,735 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1690240013333.4071de5bf0c3dcfd1b6532e183c7fedc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 23:06:53,735 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 4071de5bf0c3dcfd1b6532e183c7fedc 2023-07-24 23:06:53,735 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 4071de5bf0c3dcfd1b6532e183c7fedc 2023-07-24 23:06:53,735 DEBUG [StoreOpener-15c6c16ea0ab741de57ebe82df90050d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/default/testtb-testConsecutiveExports/15c6c16ea0ab741de57ebe82df90050d/cf 2023-07-24 23:06:53,735 DEBUG [StoreOpener-15c6c16ea0ab741de57ebe82df90050d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/default/testtb-testConsecutiveExports/15c6c16ea0ab741de57ebe82df90050d/cf 2023-07-24 23:06:53,735 INFO [StoreOpener-15c6c16ea0ab741de57ebe82df90050d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 15c6c16ea0ab741de57ebe82df90050d columnFamilyName cf 2023-07-24 23:06:53,736 INFO [StoreOpener-4071de5bf0c3dcfd1b6532e183c7fedc-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 4071de5bf0c3dcfd1b6532e183c7fedc 2023-07-24 23:06:53,736 INFO [StoreOpener-15c6c16ea0ab741de57ebe82df90050d-1] regionserver.HStore(310): Store=15c6c16ea0ab741de57ebe82df90050d/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 23:06:53,738 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/default/testtb-testConsecutiveExports/15c6c16ea0ab741de57ebe82df90050d 2023-07-24 23:06:53,738 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/default/testtb-testConsecutiveExports/15c6c16ea0ab741de57ebe82df90050d 2023-07-24 23:06:53,739 DEBUG [StoreOpener-4071de5bf0c3dcfd1b6532e183c7fedc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/default/testtb-testConsecutiveExports/4071de5bf0c3dcfd1b6532e183c7fedc/cf 2023-07-24 23:06:53,739 DEBUG [StoreOpener-4071de5bf0c3dcfd1b6532e183c7fedc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/default/testtb-testConsecutiveExports/4071de5bf0c3dcfd1b6532e183c7fedc/cf 2023-07-24 23:06:53,739 INFO [StoreOpener-4071de5bf0c3dcfd1b6532e183c7fedc-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4071de5bf0c3dcfd1b6532e183c7fedc columnFamilyName cf 2023-07-24 23:06:53,739 INFO [StoreOpener-4071de5bf0c3dcfd1b6532e183c7fedc-1] regionserver.HStore(310): Store=4071de5bf0c3dcfd1b6532e183c7fedc/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 23:06:53,740 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/default/testtb-testConsecutiveExports/4071de5bf0c3dcfd1b6532e183c7fedc 2023-07-24 23:06:53,742 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/default/testtb-testConsecutiveExports/4071de5bf0c3dcfd1b6532e183c7fedc 2023-07-24 23:06:53,742 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 15c6c16ea0ab741de57ebe82df90050d 2023-07-24 23:06:53,744 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/default/testtb-testConsecutiveExports/15c6c16ea0ab741de57ebe82df90050d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-24 23:06:53,744 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 15c6c16ea0ab741de57ebe82df90050d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66856162, jitterRate=-0.0037655532360076904}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-24 23:06:53,744 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 15c6c16ea0ab741de57ebe82df90050d: 2023-07-24 23:06:53,745 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,1,1690240013333.15c6c16ea0ab741de57ebe82df90050d., pid=46, masterSystemTime=1690240013723 2023-07-24 23:06:53,746 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 4071de5bf0c3dcfd1b6532e183c7fedc 2023-07-24 23:06:53,747 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,1,1690240013333.15c6c16ea0ab741de57ebe82df90050d. 2023-07-24 23:06:53,747 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,1,1690240013333.15c6c16ea0ab741de57ebe82df90050d. 2023-07-24 23:06:53,748 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=15c6c16ea0ab741de57ebe82df90050d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:06:53,748 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,1,1690240013333.15c6c16ea0ab741de57ebe82df90050d.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690240013748"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690240013748"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690240013748"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690240013748"}]},"ts":"1690240013748"} 2023-07-24 23:06:53,753 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=44 2023-07-24 23:06:53,753 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=44, state=SUCCESS; OpenRegionProcedure 15c6c16ea0ab741de57ebe82df90050d, server=jenkins-hbase4.apache.org,33227,1690239969957 in 179 msec 2023-07-24 23:06:53,756 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/default/testtb-testConsecutiveExports/4071de5bf0c3dcfd1b6532e183c7fedc/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-24 23:06:53,757 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=15c6c16ea0ab741de57ebe82df90050d, ASSIGN in 342 msec 2023-07-24 23:06:53,757 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 4071de5bf0c3dcfd1b6532e183c7fedc; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62533509, jitterRate=-0.06817810237407684}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-24 23:06:53,757 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 4071de5bf0c3dcfd1b6532e183c7fedc: 2023-07-24 23:06:53,758 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,,1690240013333.4071de5bf0c3dcfd1b6532e183c7fedc., pid=45, masterSystemTime=1690240013723 2023-07-24 23:06:53,762 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,,1690240013333.4071de5bf0c3dcfd1b6532e183c7fedc. 2023-07-24 23:06:53,763 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,,1690240013333.4071de5bf0c3dcfd1b6532e183c7fedc. 2023-07-24 23:06:53,763 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=4071de5bf0c3dcfd1b6532e183c7fedc, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39595,1690239969801 2023-07-24 23:06:53,763 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,,1690240013333.4071de5bf0c3dcfd1b6532e183c7fedc.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690240013763"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690240013763"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690240013763"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690240013763"}]},"ts":"1690240013763"} 2023-07-24 23:06:53,767 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=43 2023-07-24 23:06:53,767 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=43, state=SUCCESS; OpenRegionProcedure 4071de5bf0c3dcfd1b6532e183c7fedc, server=jenkins-hbase4.apache.org,39595,1690239969801 in 195 msec 2023-07-24 23:06:53,769 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=43, resume processing ppid=42 2023-07-24 23:06:53,770 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=43, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=4071de5bf0c3dcfd1b6532e183c7fedc, ASSIGN in 356 msec 2023-07-24 23:06:53,771 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-24 23:06:53,771 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690240013771"}]},"ts":"1690240013771"} 2023-07-24 23:06:53,773 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLED in hbase:meta 2023-07-24 23:06:53,775 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_POST_OPERATION 2023-07-24 23:06:53,776 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testConsecutiveExports jenkins: RWXCA 2023-07-24 23:06:53,778 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33227] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-24 23:06:53,779 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:39013-0x1019995a36f0002, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 23:06:53,779 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:39595-0x1019995a36f0001, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 23:06:53,779 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:33227-0x1019995a36f0003, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 23:06:53,780 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 23:06:53,781 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-24 23:06:53,781 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-24 23:06:53,781 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-24 23:06:53,782 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-24 23:06:53,783 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=42, state=SUCCESS; CreateTableProcedure table=testtb-testConsecutiveExports in 446 msec 2023-07-24 23:06:53,944 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-24 23:06:53,944 INFO [Listener at jenkins-hbase4.apache.org/43617] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testConsecutiveExports, procId: 42 completed 2023-07-24 23:06:53,944 DEBUG [Listener at jenkins-hbase4.apache.org/43617] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testConsecutiveExports get assigned. Timeout = 60000ms 2023-07-24 23:06:53,944 INFO [Listener at jenkins-hbase4.apache.org/43617] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-24 23:06:53,948 INFO [Listener at jenkins-hbase4.apache.org/43617] hbase.HBaseTestingUtility(3484): All regions for table testtb-testConsecutiveExports assigned to meta. Checking AM states. 2023-07-24 23:06:53,948 INFO [Listener at jenkins-hbase4.apache.org/43617] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-24 23:06:53,948 INFO [Listener at jenkins-hbase4.apache.org/43617] hbase.HBaseTestingUtility(3504): All regions for table testtb-testConsecutiveExports assigned. 2023-07-24 23:06:53,951 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-24 23:06:53,951 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690240013951 (current time:1690240013951). 2023-07-24 23:06:53,951 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-24 23:06:53,951 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] zookeeper.ReadOnlyZKClient(139): Connect 0x5688fc43 to 127.0.0.1:52881 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 23:06:53,958 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2014cfb5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 23:06:53,960 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 23:06:53,962 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41060, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 23:06:53,963 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5688fc43 to 127.0.0.1:52881 2023-07-24 23:06:53,963 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 23:06:53,964 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] zookeeper.ReadOnlyZKClient(139): Connect 0x66b1b900 to 127.0.0.1:52881 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 23:06:53,971 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@77ca2b71, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 23:06:53,972 DEBUG [hconnection-0x71a53b5a-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 23:06:53,975 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41070, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 23:06:53,979 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 23:06:53,985 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50378, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 23:06:53,986 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x66b1b900 to 127.0.0.1:52881 2023-07-24 23:06:53,986 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 23:06:53,986 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-24 23:06:53,987 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-24 23:06:53,987 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-24 23:06:53,989 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] procedure2.ProcedureExecutor(1029): Stored pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-24 23:06:53,990 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-24 23:06:53,991 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=47, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1690240613991 2023-07-24 23:06:53,991 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-07-24 23:06:53,991 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-24 23:06:53,993 DEBUG [Listener at jenkins-hbase4.apache.org/43617] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-24 23:06:53,993 DEBUG [Listener at jenkins-hbase4.apache.org/43617] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-24 23:06:53,994 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=47, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-24 23:06:53,994 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-24 23:06:53,995 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=47, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 6 msec 2023-07-24 23:06:53,996 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-24 23:06:53,997 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1690240613997 2023-07-24 23:06:54,017 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testConsecutiveExports 2023-07-24 23:06:54,017 INFO [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testConsecutiveExports' 2023-07-24 23:06:54,017 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 23:06:54,018 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' 2023-07-24 23:06:54,019 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-07-24 23:06:54,019 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-24 23:06:54,019 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-24 23:06:54,021 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:33227-0x1019995a36f0003, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 23:06:54,021 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:39013-0x1019995a36f0002, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 23:06:54,022 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 23:06:54,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 23:06:54,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-24 23:06:54,022 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:39595-0x1019995a36f0001, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 23:06:54,022 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 23:06:54,022 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39013-0x1019995a36f0002, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-24 23:06:54,022 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:06:54,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 23:06:54,023 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:06:54,023 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39595,1690239969801 2023-07-24 23:06:54,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-24 23:06:54,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-24 23:06:54,023 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-24 23:06:54,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-24 23:06:54,024 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39595,1690239969801 2023-07-24 23:06:54,024 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-24 23:06:54,024 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-24 23:06:54,024 DEBUG [member: 'jenkins-hbase4.apache.org,39013,1690239969874' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-24 23:06:54,024 DEBUG [member: 'jenkins-hbase4.apache.org,39013,1690239969874' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 23:06:54,024 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 23:06:54,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 23:06:54,025 DEBUG [member: 'jenkins-hbase4.apache.org,39013,1690239969874' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-24 23:06:54,025 DEBUG [member: 'jenkins-hbase4.apache.org,39013,1690239969874' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-24 23:06:54,025 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39595-0x1019995a36f0001, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-24 23:06:54,025 DEBUG [member: 'jenkins-hbase4.apache.org,39013,1690239969874' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39013,1690239969874' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-24 23:06:54,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-24 23:06:54,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-24 23:06:54,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-24 23:06:54,026 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-24 23:06:54,026 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33227-0x1019995a36f0003, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-24 23:06:54,027 DEBUG [member: 'jenkins-hbase4.apache.org,39013,1690239969874' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-24 23:06:54,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-24 23:06:54,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-24 23:06:54,028 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-24 23:06:54,028 DEBUG [member: 'jenkins-hbase4.apache.org,39013,1690239969874' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39013-0x1019995a36f0002, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-24 23:06:54,028 DEBUG [member: 'jenkins-hbase4.apache.org,39013,1690239969874' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 23:06:54,035 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-24 23:06:54,035 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1690239969801' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-24 23:06:54,035 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1690239969801' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 23:06:54,035 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-24 23:06:54,037 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1690239969801' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-24 23:06:54,037 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-24 23:06:54,038 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 23:06:54,038 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1690239969801' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-24 23:06:54,041 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-24 23:06:54,041 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1690239969801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39595,1690239969801' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-24 23:06:54,041 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-24 23:06:54,042 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33227,1690239969957' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-24 23:06:54,043 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:06:54,043 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-24 23:06:54,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:06:54,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 23:06:54,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 23:06:54,044 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39595,1690239969801 2023-07-24 23:06:54,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 23:06:54,044 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33227-0x1019995a36f0003, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-24 23:06:54,044 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1690239969801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-24 23:06:54,044 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 23:06:54,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 23:06:54,045 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1690239969801' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39595-0x1019995a36f0001, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-24 23:06:54,045 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1690239969801' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 23:06:54,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-24 23:06:54,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:06:54,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39013,1690239969874 2023-07-24 23:06:54,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39595,1690239969801 2023-07-24 23:06:54,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 23:06:54,051 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33227,1690239969957' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-07-24 23:06:54,051 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@19834006[Count = 1] remaining members to acquire global barrier 2023-07-24 23:06:54,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39595,1690239969801 2023-07-24 23:06:54,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 23:06:54,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 23:06:54,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 23:06:54,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 23:06:54,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-24 23:06:54,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:06:54,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39013,1690239969874 2023-07-24 23:06:54,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39595,1690239969801 2023-07-24 23:06:54,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 23:06:54,056 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39595,1690239969801' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-07-24 23:06:54,056 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@19834006[Count = 0] remaining members to acquire global barrier 2023-07-24 23:06:54,056 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-07-24 23:06:54,056 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-24 23:06:54,059 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:33227-0x1019995a36f0003, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-24 23:06:54,059 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:39013-0x1019995a36f0002, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-24 23:06:54,059 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:39595-0x1019995a36f0001, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-24 23:06:54,059 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-24 23:06:54,059 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-24 23:06:54,059 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-24 23:06:54,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-24 23:06:54,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-24 23:06:54,060 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1690239969801' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-24 23:06:54,060 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:06:54,060 DEBUG [member: 'jenkins-hbase4.apache.org,39013,1690239969874' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-24 23:06:54,060 DEBUG [member: 'jenkins-hbase4.apache.org,39013,1690239969874' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-24 23:06:54,060 DEBUG [member: 'jenkins-hbase4.apache.org,39013,1690239969874' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,39013,1690239969874' in zk 2023-07-24 23:06:54,060 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1690239969801' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 23:06:54,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-24 23:06:54,060 DEBUG [rs(jenkins-hbase4.apache.org,39595,1690239969801)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1690240013333.4071de5bf0c3dcfd1b6532e183c7fedc. 2023-07-24 23:06:54,060 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39595,1690239969801 2023-07-24 23:06:54,060 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-24 23:06:54,060 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1690239969801' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 23:06:54,060 DEBUG [rs(jenkins-hbase4.apache.org,39595,1690239969801)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1690240013333.4071de5bf0c3dcfd1b6532e183c7fedc. started... 2023-07-24 23:06:54,060 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-24 23:06:54,061 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 23:06:54,062 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 23:06:54,062 DEBUG [rs(jenkins-hbase4.apache.org,33227,1690239969957)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1690240013333.15c6c16ea0ab741de57ebe82df90050d. 2023-07-24 23:06:54,063 DEBUG [rs(jenkins-hbase4.apache.org,33227,1690239969957)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1690240013333.15c6c16ea0ab741de57ebe82df90050d. started... 2023-07-24 23:06:54,062 DEBUG [rs(jenkins-hbase4.apache.org,39595,1690239969801)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 4071de5bf0c3dcfd1b6532e183c7fedc: 2023-07-24 23:06:54,064 DEBUG [rs(jenkins-hbase4.apache.org,33227,1690239969957)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 15c6c16ea0ab741de57ebe82df90050d: 2023-07-24 23:06:54,064 DEBUG [rs(jenkins-hbase4.apache.org,39595,1690239969801)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1690240013333.4071de5bf0c3dcfd1b6532e183c7fedc.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-24 23:06:54,064 DEBUG [rs(jenkins-hbase4.apache.org,33227,1690239969957)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1690240013333.15c6c16ea0ab741de57ebe82df90050d.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-24 23:06:54,064 DEBUG [rs(jenkins-hbase4.apache.org,39595,1690239969801)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 23:06:54,065 DEBUG [rs(jenkins-hbase4.apache.org,33227,1690239969957)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 23:06:54,065 DEBUG [rs(jenkins-hbase4.apache.org,39595,1690239969801)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-24 23:06:54,065 DEBUG [rs(jenkins-hbase4.apache.org,33227,1690239969957)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-24 23:06:54,068 DEBUG [member: 'jenkins-hbase4.apache.org,39013,1690239969874' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-24 23:06:54,068 DEBUG [member: 'jenkins-hbase4.apache.org,39013,1690239969874' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 23:06:54,068 DEBUG [member: 'jenkins-hbase4.apache.org,39013,1690239969874' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-24 23:06:54,092 DEBUG [rs(jenkins-hbase4.apache.org,39595,1690239969801)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1690240013333.4071de5bf0c3dcfd1b6532e183c7fedc. completed. 2023-07-24 23:06:54,093 DEBUG [rs(jenkins-hbase4.apache.org,39595,1690239969801)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1690240013333.4071de5bf0c3dcfd1b6532e183c7fedc. 2023-07-24 23:06:54,093 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1690239969801' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 23:06:54,093 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1690239969801' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 23:06:54,093 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1690239969801' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39595,1690239969801 2023-07-24 23:06:54,093 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1690239969801' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-24 23:06:54,093 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1690239969801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,39595,1690239969801' in zk 2023-07-24 23:06:54,093 DEBUG [Listener at jenkins-hbase4.apache.org/43617] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 23:06:54,094 DEBUG [rs(jenkins-hbase4.apache.org,33227,1690239969957)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1690240013333.15c6c16ea0ab741de57ebe82df90050d. completed. 2023-07-24 23:06:54,094 DEBUG [rs(jenkins-hbase4.apache.org,33227,1690239969957)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1690240013333.15c6c16ea0ab741de57ebe82df90050d. 2023-07-24 23:06:54,094 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 23:06:54,094 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 23:06:54,094 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:06:54,094 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-24 23:06:54,094 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,33227,1690239969957' in zk 2023-07-24 23:06:54,095 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-24 23:06:54,095 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-24 23:06:54,095 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1690239969801' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-24 23:06:54,095 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1690239969801' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 23:06:54,095 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1690239969801' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-24 23:06:54,095 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39595,1690239969801 2023-07-24 23:06:54,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39595,1690239969801 2023-07-24 23:06:54,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 23:06:54,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 23:06:54,096 DEBUG [Listener at jenkins-hbase4.apache.org/43617] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-24 23:06:54,097 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-24 23:06:54,097 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 23:06:54,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 23:06:54,099 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:06:54,097 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-24 23:06:54,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 23:06:54,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-24 23:06:54,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:06:54,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39013,1690239969874 2023-07-24 23:06:54,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39595,1690239969801 2023-07-24 23:06:54,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 23:06:54,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-24 23:06:54,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:06:54,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39013,1690239969874 2023-07-24 23:06:54,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39595,1690239969801 2023-07-24 23:06:54,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,39595,1690239969801': 2023-07-24 23:06:54,105 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39595,1690239969801' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-07-24 23:06:54,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:06:54,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 23:06:54,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 23:06:54,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 23:06:54,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 23:06:54,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-24 23:06:54,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:06:54,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39013,1690239969874 2023-07-24 23:06:54,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39595,1690239969801 2023-07-24 23:06:54,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 23:06:54,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-24 23:06:54,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:06:54,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39013,1690239969874 2023-07-24 23:06:54,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39595,1690239969801 2023-07-24 23:06:54,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,33227,1690239969957': 2023-07-24 23:06:54,116 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33227,1690239969957' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-07-24 23:06:54,116 INFO [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testConsecutiveExports' execution completed 2023-07-24 23:06:54,116 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-24 23:06:54,116 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-24 23:06:54,116 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testConsecutiveExports 2023-07-24 23:06:54,116 INFO [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-24 23:06:54,118 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:39013-0x1019995a36f0002, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-24 23:06:54,118 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-24 23:06:54,118 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-24 23:06:54,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-24 23:06:54,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 23:06:54,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 23:06:54,118 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:33227-0x1019995a36f0003, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-24 23:06:54,118 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:39595-0x1019995a36f0001, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-24 23:06:54,118 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-24 23:06:54,119 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-24 23:06:54,118 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:39595-0x1019995a36f0001, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 23:06:54,118 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:33227-0x1019995a36f0003, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 23:06:54,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-24 23:06:54,118 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:39013-0x1019995a36f0002, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 23:06:54,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-24 23:06:54,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-24 23:06:54,119 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:06:54,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 23:06:54,119 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 23:06:54,119 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 23:06:54,120 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 23:06:54,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 23:06:54,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 23:06:54,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 23:06:54,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-24 23:06:54,120 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39013,1690239969874 2023-07-24 23:06:54,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-24 23:06:54,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-24 23:06:54,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-24 23:06:54,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 23:06:54,121 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39595,1690239969801 2023-07-24 23:06:54,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-24 23:06:54,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:06:54,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39013,1690239969874 2023-07-24 23:06:54,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39595,1690239969801 2023-07-24 23:06:54,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 23:06:54,124 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:06:54,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-24 23:06:54,124 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39013,1690239969874 2023-07-24 23:06:54,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:06:54,125 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39595,1690239969801 2023-07-24 23:06:54,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39013,1690239969874 2023-07-24 23:06:54,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39595,1690239969801 2023-07-24 23:06:54,128 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:39013-0x1019995a36f0002, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 23:06:54,128 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 23:06:54,128 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 23:06:54,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 23:06:54,128 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39595,1690239969801 2023-07-24 23:06:54,129 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:33227-0x1019995a36f0003, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 23:06:54,129 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:33227-0x1019995a36f0003, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 23:06:54,129 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 23:06:54,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 23:06:54,129 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:39595-0x1019995a36f0001, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 23:06:54,128 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testConsecutiveExports 2023-07-24 23:06:54,129 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 23:06:54,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 23:06:54,128 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:39013-0x1019995a36f0002, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 23:06:54,131 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 23:06:54,131 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 23:06:54,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 23:06:54,131 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testConsecutiveExports 2023-07-24 23:06:54,129 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:39595-0x1019995a36f0001, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 23:06:54,129 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-24 23:06:54,131 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 23:06:54,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 23:06:54,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 23:06:54,131 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39013,1690239969874 2023-07-24 23:06:54,132 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:06:54,132 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-24 23:06:54,132 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39595,1690239969801 2023-07-24 23:06:54,132 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-24 23:06:54,132 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39013,1690239969874 2023-07-24 23:06:54,132 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:06:54,132 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-24 23:06:54,132 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-24 23:06:54,132 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-24 23:06:54,157 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports to hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.hbase-snapshot/emptySnaptb0-testConsecutiveExports 2023-07-24 23:06:54,186 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-07-24 23:06:54,186 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-24 23:06:54,187 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-24 23:06:54,187 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1690240013991Consolidate snapshot: emptySnaptb0-testConsecutiveExports at 1690240014129 (+138 ms)Loading Region manifests for emptySnaptb0-testConsecutiveExports at 1690240014131 (+2 ms)Writing data manifest for emptySnaptb0-testConsecutiveExports at 1690240014138 (+7 ms)Verifying snapshot: emptySnaptb0-testConsecutiveExports at 1690240014150 (+12 ms)Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1690240014186 (+36 ms) 2023-07-24 23:06:54,192 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-24 23:06:54,194 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 200 msec 2023-07-24 23:06:54,296 DEBUG [Listener at jenkins-hbase4.apache.org/43617] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 23:06:54,299 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-24 23:06:54,299 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-24 23:06:54,307 DEBUG [htable-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 23:06:54,313 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33227] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,1,1690240013333.15c6c16ea0ab741de57ebe82df90050d. with WAL disabled. Data may be lost in the event of a crash. 2023-07-24 23:06:54,313 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57678, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 23:06:54,314 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39595] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,,1690240013333.4071de5bf0c3dcfd1b6532e183c7fedc. with WAL disabled. Data may be lost in the event of a crash. 2023-07-24 23:06:54,317 DEBUG [Listener at jenkins-hbase4.apache.org/43617] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-07-24 23:06:54,318 DEBUG [Listener at jenkins-hbase4.apache.org/43617] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1690240013333.4071de5bf0c3dcfd1b6532e183c7fedc. 2023-07-24 23:06:54,319 INFO [Listener at jenkins-hbase4.apache.org/43617] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-24 23:06:54,334 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-24 23:06:54,334 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690240014334 (current time:1690240014334). 2023-07-24 23:06:54,334 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-24 23:06:54,335 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] zookeeper.ReadOnlyZKClient(139): Connect 0x28aa3f60 to 127.0.0.1:52881 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 23:06:54,347 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5d5afda3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 23:06:54,349 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 23:06:54,350 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-07-24 23:06:54,351 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41074, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 23:06:54,352 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x28aa3f60 to 127.0.0.1:52881 2023-07-24 23:06:54,352 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 23:06:54,353 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] zookeeper.ReadOnlyZKClient(139): Connect 0x39443977 to 127.0.0.1:52881 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 23:06:54,361 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@406c5000, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 23:06:54,364 DEBUG [hconnection-0x4ad10a4b-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 23:06:54,367 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41086, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 23:06:54,372 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 23:06:54,373 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50394, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 23:06:54,374 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x39443977 to 127.0.0.1:52881 2023-07-24 23:06:54,374 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 23:06:54,375 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-24 23:06:54,376 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-24 23:06:54,376 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-24 23:06:54,383 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] procedure2.ProcedureExecutor(1029): Stored pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-24 23:06:54,385 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-24 23:06:54,385 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=49, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1690240614385 2023-07-24 23:06:54,386 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-07-24 23:06:54,386 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-24 23:06:54,387 DEBUG [Listener at jenkins-hbase4.apache.org/43617] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-24 23:06:54,387 DEBUG [Listener at jenkins-hbase4.apache.org/43617] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-24 23:06:54,390 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-24 23:06:54,392 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=49, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-24 23:06:54,393 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=49, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 10 msec 2023-07-24 23:06:54,394 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-24 23:06:54,395 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=50, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1690240614395 2023-07-24 23:06:54,414 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testConsecutiveExports 2023-07-24 23:06:54,415 INFO [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testConsecutiveExports' 2023-07-24 23:06:54,415 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 23:06:54,416 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testConsecutiveExports' starting 'acquire' 2023-07-24 23:06:54,416 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-07-24 23:06:54,417 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-24 23:06:54,417 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-24 23:06:54,418 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:33227-0x1019995a36f0003, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 23:06:54,418 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:39595-0x1019995a36f0001, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 23:06:54,418 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 23:06:54,419 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 23:06:54,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 23:06:54,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 23:06:54,418 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:06:54,418 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:39013-0x1019995a36f0002, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 23:06:54,419 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 23:06:54,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 23:06:54,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-24 23:06:54,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-24 23:06:54,419 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:06:54,419 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39595,1690239969801 2023-07-24 23:06:54,420 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33227-0x1019995a36f0003, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-24 23:06:54,420 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39595-0x1019995a36f0001, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-24 23:06:54,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-24 23:06:54,420 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39595,1690239969801 2023-07-24 23:06:54,420 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-24 23:06:54,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-24 23:06:54,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-24 23:06:54,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-24 23:06:54,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-24 23:06:54,420 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-24 23:06:54,420 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-24 23:06:54,420 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39013-0x1019995a36f0002, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-24 23:06:54,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-24 23:06:54,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-24 23:06:54,421 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-24 23:06:54,422 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-24 23:06:54,423 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1690239969801' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-24 23:06:54,423 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1690239969801' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 23:06:54,426 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1690239969801' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-24 23:06:54,426 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1690239969801' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-24 23:06:54,426 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1690239969801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39595,1690239969801' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-24 23:06:54,426 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-24 23:06:54,427 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-24 23:06:54,427 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 23:06:54,427 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-24 23:06:54,428 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-24 23:06:54,428 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-24 23:06:54,428 DEBUG [member: 'jenkins-hbase4.apache.org,39013,1690239969874' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-24 23:06:54,428 DEBUG [member: 'jenkins-hbase4.apache.org,39013,1690239969874' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 23:06:54,428 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33227,1690239969957' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-24 23:06:54,429 DEBUG [member: 'jenkins-hbase4.apache.org,39013,1690239969874' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-24 23:06:54,429 DEBUG [member: 'jenkins-hbase4.apache.org,39013,1690239969874' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-24 23:06:54,429 DEBUG [member: 'jenkins-hbase4.apache.org,39013,1690239969874' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39013,1690239969874' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-24 23:06:54,430 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39595,1690239969801 2023-07-24 23:06:54,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39595,1690239969801 2023-07-24 23:06:54,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 23:06:54,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 23:06:54,430 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1690239969801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-24 23:06:54,431 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:06:54,431 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1690239969801' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39595-0x1019995a36f0001, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-24 23:06:54,431 DEBUG [member: 'jenkins-hbase4.apache.org,39013,1690239969874' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-24 23:06:54,431 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-24 23:06:54,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 23:06:54,431 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1690239969801' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 23:06:54,432 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33227-0x1019995a36f0003, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-24 23:06:54,432 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 23:06:54,432 DEBUG [member: 'jenkins-hbase4.apache.org,39013,1690239969874' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39013-0x1019995a36f0002, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-24 23:06:54,432 DEBUG [member: 'jenkins-hbase4.apache.org,39013,1690239969874' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 23:06:54,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 23:06:54,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-24 23:06:54,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:06:54,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39013,1690239969874 2023-07-24 23:06:54,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39595,1690239969801 2023-07-24 23:06:54,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 23:06:54,434 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39595,1690239969801' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-07-24 23:06:54,434 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2cecbee5[Count = 1] remaining members to acquire global barrier 2023-07-24 23:06:54,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:06:54,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 23:06:54,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 23:06:54,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 23:06:54,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 23:06:54,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-24 23:06:54,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:06:54,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39013,1690239969874 2023-07-24 23:06:54,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39595,1690239969801 2023-07-24 23:06:54,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 23:06:54,437 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33227,1690239969957' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-07-24 23:06:54,437 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2cecbee5[Count = 0] remaining members to acquire global barrier 2023-07-24 23:06:54,437 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-07-24 23:06:54,437 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-24 23:06:54,438 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:33227-0x1019995a36f0003, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-24 23:06:54,438 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:39013-0x1019995a36f0002, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-24 23:06:54,438 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:39595-0x1019995a36f0001, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-24 23:06:54,438 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-24 23:06:54,438 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-24 23:06:54,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-24 23:06:54,438 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-24 23:06:54,438 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39595,1690239969801 2023-07-24 23:06:54,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-24 23:06:54,438 DEBUG [member: 'jenkins-hbase4.apache.org,39013,1690239969874' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-24 23:06:54,439 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-24 23:06:54,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-24 23:06:54,439 DEBUG [member: 'jenkins-hbase4.apache.org,39013,1690239969874' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-24 23:06:54,439 DEBUG [member: 'jenkins-hbase4.apache.org,39013,1690239969874' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,39013,1690239969874' in zk 2023-07-24 23:06:54,439 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1690239969801' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-24 23:06:54,439 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:06:54,439 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-24 23:06:54,439 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 23:06:54,439 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 23:06:54,439 DEBUG [rs(jenkins-hbase4.apache.org,33227,1690239969957)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1690240013333.15c6c16ea0ab741de57ebe82df90050d. 2023-07-24 23:06:54,439 DEBUG [rs(jenkins-hbase4.apache.org,33227,1690239969957)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1690240013333.15c6c16ea0ab741de57ebe82df90050d. started... 2023-07-24 23:06:54,439 INFO [rs(jenkins-hbase4.apache.org,33227,1690239969957)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 15c6c16ea0ab741de57ebe82df90050d 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-07-24 23:06:54,440 DEBUG [member: 'jenkins-hbase4.apache.org,39013,1690239969874' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-24 23:06:54,441 DEBUG [member: 'jenkins-hbase4.apache.org,39013,1690239969874' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 23:06:54,441 DEBUG [member: 'jenkins-hbase4.apache.org,39013,1690239969874' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-24 23:06:54,444 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1690239969801' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 23:06:54,444 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1690239969801' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 23:06:54,444 DEBUG [rs(jenkins-hbase4.apache.org,39595,1690239969801)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1690240013333.4071de5bf0c3dcfd1b6532e183c7fedc. 2023-07-24 23:06:54,444 DEBUG [rs(jenkins-hbase4.apache.org,39595,1690239969801)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1690240013333.4071de5bf0c3dcfd1b6532e183c7fedc. started... 2023-07-24 23:06:54,444 INFO [rs(jenkins-hbase4.apache.org,39595,1690239969801)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 4071de5bf0c3dcfd1b6532e183c7fedc 1/1 column families, dataSize=266 B heapSize=832 B 2023-07-24 23:06:54,489 DEBUG [Listener at jenkins-hbase4.apache.org/43617] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 23:06:54,491 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-24 23:06:54,491 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-24 23:06:54,492 DEBUG [Listener at jenkins-hbase4.apache.org/43617] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-24 23:06:54,493 INFO [rs(jenkins-hbase4.apache.org,33227,1690239969957)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.00 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/default/testtb-testConsecutiveExports/15c6c16ea0ab741de57ebe82df90050d/.tmp/cf/d2073753380b4a218f3153474b159e84 2023-07-24 23:06:54,493 INFO [rs(jenkins-hbase4.apache.org,39595,1690239969801)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=266 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/default/testtb-testConsecutiveExports/4071de5bf0c3dcfd1b6532e183c7fedc/.tmp/cf/8c21ed3514c0411b81d62d6d5bf85619 2023-07-24 23:06:54,503 DEBUG [rs(jenkins-hbase4.apache.org,33227,1690239969957)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/default/testtb-testConsecutiveExports/15c6c16ea0ab741de57ebe82df90050d/.tmp/cf/d2073753380b4a218f3153474b159e84 as hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/default/testtb-testConsecutiveExports/15c6c16ea0ab741de57ebe82df90050d/cf/d2073753380b4a218f3153474b159e84 2023-07-24 23:06:54,504 DEBUG [rs(jenkins-hbase4.apache.org,39595,1690239969801)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/default/testtb-testConsecutiveExports/4071de5bf0c3dcfd1b6532e183c7fedc/.tmp/cf/8c21ed3514c0411b81d62d6d5bf85619 as hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/default/testtb-testConsecutiveExports/4071de5bf0c3dcfd1b6532e183c7fedc/cf/8c21ed3514c0411b81d62d6d5bf85619 2023-07-24 23:06:54,511 INFO [rs(jenkins-hbase4.apache.org,33227,1690239969957)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/default/testtb-testConsecutiveExports/15c6c16ea0ab741de57ebe82df90050d/cf/d2073753380b4a218f3153474b159e84, entries=46, sequenceid=6, filesize=7.9 K 2023-07-24 23:06:54,513 INFO [rs(jenkins-hbase4.apache.org,39595,1690239969801)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/default/testtb-testConsecutiveExports/4071de5bf0c3dcfd1b6532e183c7fedc/cf/8c21ed3514c0411b81d62d6d5bf85619, entries=4, sequenceid=6, filesize=5.1 K 2023-07-24 23:06:54,515 INFO [rs(jenkins-hbase4.apache.org,33227,1690239969957)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for 15c6c16ea0ab741de57ebe82df90050d in 76ms, sequenceid=6, compaction requested=false 2023-07-24 23:06:54,516 INFO [rs(jenkins-hbase4.apache.org,39595,1690239969801)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for 4071de5bf0c3dcfd1b6532e183c7fedc in 72ms, sequenceid=6, compaction requested=false 2023-07-24 23:06:54,518 DEBUG [rs(jenkins-hbase4.apache.org,33227,1690239969957)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 15c6c16ea0ab741de57ebe82df90050d: 2023-07-24 23:06:54,518 DEBUG [rs(jenkins-hbase4.apache.org,39595,1690239969801)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 4071de5bf0c3dcfd1b6532e183c7fedc: 2023-07-24 23:06:54,518 DEBUG [rs(jenkins-hbase4.apache.org,33227,1690239969957)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1690240013333.15c6c16ea0ab741de57ebe82df90050d.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-24 23:06:54,518 DEBUG [rs(jenkins-hbase4.apache.org,33227,1690239969957)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 23:06:54,518 DEBUG [rs(jenkins-hbase4.apache.org,39595,1690239969801)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1690240013333.4071de5bf0c3dcfd1b6532e183c7fedc.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-24 23:06:54,518 DEBUG [rs(jenkins-hbase4.apache.org,33227,1690239969957)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/default/testtb-testConsecutiveExports/15c6c16ea0ab741de57ebe82df90050d/cf/d2073753380b4a218f3153474b159e84] hfiles 2023-07-24 23:06:54,518 DEBUG [rs(jenkins-hbase4.apache.org,39595,1690239969801)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 23:06:54,518 DEBUG [rs(jenkins-hbase4.apache.org,33227,1690239969957)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/default/testtb-testConsecutiveExports/15c6c16ea0ab741de57ebe82df90050d/cf/d2073753380b4a218f3153474b159e84 for snapshot=snaptb0-testConsecutiveExports 2023-07-24 23:06:54,518 DEBUG [rs(jenkins-hbase4.apache.org,39595,1690239969801)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/default/testtb-testConsecutiveExports/4071de5bf0c3dcfd1b6532e183c7fedc/cf/8c21ed3514c0411b81d62d6d5bf85619] hfiles 2023-07-24 23:06:54,518 DEBUG [rs(jenkins-hbase4.apache.org,39595,1690239969801)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/default/testtb-testConsecutiveExports/4071de5bf0c3dcfd1b6532e183c7fedc/cf/8c21ed3514c0411b81d62d6d5bf85619 for snapshot=snaptb0-testConsecutiveExports 2023-07-24 23:06:54,543 DEBUG [rs(jenkins-hbase4.apache.org,33227,1690239969957)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1690240013333.15c6c16ea0ab741de57ebe82df90050d. completed. 2023-07-24 23:06:54,543 DEBUG [rs(jenkins-hbase4.apache.org,33227,1690239969957)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1690240013333.15c6c16ea0ab741de57ebe82df90050d. 2023-07-24 23:06:54,543 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 23:06:54,543 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 23:06:54,543 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:06:54,543 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-24 23:06:54,543 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,33227,1690239969957' in zk 2023-07-24 23:06:54,547 DEBUG [rs(jenkins-hbase4.apache.org,39595,1690239969801)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1690240013333.4071de5bf0c3dcfd1b6532e183c7fedc. completed. 2023-07-24 23:06:54,547 DEBUG [rs(jenkins-hbase4.apache.org,39595,1690239969801)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1690240013333.4071de5bf0c3dcfd1b6532e183c7fedc. 2023-07-24 23:06:54,547 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1690239969801' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 23:06:54,547 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1690239969801' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 23:06:54,547 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1690239969801' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39595,1690239969801 2023-07-24 23:06:54,548 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1690239969801' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-24 23:06:54,548 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1690239969801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,39595,1690239969801' in zk 2023-07-24 23:06:54,550 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1690239969801' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-24 23:06:54,550 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39595,1690239969801 2023-07-24 23:06:54,550 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1690239969801' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 23:06:54,550 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1690239969801' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-24 23:06:54,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39595,1690239969801 2023-07-24 23:06:54,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 23:06:54,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 23:06:54,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 23:06:54,553 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:06:54,553 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-24 23:06:54,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 23:06:54,554 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 23:06:54,554 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-24 23:06:54,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-24 23:06:54,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:06:54,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39013,1690239969874 2023-07-24 23:06:54,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39595,1690239969801 2023-07-24 23:06:54,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 23:06:54,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-24 23:06:54,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:06:54,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39013,1690239969874 2023-07-24 23:06:54,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39595,1690239969801 2023-07-24 23:06:54,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,39595,1690239969801': 2023-07-24 23:06:54,558 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39595,1690239969801' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-07-24 23:06:54,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:06:54,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 23:06:54,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 23:06:54,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 23:06:54,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 23:06:54,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-24 23:06:54,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:06:54,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39013,1690239969874 2023-07-24 23:06:54,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39595,1690239969801 2023-07-24 23:06:54,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 23:06:54,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-24 23:06:54,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:06:54,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39013,1690239969874 2023-07-24 23:06:54,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39595,1690239969801 2023-07-24 23:06:54,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,33227,1690239969957': 2023-07-24 23:06:54,562 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33227,1690239969957' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-07-24 23:06:54,562 INFO [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testConsecutiveExports' execution completed 2023-07-24 23:06:54,562 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-24 23:06:54,562 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-24 23:06:54,562 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testConsecutiveExports 2023-07-24 23:06:54,562 INFO [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-24 23:06:54,564 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-24 23:06:54,564 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:39013-0x1019995a36f0002, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-24 23:06:54,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-24 23:06:54,564 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-24 23:06:54,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 23:06:54,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 23:06:54,564 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:39595-0x1019995a36f0001, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-24 23:06:54,565 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:39595-0x1019995a36f0001, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 23:06:54,564 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:39013-0x1019995a36f0002, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 23:06:54,565 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-24 23:06:54,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-24 23:06:54,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-24 23:06:54,566 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:33227-0x1019995a36f0003, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-24 23:06:54,566 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:33227-0x1019995a36f0003, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 23:06:54,566 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-24 23:06:54,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-24 23:06:54,566 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 23:06:54,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 23:06:54,567 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 23:06:54,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 23:06:54,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 23:06:54,567 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 23:06:54,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 23:06:54,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-24 23:06:54,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-24 23:06:54,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-24 23:06:54,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-24 23:06:54,568 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:06:54,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 23:06:54,569 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39013,1690239969874 2023-07-24 23:06:54,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-24 23:06:54,569 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39595,1690239969801 2023-07-24 23:06:54,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:06:54,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39013,1690239969874 2023-07-24 23:06:54,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39595,1690239969801 2023-07-24 23:06:54,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 23:06:54,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-24 23:06:54,573 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:06:54,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:06:54,573 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39013,1690239969874 2023-07-24 23:06:54,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39013,1690239969874 2023-07-24 23:06:54,574 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39595,1690239969801 2023-07-24 23:06:54,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39595,1690239969801 2023-07-24 23:06:54,583 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39595,1690239969801 2023-07-24 23:06:54,583 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:39595-0x1019995a36f0001, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 23:06:54,583 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:33227-0x1019995a36f0003, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 23:06:54,583 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 23:06:54,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 23:06:54,583 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:39013-0x1019995a36f0002, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 23:06:54,583 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 23:06:54,583 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 23:06:54,583 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testConsecutiveExports 2023-07-24 23:06:54,583 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:33227-0x1019995a36f0003, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 23:06:54,583 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testConsecutiveExports 2023-07-24 23:06:54,583 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:39595-0x1019995a36f0001, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 23:06:54,583 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-24 23:06:54,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 23:06:54,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 23:06:54,583 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:39013-0x1019995a36f0002, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 23:06:54,583 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 23:06:54,584 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39013,1690239969874 2023-07-24 23:06:54,585 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:06:54,585 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-24 23:06:54,586 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39595,1690239969801 2023-07-24 23:06:54,586 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-24 23:06:54,586 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39013,1690239969874 2023-07-24 23:06:54,586 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:06:54,586 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-24 23:06:54,586 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-24 23:06:54,586 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 23:06:54,586 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 23:06:54,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 23:06:54,586 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 23:06:54,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 23:06:54,586 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-24 23:06:54,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 23:06:54,621 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports to hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-24 23:06:54,650 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-07-24 23:06:54,650 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-24 23:06:54,650 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-24 23:06:54,650 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1690240014386Consolidate snapshot: snaptb0-testConsecutiveExports at 1690240014583 (+197 ms)Loading Region manifests for snaptb0-testConsecutiveExports at 1690240014584 (+1 ms)Writing data manifest for snaptb0-testConsecutiveExports at 1690240014590 (+6 ms)Verifying snapshot: snaptb0-testConsecutiveExports at 1690240014612 (+22 ms)Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1690240014650 (+38 ms) 2023-07-24 23:06:54,653 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=50, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-24 23:06:54,655 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=50, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 266 msec 2023-07-24 23:06:54,692 DEBUG [Listener at jenkins-hbase4.apache.org/43617] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 23:06:54,694 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-24 23:06:54,695 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-24 23:06:54,695 INFO [Listener at jenkins-hbase4.apache.org/43617] snapshot.TestExportSnapshot(389): Local export destination path: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/40a10de8-ef1a-d60f-e3da-b5fca02ca095/local-export-1690240014695 2023-07-24 23:06:54,695 INFO [Listener at jenkins-hbase4.apache.org/43617] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/40a10de8-ef1a-d60f-e3da-b5fca02ca095/local-export-1690240014695, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/40a10de8-ef1a-d60f-e3da-b5fca02ca095/local-export-1690240014695, srcFsUri=hdfs://localhost:37611, srcDir=hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb 2023-07-24 23:06:54,718 DEBUG [Listener at jenkins-hbase4.apache.org/43617] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:37611, inputRoot=hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb 2023-07-24 23:06:54,718 DEBUG [Listener at jenkins-hbase4.apache.org/43617] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@7fb619ac, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/40a10de8-ef1a-d60f-e3da-b5fca02ca095/local-export-1690240014695, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/40a10de8-ef1a-d60f-e3da-b5fca02ca095/local-export-1690240014695/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-24 23:06:54,718 INFO [Listener at jenkins-hbase4.apache.org/43617] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:37611, inputRoot=hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb, snapshotDir=hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-07-24 23:06:54,726 INFO [Listener at jenkins-hbase4.apache.org/43617] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/40a10de8-ef1a-d60f-e3da-b5fca02ca095/local-export-1690240014695/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-24 23:06:54,758 DEBUG [Listener at jenkins-hbase4.apache.org/43617] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-24 23:06:54,759 DEBUG [Listener at jenkins-hbase4.apache.org/43617] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-24 23:06:54,759 DEBUG [Listener at jenkins-hbase4.apache.org/43617] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-24 23:06:54,759 DEBUG [Listener at jenkins-hbase4.apache.org/43617] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-24 23:06:54,760 DEBUG [Listener at jenkins-hbase4.apache.org/43617] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-24 23:06:54,760 DEBUG [Listener at jenkins-hbase4.apache.org/43617] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-24 23:06:54,760 DEBUG [Listener at jenkins-hbase4.apache.org/43617] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-24 23:06:54,830 DEBUG [Listener at jenkins-hbase4.apache.org/43617] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/40a10de8-ef1a-d60f-e3da-b5fca02ca095/hadoop-12188699445608639.jar 2023-07-24 23:06:54,830 DEBUG [Listener at jenkins-hbase4.apache.org/43617] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-24 23:06:54,831 DEBUG [Listener at jenkins-hbase4.apache.org/43617] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-24 23:06:54,831 DEBUG [Listener at jenkins-hbase4.apache.org/43617] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-24 23:06:54,831 DEBUG [Listener at jenkins-hbase4.apache.org/43617] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-24 23:06:54,832 DEBUG [Listener at jenkins-hbase4.apache.org/43617] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-24 23:06:54,832 DEBUG [Listener at jenkins-hbase4.apache.org/43617] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-24 23:06:54,832 DEBUG [Listener at jenkins-hbase4.apache.org/43617] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-24 23:06:54,833 DEBUG [Listener at jenkins-hbase4.apache.org/43617] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-24 23:06:54,833 DEBUG [Listener at jenkins-hbase4.apache.org/43617] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-24 23:06:54,833 DEBUG [Listener at jenkins-hbase4.apache.org/43617] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-24 23:06:54,834 DEBUG [Listener at jenkins-hbase4.apache.org/43617] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-24 23:06:54,834 DEBUG [Listener at jenkins-hbase4.apache.org/43617] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-24 23:06:54,835 DEBUG [Listener at jenkins-hbase4.apache.org/43617] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-24 23:06:54,835 DEBUG [Listener at jenkins-hbase4.apache.org/43617] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-24 23:06:54,835 DEBUG [Listener at jenkins-hbase4.apache.org/43617] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-24 23:06:54,836 DEBUG [Listener at jenkins-hbase4.apache.org/43617] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-24 23:06:54,836 DEBUG [Listener at jenkins-hbase4.apache.org/43617] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 23:06:54,836 DEBUG [Listener at jenkins-hbase4.apache.org/43617] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 23:06:54,837 DEBUG [Listener at jenkins-hbase4.apache.org/43617] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 23:06:54,837 DEBUG [Listener at jenkins-hbase4.apache.org/43617] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 23:06:54,837 DEBUG [Listener at jenkins-hbase4.apache.org/43617] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 23:06:54,838 DEBUG [Listener at jenkins-hbase4.apache.org/43617] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 23:06:54,838 DEBUG [Listener at jenkins-hbase4.apache.org/43617] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 23:06:55,299 WARN [Listener at jenkins-hbase4.apache.org/43617] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-24 23:06:55,302 INFO [Listener at jenkins-hbase4.apache.org/43617] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-07-24 23:06:55,305 DEBUG [Listener at jenkins-hbase4.apache.org/43617] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-24 23:06:57,734 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-24 23:06:57,735 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-24 23:06:57,738 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690239977721_0002_000001 (auth:SIMPLE) 2023-07-24 23:06:58,282 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690239977721_0003_000001 (auth:SIMPLE) 2023-07-24 23:06:58,616 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-24 23:07:02,528 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690239977721_0003_000001 (auth:SIMPLE) 2023-07-24 23:07:04,771 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690239977721_0003_000001 (auth:SIMPLE) 2023-07-24 23:07:07,953 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690239977721_0003_000001 (auth:SIMPLE) 2023-07-24 23:07:09,515 INFO [Listener at jenkins-hbase4.apache.org/43617] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-24 23:07:09,515 INFO [Listener at jenkins-hbase4.apache.org/43617] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-24 23:07:09,519 INFO [Listener at jenkins-hbase4.apache.org/43617] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-07-24 23:07:09,519 INFO [Listener at jenkins-hbase4.apache.org/43617] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-24 23:07:09,520 INFO [Listener at jenkins-hbase4.apache.org/43617] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-24 23:07:09,520 DEBUG [Listener at jenkins-hbase4.apache.org/43617] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1273988721_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-24 23:07:09,521 DEBUG [Listener at jenkins-hbase4.apache.org/43617] snapshot.TestExportSnapshot(367): hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-24 23:07:09,521 DEBUG [Listener at jenkins-hbase4.apache.org/43617] snapshot.TestExportSnapshot(367): hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-24 23:07:09,521 DEBUG [Listener at jenkins-hbase4.apache.org/43617] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@216d0181 in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/40a10de8-ef1a-d60f-e3da-b5fca02ca095/local-export-1690240014695/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/40a10de8-ef1a-d60f-e3da-b5fca02ca095/local-export-1690240014695/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-24 23:07:09,521 DEBUG [Listener at jenkins-hbase4.apache.org/43617] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/40a10de8-ef1a-d60f-e3da-b5fca02ca095/local-export-1690240014695/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-24 23:07:09,521 DEBUG [Listener at jenkins-hbase4.apache.org/43617] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/40a10de8-ef1a-d60f-e3da-b5fca02ca095/local-export-1690240014695/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-24 23:07:09,522 INFO [Listener at jenkins-hbase4.apache.org/43617] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/40a10de8-ef1a-d60f-e3da-b5fca02ca095/local-export-1690240014695, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/40a10de8-ef1a-d60f-e3da-b5fca02ca095/local-export-1690240014695, srcFsUri=hdfs://localhost:37611, srcDir=hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb 2023-07-24 23:07:09,544 DEBUG [Listener at jenkins-hbase4.apache.org/43617] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:37611, inputRoot=hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb 2023-07-24 23:07:09,544 DEBUG [Listener at jenkins-hbase4.apache.org/43617] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@70b8a38d, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/40a10de8-ef1a-d60f-e3da-b5fca02ca095/local-export-1690240014695, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/40a10de8-ef1a-d60f-e3da-b5fca02ca095/local-export-1690240014695/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-24 23:07:09,544 INFO [Listener at jenkins-hbase4.apache.org/43617] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:37611, inputRoot=hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb, snapshotDir=hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-07-24 23:07:09,554 INFO [Listener at jenkins-hbase4.apache.org/43617] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/40a10de8-ef1a-d60f-e3da-b5fca02ca095/local-export-1690240014695/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-24 23:07:09,566 DEBUG [Listener at jenkins-hbase4.apache.org/43617] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-24 23:07:09,566 DEBUG [Listener at jenkins-hbase4.apache.org/43617] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-24 23:07:09,567 DEBUG [Listener at jenkins-hbase4.apache.org/43617] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-24 23:07:09,567 DEBUG [Listener at jenkins-hbase4.apache.org/43617] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-24 23:07:09,567 DEBUG [Listener at jenkins-hbase4.apache.org/43617] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-24 23:07:09,568 DEBUG [Listener at jenkins-hbase4.apache.org/43617] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-24 23:07:09,568 DEBUG [Listener at jenkins-hbase4.apache.org/43617] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-24 23:07:09,635 DEBUG [Listener at jenkins-hbase4.apache.org/43617] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/40a10de8-ef1a-d60f-e3da-b5fca02ca095/hadoop-6528352808738013531.jar 2023-07-24 23:07:09,635 DEBUG [Listener at jenkins-hbase4.apache.org/43617] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-24 23:07:09,636 DEBUG [Listener at jenkins-hbase4.apache.org/43617] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-24 23:07:09,636 DEBUG [Listener at jenkins-hbase4.apache.org/43617] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-24 23:07:09,636 DEBUG [Listener at jenkins-hbase4.apache.org/43617] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-24 23:07:09,637 DEBUG [Listener at jenkins-hbase4.apache.org/43617] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-24 23:07:09,637 DEBUG [Listener at jenkins-hbase4.apache.org/43617] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-24 23:07:09,637 DEBUG [Listener at jenkins-hbase4.apache.org/43617] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-24 23:07:09,638 DEBUG [Listener at jenkins-hbase4.apache.org/43617] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-24 23:07:09,638 DEBUG [Listener at jenkins-hbase4.apache.org/43617] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-24 23:07:09,638 DEBUG [Listener at jenkins-hbase4.apache.org/43617] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-24 23:07:09,639 DEBUG [Listener at jenkins-hbase4.apache.org/43617] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-24 23:07:09,639 DEBUG [Listener at jenkins-hbase4.apache.org/43617] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-24 23:07:09,639 DEBUG [Listener at jenkins-hbase4.apache.org/43617] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-24 23:07:09,640 DEBUG [Listener at jenkins-hbase4.apache.org/43617] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-24 23:07:09,640 DEBUG [Listener at jenkins-hbase4.apache.org/43617] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-24 23:07:09,640 DEBUG [Listener at jenkins-hbase4.apache.org/43617] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-24 23:07:09,641 DEBUG [Listener at jenkins-hbase4.apache.org/43617] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 23:07:09,641 DEBUG [Listener at jenkins-hbase4.apache.org/43617] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 23:07:09,642 DEBUG [Listener at jenkins-hbase4.apache.org/43617] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 23:07:09,642 DEBUG [Listener at jenkins-hbase4.apache.org/43617] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 23:07:09,642 DEBUG [Listener at jenkins-hbase4.apache.org/43617] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 23:07:09,642 DEBUG [Listener at jenkins-hbase4.apache.org/43617] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 23:07:09,643 DEBUG [Listener at jenkins-hbase4.apache.org/43617] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 23:07:10,010 WARN [Listener at jenkins-hbase4.apache.org/43617] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-24 23:07:10,012 INFO [Listener at jenkins-hbase4.apache.org/43617] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-07-24 23:07:10,014 DEBUG [Listener at jenkins-hbase4.apache.org/43617] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-24 23:07:14,143 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-24 23:07:14,144 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-24 23:07:14,147 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690239977721_0003_000001 (auth:SIMPLE) 2023-07-24 23:07:14,947 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690239977721_0004_000001 (auth:SIMPLE) 2023-07-24 23:07:19,249 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690239977721_0004_000001 (auth:SIMPLE) 2023-07-24 23:07:21,465 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690239977721_0004_000001 (auth:SIMPLE) 2023-07-24 23:07:26,267 INFO [Listener at jenkins-hbase4.apache.org/43617] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-24 23:07:26,267 INFO [Listener at jenkins-hbase4.apache.org/43617] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-24 23:07:26,272 INFO [Listener at jenkins-hbase4.apache.org/43617] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-07-24 23:07:26,272 INFO [Listener at jenkins-hbase4.apache.org/43617] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-24 23:07:26,273 INFO [Listener at jenkins-hbase4.apache.org/43617] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-24 23:07:26,273 DEBUG [Listener at jenkins-hbase4.apache.org/43617] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1273988721_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-24 23:07:26,291 DEBUG [Listener at jenkins-hbase4.apache.org/43617] snapshot.TestExportSnapshot(367): hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-24 23:07:26,291 DEBUG [Listener at jenkins-hbase4.apache.org/43617] snapshot.TestExportSnapshot(367): hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-24 23:07:26,291 DEBUG [Listener at jenkins-hbase4.apache.org/43617] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@216d0181 in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/40a10de8-ef1a-d60f-e3da-b5fca02ca095/local-export-1690240014695/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/40a10de8-ef1a-d60f-e3da-b5fca02ca095/local-export-1690240014695/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-24 23:07:26,292 DEBUG [Listener at jenkins-hbase4.apache.org/43617] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/40a10de8-ef1a-d60f-e3da-b5fca02ca095/local-export-1690240014695/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-24 23:07:26,292 DEBUG [Listener at jenkins-hbase4.apache.org/43617] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/40a10de8-ef1a-d60f-e3da-b5fca02ca095/local-export-1690240014695/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-24 23:07:26,311 INFO [Listener at jenkins-hbase4.apache.org/43617] client.HBaseAdmin$15(890): Started disable of testtb-testConsecutiveExports 2023-07-24 23:07:26,312 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testConsecutiveExports 2023-07-24 23:07:26,315 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] procedure2.ProcedureExecutor(1029): Stored pid=51, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testConsecutiveExports 2023-07-24 23:07:26,321 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690240046321"}]},"ts":"1690240046321"} 2023-07-24 23:07:26,323 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-24 23:07:26,323 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLING in hbase:meta 2023-07-24 23:07:26,326 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testConsecutiveExports to state=DISABLING 2023-07-24 23:07:26,327 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=4071de5bf0c3dcfd1b6532e183c7fedc, UNASSIGN}, {pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=15c6c16ea0ab741de57ebe82df90050d, UNASSIGN}] 2023-07-24 23:07:26,334 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=4071de5bf0c3dcfd1b6532e183c7fedc, UNASSIGN 2023-07-24 23:07:26,336 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=15c6c16ea0ab741de57ebe82df90050d, UNASSIGN 2023-07-24 23:07:26,337 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=4071de5bf0c3dcfd1b6532e183c7fedc, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39595,1690239969801 2023-07-24 23:07:26,337 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1690240013333.4071de5bf0c3dcfd1b6532e183c7fedc.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690240046337"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690240046337"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690240046337"}]},"ts":"1690240046337"} 2023-07-24 23:07:26,338 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=15c6c16ea0ab741de57ebe82df90050d, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:07:26,338 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1690240013333.15c6c16ea0ab741de57ebe82df90050d.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690240046338"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690240046338"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690240046338"}]},"ts":"1690240046338"} 2023-07-24 23:07:26,339 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=54, ppid=52, state=RUNNABLE; CloseRegionProcedure 4071de5bf0c3dcfd1b6532e183c7fedc, server=jenkins-hbase4.apache.org,39595,1690239969801}] 2023-07-24 23:07:26,341 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=55, ppid=53, state=RUNNABLE; CloseRegionProcedure 15c6c16ea0ab741de57ebe82df90050d, server=jenkins-hbase4.apache.org,33227,1690239969957}] 2023-07-24 23:07:26,424 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-24 23:07:26,506 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 4071de5bf0c3dcfd1b6532e183c7fedc 2023-07-24 23:07:26,506 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 4071de5bf0c3dcfd1b6532e183c7fedc, disabling compactions & flushes 2023-07-24 23:07:26,506 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1690240013333.4071de5bf0c3dcfd1b6532e183c7fedc. 2023-07-24 23:07:26,507 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1690240013333.4071de5bf0c3dcfd1b6532e183c7fedc. 2023-07-24 23:07:26,507 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1690240013333.4071de5bf0c3dcfd1b6532e183c7fedc. after waiting 0 ms 2023-07-24 23:07:26,507 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1690240013333.4071de5bf0c3dcfd1b6532e183c7fedc. 2023-07-24 23:07:26,507 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 15c6c16ea0ab741de57ebe82df90050d 2023-07-24 23:07:26,507 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 15c6c16ea0ab741de57ebe82df90050d, disabling compactions & flushes 2023-07-24 23:07:26,507 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1690240013333.15c6c16ea0ab741de57ebe82df90050d. 2023-07-24 23:07:26,507 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1690240013333.15c6c16ea0ab741de57ebe82df90050d. 2023-07-24 23:07:26,507 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1690240013333.15c6c16ea0ab741de57ebe82df90050d. after waiting 0 ms 2023-07-24 23:07:26,507 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1690240013333.15c6c16ea0ab741de57ebe82df90050d. 2023-07-24 23:07:26,547 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/default/testtb-testConsecutiveExports/4071de5bf0c3dcfd1b6532e183c7fedc/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-24 23:07:26,547 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/default/testtb-testConsecutiveExports/15c6c16ea0ab741de57ebe82df90050d/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-24 23:07:26,548 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 23:07:26,549 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1690240013333.15c6c16ea0ab741de57ebe82df90050d. 2023-07-24 23:07:26,549 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 23:07:26,549 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 15c6c16ea0ab741de57ebe82df90050d: 2023-07-24 23:07:26,551 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1690240013333.4071de5bf0c3dcfd1b6532e183c7fedc. 2023-07-24 23:07:26,552 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 4071de5bf0c3dcfd1b6532e183c7fedc: 2023-07-24 23:07:26,553 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 15c6c16ea0ab741de57ebe82df90050d 2023-07-24 23:07:26,555 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=15c6c16ea0ab741de57ebe82df90050d, regionState=CLOSED 2023-07-24 23:07:26,555 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1690240013333.15c6c16ea0ab741de57ebe82df90050d.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690240046555"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690240046555"}]},"ts":"1690240046555"} 2023-07-24 23:07:26,555 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 4071de5bf0c3dcfd1b6532e183c7fedc 2023-07-24 23:07:26,556 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=4071de5bf0c3dcfd1b6532e183c7fedc, regionState=CLOSED 2023-07-24 23:07:26,556 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1690240013333.4071de5bf0c3dcfd1b6532e183c7fedc.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690240046556"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690240046556"}]},"ts":"1690240046556"} 2023-07-24 23:07:26,569 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=55, resume processing ppid=53 2023-07-24 23:07:26,569 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=55, ppid=53, state=SUCCESS; CloseRegionProcedure 15c6c16ea0ab741de57ebe82df90050d, server=jenkins-hbase4.apache.org,33227,1690239969957 in 224 msec 2023-07-24 23:07:26,571 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=54, resume processing ppid=52 2023-07-24 23:07:26,571 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=54, ppid=52, state=SUCCESS; CloseRegionProcedure 4071de5bf0c3dcfd1b6532e183c7fedc, server=jenkins-hbase4.apache.org,39595,1690239969801 in 228 msec 2023-07-24 23:07:26,571 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=15c6c16ea0ab741de57ebe82df90050d, UNASSIGN in 242 msec 2023-07-24 23:07:26,573 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=52, resume processing ppid=51 2023-07-24 23:07:26,573 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=4071de5bf0c3dcfd1b6532e183c7fedc, UNASSIGN in 244 msec 2023-07-24 23:07:26,574 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690240046574"}]},"ts":"1690240046574"} 2023-07-24 23:07:26,576 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLED in hbase:meta 2023-07-24 23:07:26,578 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testConsecutiveExports to state=DISABLED 2023-07-24 23:07:26,584 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=51, state=SUCCESS; DisableTableProcedure table=testtb-testConsecutiveExports in 266 msec 2023-07-24 23:07:26,626 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-24 23:07:26,626 INFO [Listener at jenkins-hbase4.apache.org/43617] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testConsecutiveExports, procId: 51 completed 2023-07-24 23:07:26,627 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testConsecutiveExports 2023-07-24 23:07:26,628 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] procedure2.ProcedureExecutor(1029): Stored pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-24 23:07:26,630 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-24 23:07:26,631 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] access.PermissionStorage(259): Removing permissions of removed table testtb-testConsecutiveExports 2023-07-24 23:07:26,631 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=56, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-24 23:07:26,634 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33227] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testConsecutiveExports 2023-07-24 23:07:26,638 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-24 23:07:26,638 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:39013-0x1019995a36f0002, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-24 23:07:26,638 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:39595-0x1019995a36f0001, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-24 23:07:26,638 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:33227-0x1019995a36f0003, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-24 23:07:26,638 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-24 23:07:26,638 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-24 23:07:26,642 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-24 23:07:26,642 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 23:07:26,642 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:33227-0x1019995a36f0003, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-24 23:07:26,643 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:33227-0x1019995a36f0003, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 23:07:26,643 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:39595-0x1019995a36f0001, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 23:07:26,643 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data null 2023-07-24 23:07:26,643 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:39013-0x1019995a36f0002, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 23:07:26,643 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-24 23:07:26,643 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data null 2023-07-24 23:07:26,643 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-24 23:07:26,643 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.tmp/data/default/testtb-testConsecutiveExports/4071de5bf0c3dcfd1b6532e183c7fedc 2023-07-24 23:07:26,644 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.tmp/data/default/testtb-testConsecutiveExports/15c6c16ea0ab741de57ebe82df90050d 2023-07-24 23:07:26,645 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-24 23:07:26,646 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.tmp/data/default/testtb-testConsecutiveExports/4071de5bf0c3dcfd1b6532e183c7fedc/cf, FileablePath, hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.tmp/data/default/testtb-testConsecutiveExports/4071de5bf0c3dcfd1b6532e183c7fedc/recovered.edits] 2023-07-24 23:07:26,646 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.tmp/data/default/testtb-testConsecutiveExports/15c6c16ea0ab741de57ebe82df90050d/cf, FileablePath, hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.tmp/data/default/testtb-testConsecutiveExports/15c6c16ea0ab741de57ebe82df90050d/recovered.edits] 2023-07-24 23:07:26,653 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.tmp/data/default/testtb-testConsecutiveExports/4071de5bf0c3dcfd1b6532e183c7fedc/cf/8c21ed3514c0411b81d62d6d5bf85619 to hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/archive/data/default/testtb-testConsecutiveExports/4071de5bf0c3dcfd1b6532e183c7fedc/cf/8c21ed3514c0411b81d62d6d5bf85619 2023-07-24 23:07:26,653 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.tmp/data/default/testtb-testConsecutiveExports/15c6c16ea0ab741de57ebe82df90050d/cf/d2073753380b4a218f3153474b159e84 to hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/archive/data/default/testtb-testConsecutiveExports/15c6c16ea0ab741de57ebe82df90050d/cf/d2073753380b4a218f3153474b159e84 2023-07-24 23:07:26,656 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.tmp/data/default/testtb-testConsecutiveExports/4071de5bf0c3dcfd1b6532e183c7fedc/recovered.edits/9.seqid to hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/archive/data/default/testtb-testConsecutiveExports/4071de5bf0c3dcfd1b6532e183c7fedc/recovered.edits/9.seqid 2023-07-24 23:07:26,657 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.tmp/data/default/testtb-testConsecutiveExports/4071de5bf0c3dcfd1b6532e183c7fedc 2023-07-24 23:07:26,657 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.tmp/data/default/testtb-testConsecutiveExports/15c6c16ea0ab741de57ebe82df90050d/recovered.edits/9.seqid to hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/archive/data/default/testtb-testConsecutiveExports/15c6c16ea0ab741de57ebe82df90050d/recovered.edits/9.seqid 2023-07-24 23:07:26,658 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.tmp/data/default/testtb-testConsecutiveExports/15c6c16ea0ab741de57ebe82df90050d 2023-07-24 23:07:26,658 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-07-24 23:07:26,660 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=56, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-24 23:07:26,663 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testConsecutiveExports from hbase:meta 2023-07-24 23:07:26,665 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testConsecutiveExports' descriptor. 2023-07-24 23:07:26,666 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=56, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-24 23:07:26,666 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testConsecutiveExports' from region states. 2023-07-24 23:07:26,666 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,,1690240013333.4071de5bf0c3dcfd1b6532e183c7fedc.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690240046666"}]},"ts":"9223372036854775807"} 2023-07-24 23:07:26,667 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,1,1690240013333.15c6c16ea0ab741de57ebe82df90050d.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690240046666"}]},"ts":"9223372036854775807"} 2023-07-24 23:07:26,669 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-24 23:07:26,669 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 4071de5bf0c3dcfd1b6532e183c7fedc, NAME => 'testtb-testConsecutiveExports,,1690240013333.4071de5bf0c3dcfd1b6532e183c7fedc.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 15c6c16ea0ab741de57ebe82df90050d, NAME => 'testtb-testConsecutiveExports,1,1690240013333.15c6c16ea0ab741de57ebe82df90050d.', STARTKEY => '1', ENDKEY => ''}] 2023-07-24 23:07:26,669 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testConsecutiveExports' as deleted. 2023-07-24 23:07:26,669 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1690240046669"}]},"ts":"9223372036854775807"} 2023-07-24 23:07:26,677 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testConsecutiveExports state from META 2023-07-24 23:07:26,679 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=56, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-24 23:07:26,681 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=56, state=SUCCESS; DeleteTableProcedure table=testtb-testConsecutiveExports in 52 msec 2023-07-24 23:07:26,746 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-24 23:07:26,747 INFO [Listener at jenkins-hbase4.apache.org/43617] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testConsecutiveExports, procId: 56 completed 2023-07-24 23:07:26,758 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testConsecutiveExports" 2023-07-24 23:07:26,760 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testConsecutiveExports 2023-07-24 23:07:26,761 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testConsecutiveExports" 2023-07-24 23:07:26,763 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testConsecutiveExports 2023-07-24 23:07:26,804 INFO [Listener at jenkins-hbase4.apache.org/43617] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testConsecutiveExports Thread=747 (was 763), OpenFileDescriptor=896 (was 916), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=398 (was 380) - SystemLoadAverage LEAK? -, ProcessCount=182 (was 180) - ProcessCount LEAK? -, AvailableMemoryMB=5824 (was 5741) - AvailableMemoryMB LEAK? - 2023-07-24 23:07:26,804 WARN [Listener at jenkins-hbase4.apache.org/43617] hbase.ResourceChecker(130): Thread=747 is superior to 500 2023-07-24 23:07:26,825 INFO [Listener at jenkins-hbase4.apache.org/43617] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=747, OpenFileDescriptor=896, MaxFileDescriptor=60000, SystemLoadAverage=398, ProcessCount=182, AvailableMemoryMB=5818 2023-07-24 23:07:26,825 WARN [Listener at jenkins-hbase4.apache.org/43617] hbase.ResourceChecker(130): Thread=747 is superior to 500 2023-07-24 23:07:26,827 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-24 23:07:26,829 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] procedure2.ProcedureExecutor(1029): Stored pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:26,832 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-07-24 23:07:26,834 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion" procId is: 57 2023-07-24 23:07:26,835 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-24 23:07:26,838 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-24 23:07:26,842 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/82dd5d7cd9e029d7b4514b27ba0319dd 2023-07-24 23:07:26,843 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/82dd5d7cd9e029d7b4514b27ba0319dd empty. 2023-07-24 23:07:26,843 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/dc762efe467f73b816d1c62ec8622d16 2023-07-24 23:07:26,844 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/82dd5d7cd9e029d7b4514b27ba0319dd 2023-07-24 23:07:26,844 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/dc762efe467f73b816d1c62ec8622d16 empty. 2023-07-24 23:07:26,844 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/dc762efe467f73b816d1c62ec8622d16 2023-07-24 23:07:26,844 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-07-24 23:07:26,861 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/.tabledesc/.tableinfo.0000000001 2023-07-24 23:07:26,863 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(7675): creating {ENCODED => 82dd5d7cd9e029d7b4514b27ba0319dd, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1690240046827.82dd5d7cd9e029d7b4514b27ba0319dd.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.tmp 2023-07-24 23:07:26,863 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(7675): creating {ENCODED => dc762efe467f73b816d1c62ec8622d16, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1690240046827.dc762efe467f73b816d1c62ec8622d16.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.tmp 2023-07-24 23:07:26,895 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1690240046827.dc762efe467f73b816d1c62ec8622d16.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 23:07:26,895 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1604): Closing dc762efe467f73b816d1c62ec8622d16, disabling compactions & flushes 2023-07-24 23:07:26,895 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1690240046827.dc762efe467f73b816d1c62ec8622d16. 2023-07-24 23:07:26,895 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1690240046827.dc762efe467f73b816d1c62ec8622d16. 2023-07-24 23:07:26,895 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1690240046827.dc762efe467f73b816d1c62ec8622d16. after waiting 0 ms 2023-07-24 23:07:26,895 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1690240046827.dc762efe467f73b816d1c62ec8622d16. 2023-07-24 23:07:26,895 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1690240046827.dc762efe467f73b816d1c62ec8622d16. 2023-07-24 23:07:26,895 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1558): Region close journal for dc762efe467f73b816d1c62ec8622d16: 2023-07-24 23:07:26,895 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1690240046827.82dd5d7cd9e029d7b4514b27ba0319dd.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 23:07:26,896 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1604): Closing 82dd5d7cd9e029d7b4514b27ba0319dd, disabling compactions & flushes 2023-07-24 23:07:26,896 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1690240046827.82dd5d7cd9e029d7b4514b27ba0319dd. 2023-07-24 23:07:26,896 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1690240046827.82dd5d7cd9e029d7b4514b27ba0319dd. 2023-07-24 23:07:26,896 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1690240046827.82dd5d7cd9e029d7b4514b27ba0319dd. after waiting 0 ms 2023-07-24 23:07:26,896 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1690240046827.82dd5d7cd9e029d7b4514b27ba0319dd. 2023-07-24 23:07:26,896 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1690240046827.82dd5d7cd9e029d7b4514b27ba0319dd. 2023-07-24 23:07:26,896 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1558): Region close journal for 82dd5d7cd9e029d7b4514b27ba0319dd: 2023-07-24 23:07:26,900 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ADD_TO_META 2023-07-24 23:07:26,901 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1690240046827.dc762efe467f73b816d1c62ec8622d16.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690240046901"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690240046901"}]},"ts":"1690240046901"} 2023-07-24 23:07:26,901 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1690240046827.82dd5d7cd9e029d7b4514b27ba0319dd.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690240046901"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690240046901"}]},"ts":"1690240046901"} 2023-07-24 23:07:26,909 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-24 23:07:26,910 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-24 23:07:26,910 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690240046910"}]},"ts":"1690240046910"} 2023-07-24 23:07:26,912 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLING in hbase:meta 2023-07-24 23:07:26,915 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-24 23:07:26,917 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-24 23:07:26,917 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-24 23:07:26,917 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-24 23:07:26,917 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-24 23:07:26,917 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=82dd5d7cd9e029d7b4514b27ba0319dd, ASSIGN}, {pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=dc762efe467f73b816d1c62ec8622d16, ASSIGN}] 2023-07-24 23:07:26,924 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=82dd5d7cd9e029d7b4514b27ba0319dd, ASSIGN 2023-07-24 23:07:26,924 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=dc762efe467f73b816d1c62ec8622d16, ASSIGN 2023-07-24 23:07:26,926 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=82dd5d7cd9e029d7b4514b27ba0319dd, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33227,1690239969957; forceNewPlan=false, retain=false 2023-07-24 23:07:26,926 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=dc762efe467f73b816d1c62ec8622d16, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39595,1690239969801; forceNewPlan=false, retain=false 2023-07-24 23:07:26,936 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-24 23:07:27,076 INFO [jenkins-hbase4:37213] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-24 23:07:27,079 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=dc762efe467f73b816d1c62ec8622d16, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39595,1690239969801 2023-07-24 23:07:27,079 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=82dd5d7cd9e029d7b4514b27ba0319dd, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:07:27,079 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1690240046827.dc762efe467f73b816d1c62ec8622d16.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690240047079"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690240047079"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690240047079"}]},"ts":"1690240047079"} 2023-07-24 23:07:27,079 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1690240046827.82dd5d7cd9e029d7b4514b27ba0319dd.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690240047079"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690240047079"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690240047079"}]},"ts":"1690240047079"} 2023-07-24 23:07:27,081 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=60, ppid=59, state=RUNNABLE; OpenRegionProcedure dc762efe467f73b816d1c62ec8622d16, server=jenkins-hbase4.apache.org,39595,1690239969801}] 2023-07-24 23:07:27,082 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=61, ppid=58, state=RUNNABLE; OpenRegionProcedure 82dd5d7cd9e029d7b4514b27ba0319dd, server=jenkins-hbase4.apache.org,33227,1690239969957}] 2023-07-24 23:07:27,138 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-24 23:07:27,248 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,1,1690240046827.dc762efe467f73b816d1c62ec8622d16. 2023-07-24 23:07:27,248 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => dc762efe467f73b816d1c62ec8622d16, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1690240046827.dc762efe467f73b816d1c62ec8622d16.', STARTKEY => '1', ENDKEY => ''} 2023-07-24 23:07:27,249 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,1,1690240046827.dc762efe467f73b816d1c62ec8622d16. service=AccessControlService 2023-07-24 23:07:27,249 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 23:07:27,249 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion dc762efe467f73b816d1c62ec8622d16 2023-07-24 23:07:27,249 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1690240046827.dc762efe467f73b816d1c62ec8622d16.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 23:07:27,249 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for dc762efe467f73b816d1c62ec8622d16 2023-07-24 23:07:27,249 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for dc762efe467f73b816d1c62ec8622d16 2023-07-24 23:07:27,255 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,,1690240046827.82dd5d7cd9e029d7b4514b27ba0319dd. 2023-07-24 23:07:27,255 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 82dd5d7cd9e029d7b4514b27ba0319dd, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1690240046827.82dd5d7cd9e029d7b4514b27ba0319dd.', STARTKEY => '', ENDKEY => '1'} 2023-07-24 23:07:27,256 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,,1690240046827.82dd5d7cd9e029d7b4514b27ba0319dd. service=AccessControlService 2023-07-24 23:07:27,256 INFO [StoreOpener-dc762efe467f73b816d1c62ec8622d16-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region dc762efe467f73b816d1c62ec8622d16 2023-07-24 23:07:27,256 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 23:07:27,256 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 82dd5d7cd9e029d7b4514b27ba0319dd 2023-07-24 23:07:27,256 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1690240046827.82dd5d7cd9e029d7b4514b27ba0319dd.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 23:07:27,256 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 82dd5d7cd9e029d7b4514b27ba0319dd 2023-07-24 23:07:27,256 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 82dd5d7cd9e029d7b4514b27ba0319dd 2023-07-24 23:07:27,262 DEBUG [StoreOpener-dc762efe467f73b816d1c62ec8622d16-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/default/testtb-testExportFileSystemStateWithMergeRegion/dc762efe467f73b816d1c62ec8622d16/cf 2023-07-24 23:07:27,262 DEBUG [StoreOpener-dc762efe467f73b816d1c62ec8622d16-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/default/testtb-testExportFileSystemStateWithMergeRegion/dc762efe467f73b816d1c62ec8622d16/cf 2023-07-24 23:07:27,264 INFO [StoreOpener-dc762efe467f73b816d1c62ec8622d16-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region dc762efe467f73b816d1c62ec8622d16 columnFamilyName cf 2023-07-24 23:07:27,265 INFO [StoreOpener-dc762efe467f73b816d1c62ec8622d16-1] regionserver.HStore(310): Store=dc762efe467f73b816d1c62ec8622d16/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 23:07:27,269 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/default/testtb-testExportFileSystemStateWithMergeRegion/dc762efe467f73b816d1c62ec8622d16 2023-07-24 23:07:27,272 INFO [StoreOpener-82dd5d7cd9e029d7b4514b27ba0319dd-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 82dd5d7cd9e029d7b4514b27ba0319dd 2023-07-24 23:07:27,272 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/default/testtb-testExportFileSystemStateWithMergeRegion/dc762efe467f73b816d1c62ec8622d16 2023-07-24 23:07:27,274 DEBUG [StoreOpener-82dd5d7cd9e029d7b4514b27ba0319dd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/default/testtb-testExportFileSystemStateWithMergeRegion/82dd5d7cd9e029d7b4514b27ba0319dd/cf 2023-07-24 23:07:27,274 DEBUG [StoreOpener-82dd5d7cd9e029d7b4514b27ba0319dd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/default/testtb-testExportFileSystemStateWithMergeRegion/82dd5d7cd9e029d7b4514b27ba0319dd/cf 2023-07-24 23:07:27,274 INFO [StoreOpener-82dd5d7cd9e029d7b4514b27ba0319dd-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 82dd5d7cd9e029d7b4514b27ba0319dd columnFamilyName cf 2023-07-24 23:07:27,276 INFO [StoreOpener-82dd5d7cd9e029d7b4514b27ba0319dd-1] regionserver.HStore(310): Store=82dd5d7cd9e029d7b4514b27ba0319dd/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 23:07:27,276 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for dc762efe467f73b816d1c62ec8622d16 2023-07-24 23:07:27,277 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/default/testtb-testExportFileSystemStateWithMergeRegion/82dd5d7cd9e029d7b4514b27ba0319dd 2023-07-24 23:07:27,285 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/default/testtb-testExportFileSystemStateWithMergeRegion/82dd5d7cd9e029d7b4514b27ba0319dd 2023-07-24 23:07:27,289 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 82dd5d7cd9e029d7b4514b27ba0319dd 2023-07-24 23:07:27,289 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/default/testtb-testExportFileSystemStateWithMergeRegion/dc762efe467f73b816d1c62ec8622d16/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-24 23:07:27,291 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened dc762efe467f73b816d1c62ec8622d16; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71872315, jitterRate=0.07098095118999481}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-24 23:07:27,291 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for dc762efe467f73b816d1c62ec8622d16: 2023-07-24 23:07:27,293 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,1,1690240046827.dc762efe467f73b816d1c62ec8622d16., pid=60, masterSystemTime=1690240047233 2023-07-24 23:07:27,299 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=dc762efe467f73b816d1c62ec8622d16, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39595,1690239969801 2023-07-24 23:07:27,299 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,1,1690240046827.dc762efe467f73b816d1c62ec8622d16. 2023-07-24 23:07:27,299 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1690240046827.dc762efe467f73b816d1c62ec8622d16.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690240047299"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690240047299"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690240047299"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690240047299"}]},"ts":"1690240047299"} 2023-07-24 23:07:27,300 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/default/testtb-testExportFileSystemStateWithMergeRegion/82dd5d7cd9e029d7b4514b27ba0319dd/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-24 23:07:27,300 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 82dd5d7cd9e029d7b4514b27ba0319dd; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60639144, jitterRate=-0.09640634059906006}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-24 23:07:27,301 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 82dd5d7cd9e029d7b4514b27ba0319dd: 2023-07-24 23:07:27,299 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,1,1690240046827.dc762efe467f73b816d1c62ec8622d16. 2023-07-24 23:07:27,304 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,,1690240046827.82dd5d7cd9e029d7b4514b27ba0319dd., pid=61, masterSystemTime=1690240047234 2023-07-24 23:07:27,309 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,,1690240046827.82dd5d7cd9e029d7b4514b27ba0319dd. 2023-07-24 23:07:27,309 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,,1690240046827.82dd5d7cd9e029d7b4514b27ba0319dd. 2023-07-24 23:07:27,311 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=82dd5d7cd9e029d7b4514b27ba0319dd, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:07:27,311 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1690240046827.82dd5d7cd9e029d7b4514b27ba0319dd.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690240047310"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690240047310"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690240047310"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690240047310"}]},"ts":"1690240047310"} 2023-07-24 23:07:27,312 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=60, resume processing ppid=59 2023-07-24 23:07:27,313 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=60, ppid=59, state=SUCCESS; OpenRegionProcedure dc762efe467f73b816d1c62ec8622d16, server=jenkins-hbase4.apache.org,39595,1690239969801 in 226 msec 2023-07-24 23:07:27,323 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=61, resume processing ppid=58 2023-07-24 23:07:27,325 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=61, ppid=58, state=SUCCESS; OpenRegionProcedure 82dd5d7cd9e029d7b4514b27ba0319dd, server=jenkins-hbase4.apache.org,33227,1690239969957 in 231 msec 2023-07-24 23:07:27,330 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=59, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=dc762efe467f73b816d1c62ec8622d16, ASSIGN in 405 msec 2023-07-24 23:07:27,332 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=58, resume processing ppid=57 2023-07-24 23:07:27,333 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=58, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=82dd5d7cd9e029d7b4514b27ba0319dd, ASSIGN in 412 msec 2023-07-24 23:07:27,333 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-24 23:07:27,334 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690240047334"}]},"ts":"1690240047334"} 2023-07-24 23:07:27,335 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLED in hbase:meta 2023-07-24 23:07:27,343 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_POST_OPERATION 2023-07-24 23:07:27,344 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion jenkins: RWXCA 2023-07-24 23:07:27,352 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33227] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-24 23:07:27,354 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:39595-0x1019995a36f0001, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 23:07:27,354 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 23:07:27,354 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:39013-0x1019995a36f0002, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 23:07:27,354 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:33227-0x1019995a36f0003, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 23:07:27,356 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-24 23:07:27,356 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-24 23:07:27,356 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-24 23:07:27,356 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-24 23:07:27,359 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=57, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 529 msec 2023-07-24 23:07:27,440 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-24 23:07:27,441 INFO [Listener at jenkins-hbase4.apache.org/43617] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 57 completed 2023-07-24 23:07:27,441 DEBUG [Listener at jenkins-hbase4.apache.org/43617] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testExportFileSystemStateWithMergeRegion get assigned. Timeout = 60000ms 2023-07-24 23:07:27,441 INFO [Listener at jenkins-hbase4.apache.org/43617] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-24 23:07:27,446 INFO [Listener at jenkins-hbase4.apache.org/43617] hbase.HBaseTestingUtility(3484): All regions for table testtb-testExportFileSystemStateWithMergeRegion assigned to meta. Checking AM states. 2023-07-24 23:07:27,446 INFO [Listener at jenkins-hbase4.apache.org/43617] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-24 23:07:27,446 INFO [Listener at jenkins-hbase4.apache.org/43617] hbase.HBaseTestingUtility(3504): All regions for table testtb-testExportFileSystemStateWithMergeRegion assigned. 2023-07-24 23:07:27,454 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-24 23:07:27,454 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690240047454 (current time:1690240047454). 2023-07-24 23:07:27,454 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-24 23:07:27,454 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] zookeeper.ReadOnlyZKClient(139): Connect 0x2f0c3337 to 127.0.0.1:52881 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 23:07:27,464 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@c7b0262, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 23:07:27,465 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 23:07:27,468 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47780, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 23:07:27,470 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2f0c3337 to 127.0.0.1:52881 2023-07-24 23:07:27,470 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 23:07:27,470 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] zookeeper.ReadOnlyZKClient(139): Connect 0x651a1056 to 127.0.0.1:52881 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 23:07:27,489 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2bc10249, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 23:07:27,494 DEBUG [hconnection-0x7f7d7d41-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 23:07:27,496 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47796, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 23:07:27,500 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 23:07:27,503 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52846, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 23:07:27,505 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x651a1056 to 127.0.0.1:52881 2023-07-24 23:07:27,505 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 23:07:27,505 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-24 23:07:27,506 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-24 23:07:27,506 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-24 23:07:27,516 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] procedure2.ProcedureExecutor(1029): Stored pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-24 23:07:27,518 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-24 23:07:27,519 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=62, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1690240647519 2023-07-24 23:07:27,519 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-24 23:07:27,519 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:27,519 DEBUG [Listener at jenkins-hbase4.apache.org/43617] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-24 23:07:27,519 DEBUG [Listener at jenkins-hbase4.apache.org/43617] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-24 23:07:27,525 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=62, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-24 23:07:27,526 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-24 23:07:27,528 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=62, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 10 msec 2023-07-24 23:07:27,529 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-24 23:07:27,530 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=63, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1690240647530 2023-07-24 23:07:27,558 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:27,559 INFO [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' 2023-07-24 23:07:27,559 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 23:07:27,560 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-07-24 23:07:27,561 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-07-24 23:07:27,561 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:27,561 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:27,562 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:39013-0x1019995a36f0002, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 23:07:27,562 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:39595-0x1019995a36f0001, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 23:07:27,562 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 23:07:27,563 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:07:27,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 23:07:27,563 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 23:07:27,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 23:07:27,562 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:33227-0x1019995a36f0003, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 23:07:27,563 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 23:07:27,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 23:07:27,563 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:07:27,563 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39595,1690239969801 2023-07-24 23:07:27,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:27,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:27,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:27,564 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39595-0x1019995a36f0001, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:27,564 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39595,1690239969801 2023-07-24 23:07:27,564 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-24 23:07:27,564 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39013-0x1019995a36f0002, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:27,564 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33227-0x1019995a36f0003, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:27,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-24 23:07:27,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:27,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-24 23:07:27,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-24 23:07:27,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:27,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:27,565 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-24 23:07:27,565 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-24 23:07:27,565 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-24 23:07:27,565 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:27,566 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1690239969801' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-24 23:07:27,566 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1690239969801' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 23:07:27,568 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:27,570 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:27,570 DEBUG [member: 'jenkins-hbase4.apache.org,39013,1690239969874' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-24 23:07:27,570 DEBUG [member: 'jenkins-hbase4.apache.org,39013,1690239969874' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 23:07:27,570 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1690239969801' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-24 23:07:27,571 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1690239969801' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-24 23:07:27,570 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-24 23:07:27,572 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1690239969801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39595,1690239969801' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-24 23:07:27,571 DEBUG [member: 'jenkins-hbase4.apache.org,39013,1690239969874' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-24 23:07:27,572 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 23:07:27,572 DEBUG [member: 'jenkins-hbase4.apache.org,39013,1690239969874' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-24 23:07:27,573 DEBUG [member: 'jenkins-hbase4.apache.org,39013,1690239969874' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39013,1690239969874' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-24 23:07:27,573 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-24 23:07:27,574 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-24 23:07:27,575 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33227,1690239969957' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-24 23:07:27,580 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39595,1690239969801 2023-07-24 23:07:27,580 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1690239969801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:27,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39595,1690239969801 2023-07-24 23:07:27,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 23:07:27,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 23:07:27,582 DEBUG [member: 'jenkins-hbase4.apache.org,39013,1690239969874' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:27,582 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1690239969801' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39595-0x1019995a36f0001, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:27,582 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1690239969801' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 23:07:27,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 23:07:27,582 DEBUG [member: 'jenkins-hbase4.apache.org,39013,1690239969874' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39013-0x1019995a36f0002, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:27,582 DEBUG [member: 'jenkins-hbase4.apache.org,39013,1690239969874' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 23:07:27,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 23:07:27,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:27,584 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:27,584 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:07:27,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:07:27,585 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33227-0x1019995a36f0003, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:27,585 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 23:07:27,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39013,1690239969874 2023-07-24 23:07:27,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39595,1690239969801 2023-07-24 23:07:27,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 23:07:27,586 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39595,1690239969801' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-24 23:07:27,586 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@191be819[Count = 1] remaining members to acquire global barrier 2023-07-24 23:07:27,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:07:27,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 23:07:27,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 23:07:27,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 23:07:27,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 23:07:27,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:27,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:07:27,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39013,1690239969874 2023-07-24 23:07:27,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39595,1690239969801 2023-07-24 23:07:27,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 23:07:27,589 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33227,1690239969957' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-24 23:07:27,589 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@191be819[Count = 0] remaining members to acquire global barrier 2023-07-24 23:07:27,589 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-07-24 23:07:27,589 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:27,591 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:39595-0x1019995a36f0001, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:27,591 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:27,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:27,591 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1690239969801' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-24 23:07:27,592 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1690239969801' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 23:07:27,592 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1690239969801' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 23:07:27,592 DEBUG [rs(jenkins-hbase4.apache.org,39595,1690239969801)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1690240046827.dc762efe467f73b816d1c62ec8622d16. 2023-07-24 23:07:27,593 DEBUG [rs(jenkins-hbase4.apache.org,39595,1690239969801)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1690240046827.dc762efe467f73b816d1c62ec8622d16. started... 2023-07-24 23:07:27,599 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:39013-0x1019995a36f0002, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:27,599 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:27,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:27,599 DEBUG [member: 'jenkins-hbase4.apache.org,39013,1690239969874' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-24 23:07:27,599 DEBUG [member: 'jenkins-hbase4.apache.org,39013,1690239969874' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-24 23:07:27,599 DEBUG [member: 'jenkins-hbase4.apache.org,39013,1690239969874' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,39013,1690239969874' in zk 2023-07-24 23:07:27,599 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:33227-0x1019995a36f0003, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:27,599 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:27,599 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39595,1690239969801 2023-07-24 23:07:27,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:27,599 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-24 23:07:27,600 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:07:27,600 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-24 23:07:27,605 DEBUG [member: 'jenkins-hbase4.apache.org,39013,1690239969874' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-24 23:07:27,605 DEBUG [member: 'jenkins-hbase4.apache.org,39013,1690239969874' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 23:07:27,605 DEBUG [member: 'jenkins-hbase4.apache.org,39013,1690239969874' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-24 23:07:27,607 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 23:07:27,607 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 23:07:27,612 DEBUG [rs(jenkins-hbase4.apache.org,33227,1690239969957)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1690240046827.82dd5d7cd9e029d7b4514b27ba0319dd. 2023-07-24 23:07:27,612 DEBUG [rs(jenkins-hbase4.apache.org,33227,1690239969957)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1690240046827.82dd5d7cd9e029d7b4514b27ba0319dd. started... 2023-07-24 23:07:27,613 DEBUG [rs(jenkins-hbase4.apache.org,39595,1690239969801)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for dc762efe467f73b816d1c62ec8622d16: 2023-07-24 23:07:27,613 DEBUG [rs(jenkins-hbase4.apache.org,39595,1690239969801)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1690240046827.dc762efe467f73b816d1c62ec8622d16.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:27,613 DEBUG [rs(jenkins-hbase4.apache.org,39595,1690239969801)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 23:07:27,613 DEBUG [rs(jenkins-hbase4.apache.org,39595,1690239969801)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-24 23:07:27,615 DEBUG [rs(jenkins-hbase4.apache.org,33227,1690239969957)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 82dd5d7cd9e029d7b4514b27ba0319dd: 2023-07-24 23:07:27,615 DEBUG [rs(jenkins-hbase4.apache.org,33227,1690239969957)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1690240046827.82dd5d7cd9e029d7b4514b27ba0319dd.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:27,615 DEBUG [rs(jenkins-hbase4.apache.org,33227,1690239969957)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 23:07:27,615 DEBUG [rs(jenkins-hbase4.apache.org,33227,1690239969957)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-24 23:07:27,620 DEBUG [Listener at jenkins-hbase4.apache.org/43617] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 23:07:27,621 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-24 23:07:27,621 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-24 23:07:27,622 DEBUG [Listener at jenkins-hbase4.apache.org/43617] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-24 23:07:27,655 DEBUG [rs(jenkins-hbase4.apache.org,33227,1690239969957)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1690240046827.82dd5d7cd9e029d7b4514b27ba0319dd. completed. 2023-07-24 23:07:27,655 DEBUG [rs(jenkins-hbase4.apache.org,33227,1690239969957)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1690240046827.82dd5d7cd9e029d7b4514b27ba0319dd. 2023-07-24 23:07:27,655 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 23:07:27,655 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 23:07:27,655 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:07:27,655 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-24 23:07:27,655 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,33227,1690239969957' in zk 2023-07-24 23:07:27,663 DEBUG [rs(jenkins-hbase4.apache.org,39595,1690239969801)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1690240046827.dc762efe467f73b816d1c62ec8622d16. completed. 2023-07-24 23:07:27,663 DEBUG [rs(jenkins-hbase4.apache.org,39595,1690239969801)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1690240046827.dc762efe467f73b816d1c62ec8622d16. 2023-07-24 23:07:27,663 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1690239969801' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 23:07:27,663 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1690239969801' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 23:07:27,663 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1690239969801' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39595,1690239969801 2023-07-24 23:07:27,663 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1690239969801' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-24 23:07:27,663 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1690239969801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,39595,1690239969801' in zk 2023-07-24 23:07:27,664 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:07:27,664 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-24 23:07:27,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:07:27,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 23:07:27,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 23:07:27,664 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 23:07:27,664 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-24 23:07:27,675 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1690239969801' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-24 23:07:27,675 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1690239969801' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 23:07:27,675 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39595,1690239969801 2023-07-24 23:07:27,675 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1690239969801' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-24 23:07:27,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 23:07:27,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 23:07:27,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:27,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:07:27,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39013,1690239969874 2023-07-24 23:07:27,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39595,1690239969801 2023-07-24 23:07:27,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 23:07:27,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:27,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:07:27,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39013,1690239969874 2023-07-24 23:07:27,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39595,1690239969801 2023-07-24 23:07:27,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,33227,1690239969957': 2023-07-24 23:07:27,685 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33227,1690239969957' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-07-24 23:07:27,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39595,1690239969801 2023-07-24 23:07:27,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 23:07:27,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 23:07:27,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 23:07:27,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 23:07:27,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:27,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:07:27,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39013,1690239969874 2023-07-24 23:07:27,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39595,1690239969801 2023-07-24 23:07:27,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 23:07:27,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:27,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:07:27,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39013,1690239969874 2023-07-24 23:07:27,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39595,1690239969801 2023-07-24 23:07:27,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,39595,1690239969801': 2023-07-24 23:07:27,689 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39595,1690239969801' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-07-24 23:07:27,689 INFO [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-07-24 23:07:27,690 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-24 23:07:27,690 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-24 23:07:27,690 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:27,690 INFO [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-24 23:07:27,692 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:27,692 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:33227-0x1019995a36f0003, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:27,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:27,692 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:33227-0x1019995a36f0003, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 23:07:27,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 23:07:27,692 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:27,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:27,692 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:39595-0x1019995a36f0001, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:27,692 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:39595-0x1019995a36f0001, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 23:07:27,692 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:39013-0x1019995a36f0002, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:27,692 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:27,692 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:27,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:27,692 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 23:07:27,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 23:07:27,692 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:39013-0x1019995a36f0002, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 23:07:27,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 23:07:27,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:27,693 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:07:27,693 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 23:07:27,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 23:07:27,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:27,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 23:07:27,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:27,693 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39013,1690239969874 2023-07-24 23:07:27,693 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 23:07:27,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 23:07:27,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:27,694 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39595,1690239969801 2023-07-24 23:07:27,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:27,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 23:07:27,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:27,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:07:27,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39013,1690239969874 2023-07-24 23:07:27,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39595,1690239969801 2023-07-24 23:07:27,696 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:07:27,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 23:07:27,696 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39013,1690239969874 2023-07-24 23:07:27,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:27,697 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39595,1690239969801 2023-07-24 23:07:27,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:07:27,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39013,1690239969874 2023-07-24 23:07:27,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39595,1690239969801 2023-07-24 23:07:27,701 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39595,1690239969801 2023-07-24 23:07:27,701 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:27,702 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:39013-0x1019995a36f0002, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 23:07:27,702 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:39595-0x1019995a36f0001, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 23:07:27,702 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:33227-0x1019995a36f0003, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 23:07:27,702 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 23:07:27,702 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 23:07:27,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 23:07:27,702 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39013,1690239969874 2023-07-24 23:07:27,702 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:27,702 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:07:27,702 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:27,702 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:39013-0x1019995a36f0002, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 23:07:27,702 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 23:07:27,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 23:07:27,702 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:33227-0x1019995a36f0003, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 23:07:27,702 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:39595-0x1019995a36f0001, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 23:07:27,702 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 23:07:27,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 23:07:27,704 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 23:07:27,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 23:07:27,702 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:27,704 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 23:07:27,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 23:07:27,704 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39595,1690239969801 2023-07-24 23:07:27,705 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:27,705 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39013,1690239969874 2023-07-24 23:07:27,705 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:07:27,705 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:27,705 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:27,707 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 23:07:27,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 23:07:27,707 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:27,754 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:27,792 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-07-24 23:07:27,792 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:27,792 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:27,793 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1690240047519Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1690240047702 (+183 ms)Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1690240047702Writing data manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1690240047713 (+11 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1690240047739 (+26 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1690240047792 (+53 ms) 2023-07-24 23:07:27,795 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=63, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-24 23:07:27,797 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=63, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 271 msec 2023-07-24 23:07:27,822 DEBUG [Listener at jenkins-hbase4.apache.org/43617] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 23:07:27,825 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-24 23:07:27,825 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-24 23:07:27,840 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33227] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,,1690240046827.82dd5d7cd9e029d7b4514b27ba0319dd. with WAL disabled. Data may be lost in the event of a crash. 2023-07-24 23:07:27,848 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39595] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,1,1690240046827.dc762efe467f73b816d1c62ec8622d16. with WAL disabled. Data may be lost in the event of a crash. 2023-07-24 23:07:27,855 DEBUG [Listener at jenkins-hbase4.apache.org/43617] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:27,855 DEBUG [Listener at jenkins-hbase4.apache.org/43617] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1690240046827.82dd5d7cd9e029d7b4514b27ba0319dd. 2023-07-24 23:07:27,855 INFO [Listener at jenkins-hbase4.apache.org/43617] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-24 23:07:27,870 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-24 23:07:27,870 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690240047870 (current time:1690240047870). 2023-07-24 23:07:27,870 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-24 23:07:27,871 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] zookeeper.ReadOnlyZKClient(139): Connect 0x2b9d6918 to 127.0.0.1:52881 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 23:07:27,913 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1b323027, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 23:07:27,915 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 23:07:27,928 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47806, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 23:07:27,929 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2b9d6918 to 127.0.0.1:52881 2023-07-24 23:07:27,929 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 23:07:27,930 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] zookeeper.ReadOnlyZKClient(139): Connect 0x3c31f355 to 127.0.0.1:52881 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 23:07:27,945 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7ca48862, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 23:07:27,951 DEBUG [hconnection-0x761d3cd9-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 23:07:27,954 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47808, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 23:07:27,958 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 23:07:27,960 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52848, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 23:07:27,962 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3c31f355 to 127.0.0.1:52881 2023-07-24 23:07:27,962 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 23:07:27,962 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-24 23:07:27,963 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-24 23:07:27,963 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-24 23:07:27,965 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] procedure2.ProcedureExecutor(1029): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-24 23:07:27,966 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-24 23:07:27,967 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1690240647967 2023-07-24 23:07:27,967 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-24 23:07:27,967 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:27,968 DEBUG [Listener at jenkins-hbase4.apache.org/43617] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-24 23:07:27,968 DEBUG [Listener at jenkins-hbase4.apache.org/43617] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-24 23:07:27,969 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-24 23:07:27,969 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-24 23:07:27,971 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 5 msec 2023-07-24 23:07:27,972 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-24 23:07:27,973 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=65, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1690240647973 2023-07-24 23:07:28,042 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:28,042 INFO [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' 2023-07-24 23:07:28,042 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 23:07:28,047 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-07-24 23:07:28,047 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-07-24 23:07:28,048 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:28,048 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:28,049 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:39595-0x1019995a36f0001, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 23:07:28,049 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 23:07:28,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 23:07:28,049 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:39013-0x1019995a36f0002, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 23:07:28,049 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 23:07:28,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 23:07:28,050 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:33227-0x1019995a36f0003, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 23:07:28,050 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 23:07:28,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 23:07:28,053 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:07:28,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:28,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:28,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:28,055 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:07:28,055 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39595,1690239969801 2023-07-24 23:07:28,055 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39013-0x1019995a36f0002, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:28,055 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33227-0x1019995a36f0003, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:28,055 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39595-0x1019995a36f0001, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:28,056 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39595,1690239969801 2023-07-24 23:07:28,056 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-24 23:07:28,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-24 23:07:28,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-24 23:07:28,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:28,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-24 23:07:28,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:28,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:28,056 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-24 23:07:28,056 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-24 23:07:28,056 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-24 23:07:28,058 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:28,058 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:28,059 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-24 23:07:28,059 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 23:07:28,059 DEBUG [member: 'jenkins-hbase4.apache.org,39013,1690239969874' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-24 23:07:28,059 DEBUG [member: 'jenkins-hbase4.apache.org,39013,1690239969874' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 23:07:28,065 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-24 23:07:28,065 DEBUG [member: 'jenkins-hbase4.apache.org,39013,1690239969874' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-24 23:07:28,065 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:28,065 DEBUG [member: 'jenkins-hbase4.apache.org,39013,1690239969874' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-24 23:07:28,065 DEBUG [member: 'jenkins-hbase4.apache.org,39013,1690239969874' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39013,1690239969874' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-24 23:07:28,065 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-24 23:07:28,065 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1690239969801' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-24 23:07:28,066 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1690239969801' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 23:07:28,066 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33227,1690239969957' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-24 23:07:28,067 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1690239969801' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-24 23:07:28,067 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1690239969801' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-24 23:07:28,067 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1690239969801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39595,1690239969801' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-24 23:07:28,068 DEBUG [Listener at jenkins-hbase4.apache.org/43617] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 23:07:28,069 DEBUG [member: 'jenkins-hbase4.apache.org,39013,1690239969874' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:28,069 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:28,069 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:07:28,070 DEBUG [member: 'jenkins-hbase4.apache.org,39013,1690239969874' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39013-0x1019995a36f0002, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:28,070 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1690239969801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:28,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:07:28,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 23:07:28,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 23:07:28,070 DEBUG [member: 'jenkins-hbase4.apache.org,39013,1690239969874' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 23:07:28,070 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-24 23:07:28,070 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39595,1690239969801 2023-07-24 23:07:28,070 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-24 23:07:28,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 23:07:28,070 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33227-0x1019995a36f0003, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:28,070 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 23:07:28,070 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1690239969801' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39595-0x1019995a36f0001, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:28,070 DEBUG [Listener at jenkins-hbase4.apache.org/43617] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-24 23:07:28,070 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1690239969801' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 23:07:28,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 23:07:28,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:28,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:07:28,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39013,1690239969874 2023-07-24 23:07:28,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39595,1690239969801 2023-07-24 23:07:28,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 23:07:28,072 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33227,1690239969957' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-24 23:07:28,072 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@118980ff[Count = 1] remaining members to acquire global barrier 2023-07-24 23:07:28,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39595,1690239969801 2023-07-24 23:07:28,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 23:07:28,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 23:07:28,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 23:07:28,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 23:07:28,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:28,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:07:28,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39013,1690239969874 2023-07-24 23:07:28,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39595,1690239969801 2023-07-24 23:07:28,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 23:07:28,075 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39595,1690239969801' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-24 23:07:28,075 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@118980ff[Count = 0] remaining members to acquire global barrier 2023-07-24 23:07:28,075 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-07-24 23:07:28,075 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:28,077 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:33227-0x1019995a36f0003, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:28,077 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:39013-0x1019995a36f0002, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:28,077 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:28,077 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:39595-0x1019995a36f0001, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:28,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:28,077 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:28,077 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-24 23:07:28,077 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:28,077 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:07:28,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:28,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:28,077 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1690239969801' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-24 23:07:28,077 DEBUG [member: 'jenkins-hbase4.apache.org,39013,1690239969874' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-24 23:07:28,078 DEBUG [member: 'jenkins-hbase4.apache.org,39013,1690239969874' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-24 23:07:28,078 DEBUG [member: 'jenkins-hbase4.apache.org,39013,1690239969874' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,39013,1690239969874' in zk 2023-07-24 23:07:28,078 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39595,1690239969801 2023-07-24 23:07:28,078 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-24 23:07:28,079 DEBUG [member: 'jenkins-hbase4.apache.org,39013,1690239969874' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-24 23:07:28,079 DEBUG [member: 'jenkins-hbase4.apache.org,39013,1690239969874' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 23:07:28,079 DEBUG [member: 'jenkins-hbase4.apache.org,39013,1690239969874' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-24 23:07:28,084 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 23:07:28,084 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 23:07:28,084 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1690239969801' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 23:07:28,084 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1690239969801' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 23:07:28,084 DEBUG [rs(jenkins-hbase4.apache.org,39595,1690239969801)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1690240046827.dc762efe467f73b816d1c62ec8622d16. 2023-07-24 23:07:28,084 DEBUG [rs(jenkins-hbase4.apache.org,33227,1690239969957)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1690240046827.82dd5d7cd9e029d7b4514b27ba0319dd. 2023-07-24 23:07:28,084 DEBUG [rs(jenkins-hbase4.apache.org,39595,1690239969801)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1690240046827.dc762efe467f73b816d1c62ec8622d16. started... 2023-07-24 23:07:28,084 DEBUG [rs(jenkins-hbase4.apache.org,33227,1690239969957)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1690240046827.82dd5d7cd9e029d7b4514b27ba0319dd. started... 2023-07-24 23:07:28,084 INFO [rs(jenkins-hbase4.apache.org,33227,1690239969957)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 82dd5d7cd9e029d7b4514b27ba0319dd 1/1 column families, dataSize=199 B heapSize=688 B 2023-07-24 23:07:28,084 INFO [rs(jenkins-hbase4.apache.org,39595,1690239969801)-snapshot-pool-0] regionserver.HRegion(2745): Flushing dc762efe467f73b816d1c62ec8622d16 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-07-24 23:07:28,106 INFO [rs(jenkins-hbase4.apache.org,39595,1690239969801)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.06 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/default/testtb-testExportFileSystemStateWithMergeRegion/dc762efe467f73b816d1c62ec8622d16/.tmp/cf/35abb0bf6e484acaaf323af1589ddfd6 2023-07-24 23:07:28,108 INFO [rs(jenkins-hbase4.apache.org,33227,1690239969957)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=199 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/default/testtb-testExportFileSystemStateWithMergeRegion/82dd5d7cd9e029d7b4514b27ba0319dd/.tmp/cf/183254f2d24b43b3aaacca12ebe6032d 2023-07-24 23:07:28,112 DEBUG [rs(jenkins-hbase4.apache.org,39595,1690239969801)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/default/testtb-testExportFileSystemStateWithMergeRegion/dc762efe467f73b816d1c62ec8622d16/.tmp/cf/35abb0bf6e484acaaf323af1589ddfd6 as hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/default/testtb-testExportFileSystemStateWithMergeRegion/dc762efe467f73b816d1c62ec8622d16/cf/35abb0bf6e484acaaf323af1589ddfd6 2023-07-24 23:07:28,114 DEBUG [rs(jenkins-hbase4.apache.org,33227,1690239969957)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/default/testtb-testExportFileSystemStateWithMergeRegion/82dd5d7cd9e029d7b4514b27ba0319dd/.tmp/cf/183254f2d24b43b3aaacca12ebe6032d as hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/default/testtb-testExportFileSystemStateWithMergeRegion/82dd5d7cd9e029d7b4514b27ba0319dd/cf/183254f2d24b43b3aaacca12ebe6032d 2023-07-24 23:07:28,117 INFO [rs(jenkins-hbase4.apache.org,39595,1690239969801)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/default/testtb-testExportFileSystemStateWithMergeRegion/dc762efe467f73b816d1c62ec8622d16/cf/35abb0bf6e484acaaf323af1589ddfd6, entries=47, sequenceid=6, filesize=8.0 K 2023-07-24 23:07:28,121 INFO [rs(jenkins-hbase4.apache.org,39595,1690239969801)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for dc762efe467f73b816d1c62ec8622d16 in 37ms, sequenceid=6, compaction requested=false 2023-07-24 23:07:28,121 DEBUG [rs(jenkins-hbase4.apache.org,39595,1690239969801)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion' 2023-07-24 23:07:28,121 DEBUG [rs(jenkins-hbase4.apache.org,39595,1690239969801)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for dc762efe467f73b816d1c62ec8622d16: 2023-07-24 23:07:28,122 DEBUG [rs(jenkins-hbase4.apache.org,39595,1690239969801)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1690240046827.dc762efe467f73b816d1c62ec8622d16.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:28,122 DEBUG [rs(jenkins-hbase4.apache.org,39595,1690239969801)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 23:07:28,122 DEBUG [rs(jenkins-hbase4.apache.org,39595,1690239969801)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/default/testtb-testExportFileSystemStateWithMergeRegion/dc762efe467f73b816d1c62ec8622d16/cf/35abb0bf6e484acaaf323af1589ddfd6] hfiles 2023-07-24 23:07:28,122 DEBUG [rs(jenkins-hbase4.apache.org,39595,1690239969801)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/default/testtb-testExportFileSystemStateWithMergeRegion/dc762efe467f73b816d1c62ec8622d16/cf/35abb0bf6e484acaaf323af1589ddfd6 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:28,122 INFO [rs(jenkins-hbase4.apache.org,33227,1690239969957)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/default/testtb-testExportFileSystemStateWithMergeRegion/82dd5d7cd9e029d7b4514b27ba0319dd/cf/183254f2d24b43b3aaacca12ebe6032d, entries=3, sequenceid=6, filesize=5.0 K 2023-07-24 23:07:28,123 INFO [rs(jenkins-hbase4.apache.org,33227,1690239969957)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for 82dd5d7cd9e029d7b4514b27ba0319dd in 39ms, sequenceid=6, compaction requested=false 2023-07-24 23:07:28,124 DEBUG [rs(jenkins-hbase4.apache.org,33227,1690239969957)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 82dd5d7cd9e029d7b4514b27ba0319dd: 2023-07-24 23:07:28,125 DEBUG [rs(jenkins-hbase4.apache.org,33227,1690239969957)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1690240046827.82dd5d7cd9e029d7b4514b27ba0319dd.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:28,125 DEBUG [rs(jenkins-hbase4.apache.org,33227,1690239969957)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 23:07:28,125 DEBUG [rs(jenkins-hbase4.apache.org,33227,1690239969957)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/default/testtb-testExportFileSystemStateWithMergeRegion/82dd5d7cd9e029d7b4514b27ba0319dd/cf/183254f2d24b43b3aaacca12ebe6032d] hfiles 2023-07-24 23:07:28,125 DEBUG [rs(jenkins-hbase4.apache.org,33227,1690239969957)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/default/testtb-testExportFileSystemStateWithMergeRegion/82dd5d7cd9e029d7b4514b27ba0319dd/cf/183254f2d24b43b3aaacca12ebe6032d for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:28,133 DEBUG [rs(jenkins-hbase4.apache.org,39595,1690239969801)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1690240046827.dc762efe467f73b816d1c62ec8622d16. completed. 2023-07-24 23:07:28,133 DEBUG [rs(jenkins-hbase4.apache.org,39595,1690239969801)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1690240046827.dc762efe467f73b816d1c62ec8622d16. 2023-07-24 23:07:28,133 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1690239969801' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 23:07:28,134 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1690239969801' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 23:07:28,134 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1690239969801' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39595,1690239969801 2023-07-24 23:07:28,134 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1690239969801' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-24 23:07:28,134 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1690239969801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,39595,1690239969801' in zk 2023-07-24 23:07:28,135 DEBUG [rs(jenkins-hbase4.apache.org,33227,1690239969957)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1690240046827.82dd5d7cd9e029d7b4514b27ba0319dd. completed. 2023-07-24 23:07:28,135 DEBUG [rs(jenkins-hbase4.apache.org,33227,1690239969957)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1690240046827.82dd5d7cd9e029d7b4514b27ba0319dd. 2023-07-24 23:07:28,135 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 23:07:28,135 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 23:07:28,135 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:07:28,135 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-24 23:07:28,135 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,33227,1690239969957' in zk 2023-07-24 23:07:28,141 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1690239969801' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-24 23:07:28,141 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39595,1690239969801 2023-07-24 23:07:28,141 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1690239969801' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 23:07:28,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39595,1690239969801 2023-07-24 23:07:28,141 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1690239969801' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-24 23:07:28,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 23:07:28,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 23:07:28,143 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-24 23:07:28,143 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:07:28,143 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 23:07:28,143 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-24 23:07:28,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 23:07:28,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 23:07:28,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:28,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:07:28,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39013,1690239969874 2023-07-24 23:07:28,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39595,1690239969801 2023-07-24 23:07:28,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 23:07:28,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:28,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:07:28,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39013,1690239969874 2023-07-24 23:07:28,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39595,1690239969801 2023-07-24 23:07:28,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,39595,1690239969801': 2023-07-24 23:07:28,149 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39595,1690239969801' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-07-24 23:07:28,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:07:28,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 23:07:28,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 23:07:28,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 23:07:28,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 23:07:28,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:28,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:07:28,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39013,1690239969874 2023-07-24 23:07:28,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39595,1690239969801 2023-07-24 23:07:28,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 23:07:28,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:28,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:07:28,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39013,1690239969874 2023-07-24 23:07:28,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39595,1690239969801 2023-07-24 23:07:28,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,33227,1690239969957': 2023-07-24 23:07:28,155 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33227,1690239969957' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-07-24 23:07:28,155 INFO [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-07-24 23:07:28,155 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-24 23:07:28,155 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-24 23:07:28,155 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:28,155 INFO [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-24 23:07:28,168 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:39013-0x1019995a36f0002, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:28,168 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:33227-0x1019995a36f0003, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:28,168 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:28,168 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:28,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:28,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 23:07:28,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 23:07:28,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:28,168 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:33227-0x1019995a36f0003, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 23:07:28,168 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:28,168 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:39013-0x1019995a36f0002, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 23:07:28,168 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:39595-0x1019995a36f0001, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:28,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:28,168 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:28,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:28,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 23:07:28,168 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:39595-0x1019995a36f0001, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 23:07:28,168 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:07:28,168 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 23:07:28,169 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 23:07:28,169 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 23:07:28,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 23:07:28,169 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39013,1690239969874 2023-07-24 23:07:28,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:28,170 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39595,1690239969801 2023-07-24 23:07:28,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 23:07:28,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:28,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 23:07:28,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 23:07:28,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:28,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:28,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:28,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:07:28,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39013,1690239969874 2023-07-24 23:07:28,172 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:07:28,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39595,1690239969801 2023-07-24 23:07:28,172 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39013,1690239969874 2023-07-24 23:07:28,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 23:07:28,173 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39595,1690239969801 2023-07-24 23:07:28,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:28,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:07:28,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39013,1690239969874 2023-07-24 23:07:28,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39595,1690239969801 2023-07-24 23:07:28,177 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39595,1690239969801 2023-07-24 23:07:28,177 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:39595-0x1019995a36f0001, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 23:07:28,177 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:39595-0x1019995a36f0001, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 23:07:28,177 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 23:07:28,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 23:07:28,177 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:28,177 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39013,1690239969874 2023-07-24 23:07:28,177 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:07:28,177 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:28,177 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39595,1690239969801 2023-07-24 23:07:28,177 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:28,177 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39013,1690239969874 2023-07-24 23:07:28,178 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:07:28,178 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:28,178 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:28,177 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:33227-0x1019995a36f0003, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 23:07:28,178 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:33227-0x1019995a36f0003, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 23:07:28,178 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 23:07:28,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 23:07:28,179 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 23:07:28,179 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:28,179 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:28,180 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:39013-0x1019995a36f0002, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 23:07:28,180 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:39013-0x1019995a36f0002, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 23:07:28,182 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 23:07:28,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 23:07:28,182 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:28,182 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 23:07:28,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 23:07:28,183 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 23:07:28,183 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 23:07:28,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 23:07:28,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 23:07:28,210 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:28,271 DEBUG [Listener at jenkins-hbase4.apache.org/43617] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 23:07:28,272 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-24 23:07:28,272 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-24 23:07:28,272 DEBUG [Listener at jenkins-hbase4.apache.org/43617] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-24 23:07:28,294 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-07-24 23:07:28,294 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:28,294 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:28,294 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1690240047967Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1690240048179 (+212 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion at 1690240048179Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion at 1690240048186 (+7 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1690240048199 (+13 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1690240048294 (+95 ms) 2023-07-24 23:07:28,298 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=65, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-24 23:07:28,300 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=65, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 330 msec 2023-07-24 23:07:28,573 DEBUG [Listener at jenkins-hbase4.apache.org/43617] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 23:07:28,576 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-24 23:07:28,576 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-24 23:07:28,614 DEBUG [Listener at jenkins-hbase4.apache.org/43617] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-24 23:07:28,623 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52860, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-24 23:07:28,625 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33227] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-24 23:07:28,626 DEBUG [Listener at jenkins-hbase4.apache.org/43617] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-24 23:07:28,629 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47812, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-24 23:07:28,629 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39013] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-24 23:07:28,630 DEBUG [Listener at jenkins-hbase4.apache.org/43617] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-24 23:07:28,636 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33522, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-24 23:07:28,637 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39595] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-24 23:07:28,641 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-24 23:07:28,649 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] procedure2.ProcedureExecutor(1029): Stored pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 23:07:28,655 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_PRE_OPERATION 2023-07-24 23:07:28,655 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion-1" procId is: 66 2023-07-24 23:07:28,656 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-24 23:07:28,656 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-24 23:07:28,663 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6742985cd160e2fa2ac8bf4d554b8822 2023-07-24 23:07:28,664 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8a1866c88e05658d9bf1313d31d7a57c 2023-07-24 23:07:28,664 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6742985cd160e2fa2ac8bf4d554b8822 empty. 2023-07-24 23:07:28,665 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8a1866c88e05658d9bf1313d31d7a57c empty. 2023-07-24 23:07:28,665 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6742985cd160e2fa2ac8bf4d554b8822 2023-07-24 23:07:28,666 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8a1866c88e05658d9bf1313d31d7a57c 2023-07-24 23:07:28,666 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-07-24 23:07:28,690 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/.tabledesc/.tableinfo.0000000001 2023-07-24 23:07:28,693 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(7675): creating {ENCODED => 6742985cd160e2fa2ac8bf4d554b8822, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1690240048641.6742985cd160e2fa2ac8bf4d554b8822.', STARTKEY => '', ENDKEY => '2'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.tmp 2023-07-24 23:07:28,693 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(7675): creating {ENCODED => 8a1866c88e05658d9bf1313d31d7a57c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1690240048641.8a1866c88e05658d9bf1313d31d7a57c.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.tmp 2023-07-24 23:07:28,740 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1690240048641.6742985cd160e2fa2ac8bf4d554b8822.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 23:07:28,746 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1604): Closing 6742985cd160e2fa2ac8bf4d554b8822, disabling compactions & flushes 2023-07-24 23:07:28,746 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1690240048641.6742985cd160e2fa2ac8bf4d554b8822. 2023-07-24 23:07:28,746 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1690240048641.6742985cd160e2fa2ac8bf4d554b8822. 2023-07-24 23:07:28,746 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1690240048641.6742985cd160e2fa2ac8bf4d554b8822. after waiting 0 ms 2023-07-24 23:07:28,746 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1690240048641.6742985cd160e2fa2ac8bf4d554b8822. 2023-07-24 23:07:28,746 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1690240048641.6742985cd160e2fa2ac8bf4d554b8822. 2023-07-24 23:07:28,746 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1558): Region close journal for 6742985cd160e2fa2ac8bf4d554b8822: 2023-07-24 23:07:28,758 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-24 23:07:28,763 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1690240048641.8a1866c88e05658d9bf1313d31d7a57c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 23:07:28,763 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1604): Closing 8a1866c88e05658d9bf1313d31d7a57c, disabling compactions & flushes 2023-07-24 23:07:28,763 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1690240048641.8a1866c88e05658d9bf1313d31d7a57c. 2023-07-24 23:07:28,763 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1690240048641.8a1866c88e05658d9bf1313d31d7a57c. 2023-07-24 23:07:28,763 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1690240048641.8a1866c88e05658d9bf1313d31d7a57c. after waiting 0 ms 2023-07-24 23:07:28,763 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1690240048641.8a1866c88e05658d9bf1313d31d7a57c. 2023-07-24 23:07:28,763 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1690240048641.8a1866c88e05658d9bf1313d31d7a57c. 2023-07-24 23:07:28,763 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1558): Region close journal for 8a1866c88e05658d9bf1313d31d7a57c: 2023-07-24 23:07:28,766 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ADD_TO_META 2023-07-24 23:07:28,767 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690240048641.6742985cd160e2fa2ac8bf4d554b8822.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690240048767"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690240048767"}]},"ts":"1690240048767"} 2023-07-24 23:07:28,767 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1690240048641.8a1866c88e05658d9bf1313d31d7a57c.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690240048767"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690240048767"}]},"ts":"1690240048767"} 2023-07-24 23:07:28,771 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-24 23:07:28,772 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-24 23:07:28,772 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690240048772"}]},"ts":"1690240048772"} 2023-07-24 23:07:28,774 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLING in hbase:meta 2023-07-24 23:07:28,788 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-24 23:07:28,790 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-24 23:07:28,790 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-24 23:07:28,790 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-24 23:07:28,790 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-24 23:07:28,790 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=6742985cd160e2fa2ac8bf4d554b8822, ASSIGN}, {pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=8a1866c88e05658d9bf1313d31d7a57c, ASSIGN}] 2023-07-24 23:07:28,794 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=8a1866c88e05658d9bf1313d31d7a57c, ASSIGN 2023-07-24 23:07:28,796 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=8a1866c88e05658d9bf1313d31d7a57c, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39013,1690239969874; forceNewPlan=false, retain=false 2023-07-24 23:07:28,798 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=6742985cd160e2fa2ac8bf4d554b8822, ASSIGN 2023-07-24 23:07:28,801 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=6742985cd160e2fa2ac8bf4d554b8822, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33227,1690239969957; forceNewPlan=false, retain=false 2023-07-24 23:07:28,946 INFO [jenkins-hbase4:37213] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-24 23:07:28,949 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=8a1866c88e05658d9bf1313d31d7a57c, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39013,1690239969874 2023-07-24 23:07:28,949 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=6742985cd160e2fa2ac8bf4d554b8822, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:07:28,949 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1690240048641.8a1866c88e05658d9bf1313d31d7a57c.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690240048949"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690240048949"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690240048949"}]},"ts":"1690240048949"} 2023-07-24 23:07:28,950 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690240048641.6742985cd160e2fa2ac8bf4d554b8822.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690240048949"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690240048949"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690240048949"}]},"ts":"1690240048949"} 2023-07-24 23:07:28,952 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=69, ppid=67, state=RUNNABLE; OpenRegionProcedure 6742985cd160e2fa2ac8bf4d554b8822, server=jenkins-hbase4.apache.org,33227,1690239969957}] 2023-07-24 23:07:28,953 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=70, ppid=68, state=RUNNABLE; OpenRegionProcedure 8a1866c88e05658d9bf1313d31d7a57c, server=jenkins-hbase4.apache.org,39013,1690239969874}] 2023-07-24 23:07:28,964 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-24 23:07:29,111 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1690240048641.6742985cd160e2fa2ac8bf4d554b8822. 2023-07-24 23:07:29,111 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 6742985cd160e2fa2ac8bf4d554b8822, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1690240048641.6742985cd160e2fa2ac8bf4d554b8822.', STARTKEY => '', ENDKEY => '2'} 2023-07-24 23:07:29,111 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,2,1690240048641.8a1866c88e05658d9bf1313d31d7a57c. 2023-07-24 23:07:29,111 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 8a1866c88e05658d9bf1313d31d7a57c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1690240048641.8a1866c88e05658d9bf1313d31d7a57c.', STARTKEY => '2', ENDKEY => ''} 2023-07-24 23:07:29,112 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1690240048641.6742985cd160e2fa2ac8bf4d554b8822. service=AccessControlService 2023-07-24 23:07:29,112 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,2,1690240048641.8a1866c88e05658d9bf1313d31d7a57c. service=AccessControlService 2023-07-24 23:07:29,112 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 23:07:29,112 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 23:07:29,112 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 8a1866c88e05658d9bf1313d31d7a57c 2023-07-24 23:07:29,112 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 6742985cd160e2fa2ac8bf4d554b8822 2023-07-24 23:07:29,112 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1690240048641.8a1866c88e05658d9bf1313d31d7a57c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 23:07:29,112 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1690240048641.6742985cd160e2fa2ac8bf4d554b8822.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 23:07:29,112 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 8a1866c88e05658d9bf1313d31d7a57c 2023-07-24 23:07:29,112 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 6742985cd160e2fa2ac8bf4d554b8822 2023-07-24 23:07:29,112 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 8a1866c88e05658d9bf1313d31d7a57c 2023-07-24 23:07:29,113 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 6742985cd160e2fa2ac8bf4d554b8822 2023-07-24 23:07:29,118 INFO [StoreOpener-8a1866c88e05658d9bf1313d31d7a57c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 8a1866c88e05658d9bf1313d31d7a57c 2023-07-24 23:07:29,118 INFO [StoreOpener-6742985cd160e2fa2ac8bf4d554b8822-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 6742985cd160e2fa2ac8bf4d554b8822 2023-07-24 23:07:29,119 DEBUG [StoreOpener-8a1866c88e05658d9bf1313d31d7a57c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8a1866c88e05658d9bf1313d31d7a57c/cf 2023-07-24 23:07:29,119 DEBUG [StoreOpener-6742985cd160e2fa2ac8bf4d554b8822-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6742985cd160e2fa2ac8bf4d554b8822/cf 2023-07-24 23:07:29,119 DEBUG [StoreOpener-8a1866c88e05658d9bf1313d31d7a57c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8a1866c88e05658d9bf1313d31d7a57c/cf 2023-07-24 23:07:29,119 DEBUG [StoreOpener-6742985cd160e2fa2ac8bf4d554b8822-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6742985cd160e2fa2ac8bf4d554b8822/cf 2023-07-24 23:07:29,120 INFO [StoreOpener-6742985cd160e2fa2ac8bf4d554b8822-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6742985cd160e2fa2ac8bf4d554b8822 columnFamilyName cf 2023-07-24 23:07:29,120 INFO [StoreOpener-8a1866c88e05658d9bf1313d31d7a57c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8a1866c88e05658d9bf1313d31d7a57c columnFamilyName cf 2023-07-24 23:07:29,120 INFO [StoreOpener-8a1866c88e05658d9bf1313d31d7a57c-1] regionserver.HStore(310): Store=8a1866c88e05658d9bf1313d31d7a57c/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 23:07:29,120 INFO [StoreOpener-6742985cd160e2fa2ac8bf4d554b8822-1] regionserver.HStore(310): Store=6742985cd160e2fa2ac8bf4d554b8822/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 23:07:29,121 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8a1866c88e05658d9bf1313d31d7a57c 2023-07-24 23:07:29,121 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6742985cd160e2fa2ac8bf4d554b8822 2023-07-24 23:07:29,121 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8a1866c88e05658d9bf1313d31d7a57c 2023-07-24 23:07:29,122 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6742985cd160e2fa2ac8bf4d554b8822 2023-07-24 23:07:29,124 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 8a1866c88e05658d9bf1313d31d7a57c 2023-07-24 23:07:29,124 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 6742985cd160e2fa2ac8bf4d554b8822 2023-07-24 23:07:29,126 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8a1866c88e05658d9bf1313d31d7a57c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-24 23:07:29,126 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6742985cd160e2fa2ac8bf4d554b8822/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-24 23:07:29,127 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 8a1866c88e05658d9bf1313d31d7a57c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74566636, jitterRate=0.11112946271896362}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-24 23:07:29,127 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 8a1866c88e05658d9bf1313d31d7a57c: 2023-07-24 23:07:29,127 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 6742985cd160e2fa2ac8bf4d554b8822; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72715746, jitterRate=0.08354905247688293}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-24 23:07:29,127 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 6742985cd160e2fa2ac8bf4d554b8822: 2023-07-24 23:07:29,128 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1690240048641.6742985cd160e2fa2ac8bf4d554b8822., pid=69, masterSystemTime=1690240049105 2023-07-24 23:07:29,130 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,2,1690240048641.8a1866c88e05658d9bf1313d31d7a57c., pid=70, masterSystemTime=1690240049105 2023-07-24 23:07:29,170 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1690240048641.6742985cd160e2fa2ac8bf4d554b8822. 2023-07-24 23:07:29,170 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1690240048641.6742985cd160e2fa2ac8bf4d554b8822. 2023-07-24 23:07:29,171 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=6742985cd160e2fa2ac8bf4d554b8822, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:07:29,171 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690240048641.6742985cd160e2fa2ac8bf4d554b8822.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690240049171"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690240049171"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690240049171"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690240049171"}]},"ts":"1690240049171"} 2023-07-24 23:07:29,171 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,2,1690240048641.8a1866c88e05658d9bf1313d31d7a57c. 2023-07-24 23:07:29,171 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,2,1690240048641.8a1866c88e05658d9bf1313d31d7a57c. 2023-07-24 23:07:29,172 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=8a1866c88e05658d9bf1313d31d7a57c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39013,1690239969874 2023-07-24 23:07:29,172 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1690240048641.8a1866c88e05658d9bf1313d31d7a57c.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690240049172"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690240049172"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690240049172"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690240049172"}]},"ts":"1690240049172"} 2023-07-24 23:07:29,174 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=69, resume processing ppid=67 2023-07-24 23:07:29,175 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=69, ppid=67, state=SUCCESS; OpenRegionProcedure 6742985cd160e2fa2ac8bf4d554b8822, server=jenkins-hbase4.apache.org,33227,1690239969957 in 221 msec 2023-07-24 23:07:29,176 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=70, resume processing ppid=68 2023-07-24 23:07:29,176 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=70, ppid=68, state=SUCCESS; OpenRegionProcedure 8a1866c88e05658d9bf1313d31d7a57c, server=jenkins-hbase4.apache.org,39013,1690239969874 in 221 msec 2023-07-24 23:07:29,178 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=6742985cd160e2fa2ac8bf4d554b8822, ASSIGN in 385 msec 2023-07-24 23:07:29,179 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=68, resume processing ppid=66 2023-07-24 23:07:29,179 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=68, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=8a1866c88e05658d9bf1313d31d7a57c, ASSIGN in 386 msec 2023-07-24 23:07:29,180 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-24 23:07:29,180 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690240049180"}]},"ts":"1690240049180"} 2023-07-24 23:07:29,181 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLED in hbase:meta 2023-07-24 23:07:29,254 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_POST_OPERATION 2023-07-24 23:07:29,255 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion-1 jenkins: RWXCA 2023-07-24 23:07:29,257 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33227] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-07-24 23:07:29,265 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-24 23:07:29,315 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:39013-0x1019995a36f0002, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 23:07:29,315 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:33227-0x1019995a36f0003, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 23:07:29,315 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:39595-0x1019995a36f0001, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 23:07:29,315 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 23:07:29,385 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-24 23:07:29,385 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-24 23:07:29,385 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-24 23:07:29,385 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-24 23:07:29,385 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-24 23:07:29,385 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-24 23:07:29,385 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-24 23:07:29,385 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-24 23:07:29,393 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=66, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 743 msec 2023-07-24 23:07:29,767 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-24 23:07:29,767 INFO [Listener at jenkins-hbase4.apache.org/43617] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 66 completed 2023-07-24 23:07:29,858 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] master.HMaster$2(1952): Client=jenkins//172.31.14.131 merge regions 6742985cd160e2fa2ac8bf4d554b8822, 8a1866c88e05658d9bf1313d31d7a57c 2023-07-24 23:07:29,868 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] procedure2.ProcedureExecutor(1029): Stored pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[6742985cd160e2fa2ac8bf4d554b8822, 8a1866c88e05658d9bf1313d31d7a57c], force=true 2023-07-24 23:07:29,870 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[6742985cd160e2fa2ac8bf4d554b8822, 8a1866c88e05658d9bf1313d31d7a57c], force=true 2023-07-24 23:07:29,870 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[6742985cd160e2fa2ac8bf4d554b8822, 8a1866c88e05658d9bf1313d31d7a57c], force=true 2023-07-24 23:07:29,870 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[6742985cd160e2fa2ac8bf4d554b8822, 8a1866c88e05658d9bf1313d31d7a57c], force=true 2023-07-24 23:07:29,874 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-24 23:07:29,897 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=6742985cd160e2fa2ac8bf4d554b8822, UNASSIGN}, {pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=8a1866c88e05658d9bf1313d31d7a57c, UNASSIGN}] 2023-07-24 23:07:29,899 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=6742985cd160e2fa2ac8bf4d554b8822, UNASSIGN 2023-07-24 23:07:29,899 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=8a1866c88e05658d9bf1313d31d7a57c, UNASSIGN 2023-07-24 23:07:29,900 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=8a1866c88e05658d9bf1313d31d7a57c, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39013,1690239969874 2023-07-24 23:07:29,900 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=6742985cd160e2fa2ac8bf4d554b8822, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:07:29,900 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1690240048641.8a1866c88e05658d9bf1313d31d7a57c.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690240049900"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690240049900"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690240049900"}]},"ts":"1690240049900"} 2023-07-24 23:07:29,900 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690240048641.6742985cd160e2fa2ac8bf4d554b8822.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690240049900"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690240049900"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690240049900"}]},"ts":"1690240049900"} 2023-07-24 23:07:29,902 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=74, ppid=73, state=RUNNABLE; CloseRegionProcedure 8a1866c88e05658d9bf1313d31d7a57c, server=jenkins-hbase4.apache.org,39013,1690239969874}] 2023-07-24 23:07:29,903 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=75, ppid=72, state=RUNNABLE; CloseRegionProcedure 6742985cd160e2fa2ac8bf4d554b8822, server=jenkins-hbase4.apache.org,33227,1690239969957}] 2023-07-24 23:07:29,975 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-24 23:07:30,054 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 8a1866c88e05658d9bf1313d31d7a57c 2023-07-24 23:07:30,056 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 8a1866c88e05658d9bf1313d31d7a57c, disabling compactions & flushes 2023-07-24 23:07:30,056 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1690240048641.8a1866c88e05658d9bf1313d31d7a57c. 2023-07-24 23:07:30,056 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1690240048641.8a1866c88e05658d9bf1313d31d7a57c. 2023-07-24 23:07:30,057 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1690240048641.8a1866c88e05658d9bf1313d31d7a57c. after waiting 0 ms 2023-07-24 23:07:30,057 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1690240048641.8a1866c88e05658d9bf1313d31d7a57c. 2023-07-24 23:07:30,057 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 8a1866c88e05658d9bf1313d31d7a57c 1/1 column families, dataSize=24 B heapSize=352 B 2023-07-24 23:07:30,057 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 6742985cd160e2fa2ac8bf4d554b8822 2023-07-24 23:07:30,058 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 6742985cd160e2fa2ac8bf4d554b8822, disabling compactions & flushes 2023-07-24 23:07:30,058 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1690240048641.6742985cd160e2fa2ac8bf4d554b8822. 2023-07-24 23:07:30,058 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1690240048641.6742985cd160e2fa2ac8bf4d554b8822. 2023-07-24 23:07:30,058 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1690240048641.6742985cd160e2fa2ac8bf4d554b8822. after waiting 0 ms 2023-07-24 23:07:30,058 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1690240048641.6742985cd160e2fa2ac8bf4d554b8822. 2023-07-24 23:07:30,059 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 6742985cd160e2fa2ac8bf4d554b8822 1/1 column families, dataSize=24 B heapSize=352 B 2023-07-24 23:07:30,093 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8a1866c88e05658d9bf1313d31d7a57c/.tmp/cf/0c12f731d52e4b8c872b2d41d2fea915 2023-07-24 23:07:30,094 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6742985cd160e2fa2ac8bf4d554b8822/.tmp/cf/be6f10b1be4341dbb7b0ffa32ed8c101 2023-07-24 23:07:30,102 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6742985cd160e2fa2ac8bf4d554b8822/.tmp/cf/be6f10b1be4341dbb7b0ffa32ed8c101 as hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6742985cd160e2fa2ac8bf4d554b8822/cf/be6f10b1be4341dbb7b0ffa32ed8c101 2023-07-24 23:07:30,102 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8a1866c88e05658d9bf1313d31d7a57c/.tmp/cf/0c12f731d52e4b8c872b2d41d2fea915 as hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8a1866c88e05658d9bf1313d31d7a57c/cf/0c12f731d52e4b8c872b2d41d2fea915 2023-07-24 23:07:30,109 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8a1866c88e05658d9bf1313d31d7a57c/cf/0c12f731d52e4b8c872b2d41d2fea915, entries=1, sequenceid=5, filesize=4.7 K 2023-07-24 23:07:30,111 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for 8a1866c88e05658d9bf1313d31d7a57c in 54ms, sequenceid=5, compaction requested=false 2023-07-24 23:07:30,111 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion-1' 2023-07-24 23:07:30,111 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6742985cd160e2fa2ac8bf4d554b8822/cf/be6f10b1be4341dbb7b0ffa32ed8c101, entries=1, sequenceid=5, filesize=4.7 K 2023-07-24 23:07:30,112 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for 6742985cd160e2fa2ac8bf4d554b8822 in 53ms, sequenceid=5, compaction requested=false 2023-07-24 23:07:30,130 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6742985cd160e2fa2ac8bf4d554b8822/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-24 23:07:30,130 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8a1866c88e05658d9bf1313d31d7a57c/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-24 23:07:30,131 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 23:07:30,131 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 23:07:30,131 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1690240048641.6742985cd160e2fa2ac8bf4d554b8822. 2023-07-24 23:07:30,131 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1690240048641.8a1866c88e05658d9bf1313d31d7a57c. 2023-07-24 23:07:30,131 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 6742985cd160e2fa2ac8bf4d554b8822: 2023-07-24 23:07:30,131 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 8a1866c88e05658d9bf1313d31d7a57c: 2023-07-24 23:07:30,133 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 8a1866c88e05658d9bf1313d31d7a57c 2023-07-24 23:07:30,133 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=8a1866c88e05658d9bf1313d31d7a57c, regionState=CLOSED 2023-07-24 23:07:30,133 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 6742985cd160e2fa2ac8bf4d554b8822 2023-07-24 23:07:30,133 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1690240048641.8a1866c88e05658d9bf1313d31d7a57c.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690240050133"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690240050133"}]},"ts":"1690240050133"} 2023-07-24 23:07:30,134 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=6742985cd160e2fa2ac8bf4d554b8822, regionState=CLOSED 2023-07-24 23:07:30,134 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690240048641.6742985cd160e2fa2ac8bf4d554b8822.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690240050134"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690240050134"}]},"ts":"1690240050134"} 2023-07-24 23:07:30,147 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=74, resume processing ppid=73 2023-07-24 23:07:30,147 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=74, ppid=73, state=SUCCESS; CloseRegionProcedure 8a1866c88e05658d9bf1313d31d7a57c, server=jenkins-hbase4.apache.org,39013,1690239969874 in 233 msec 2023-07-24 23:07:30,148 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=75, resume processing ppid=72 2023-07-24 23:07:30,148 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=75, ppid=72, state=SUCCESS; CloseRegionProcedure 6742985cd160e2fa2ac8bf4d554b8822, server=jenkins-hbase4.apache.org,33227,1690239969957 in 233 msec 2023-07-24 23:07:30,151 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=73, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=8a1866c88e05658d9bf1313d31d7a57c, UNASSIGN in 251 msec 2023-07-24 23:07:30,152 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=72, resume processing ppid=71 2023-07-24 23:07:30,152 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=6742985cd160e2fa2ac8bf4d554b8822, UNASSIGN in 255 msec 2023-07-24 23:07:30,177 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-24 23:07:30,218 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/062897a606bb8da4b95ee21c187a9eb2/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=-1 2023-07-24 23:07:30,220 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690240048641.6742985cd160e2fa2ac8bf4d554b8822.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-24 23:07:30,220 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1690240048641.8a1866c88e05658d9bf1313d31d7a57c.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-24 23:07:30,220 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":7,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690240048642.062897a606bb8da4b95ee21c187a9eb2.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0000","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0001","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-24 23:07:30,312 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=062897a606bb8da4b95ee21c187a9eb2, ASSIGN}] 2023-07-24 23:07:30,314 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=062897a606bb8da4b95ee21c187a9eb2, ASSIGN 2023-07-24 23:07:30,315 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=062897a606bb8da4b95ee21c187a9eb2, ASSIGN; state=MERGED, location=jenkins-hbase4.apache.org,33227,1690239969957; forceNewPlan=false, retain=false 2023-07-24 23:07:30,465 INFO [jenkins-hbase4:37213] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-24 23:07:30,467 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=062897a606bb8da4b95ee21c187a9eb2, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:07:30,468 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690240048642.062897a606bb8da4b95ee21c187a9eb2.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1690240050467"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690240050467"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690240050467"}]},"ts":"1690240050467"} 2023-07-24 23:07:30,474 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; OpenRegionProcedure 062897a606bb8da4b95ee21c187a9eb2, server=jenkins-hbase4.apache.org,33227,1690239969957}] 2023-07-24 23:07:30,478 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-24 23:07:30,632 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1690240048642.062897a606bb8da4b95ee21c187a9eb2. 2023-07-24 23:07:30,632 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 062897a606bb8da4b95ee21c187a9eb2, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1690240048642.062897a606bb8da4b95ee21c187a9eb2.', STARTKEY => '', ENDKEY => ''} 2023-07-24 23:07:30,632 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1690240048642.062897a606bb8da4b95ee21c187a9eb2. service=AccessControlService 2023-07-24 23:07:30,633 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 23:07:30,633 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 062897a606bb8da4b95ee21c187a9eb2 2023-07-24 23:07:30,633 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1690240048642.062897a606bb8da4b95ee21c187a9eb2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 23:07:30,633 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 062897a606bb8da4b95ee21c187a9eb2 2023-07-24 23:07:30,633 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 062897a606bb8da4b95ee21c187a9eb2 2023-07-24 23:07:30,634 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(950): Rewriting .regioninfo file at: hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/062897a606bb8da4b95ee21c187a9eb2/.regioninfo 2023-07-24 23:07:30,644 INFO [StoreOpener-062897a606bb8da4b95ee21c187a9eb2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 062897a606bb8da4b95ee21c187a9eb2 2023-07-24 23:07:30,645 DEBUG [StoreOpener-062897a606bb8da4b95ee21c187a9eb2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/062897a606bb8da4b95ee21c187a9eb2/cf 2023-07-24 23:07:30,645 DEBUG [StoreOpener-062897a606bb8da4b95ee21c187a9eb2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/062897a606bb8da4b95ee21c187a9eb2/cf 2023-07-24 23:07:30,645 INFO [StoreOpener-062897a606bb8da4b95ee21c187a9eb2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 062897a606bb8da4b95ee21c187a9eb2 columnFamilyName cf 2023-07-24 23:07:30,675 DEBUG [StoreOpener-062897a606bb8da4b95ee21c187a9eb2-1] regionserver.HStore(539): loaded hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/062897a606bb8da4b95ee21c187a9eb2/cf/0c12f731d52e4b8c872b2d41d2fea915.8a1866c88e05658d9bf1313d31d7a57c->hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8a1866c88e05658d9bf1313d31d7a57c/cf/0c12f731d52e4b8c872b2d41d2fea915-top 2023-07-24 23:07:30,682 DEBUG [StoreOpener-062897a606bb8da4b95ee21c187a9eb2-1] regionserver.HStore(539): loaded hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/062897a606bb8da4b95ee21c187a9eb2/cf/be6f10b1be4341dbb7b0ffa32ed8c101.6742985cd160e2fa2ac8bf4d554b8822->hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6742985cd160e2fa2ac8bf4d554b8822/cf/be6f10b1be4341dbb7b0ffa32ed8c101-top 2023-07-24 23:07:30,682 INFO [StoreOpener-062897a606bb8da4b95ee21c187a9eb2-1] regionserver.HStore(310): Store=062897a606bb8da4b95ee21c187a9eb2/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 23:07:30,683 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/062897a606bb8da4b95ee21c187a9eb2 2023-07-24 23:07:30,685 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/062897a606bb8da4b95ee21c187a9eb2 2023-07-24 23:07:30,688 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 062897a606bb8da4b95ee21c187a9eb2 2023-07-24 23:07:30,689 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 062897a606bb8da4b95ee21c187a9eb2; next sequenceid=9; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61656311, jitterRate=-0.08124937117099762}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-24 23:07:30,689 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 062897a606bb8da4b95ee21c187a9eb2: 2023-07-24 23:07:30,690 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1690240048642.062897a606bb8da4b95ee21c187a9eb2., pid=77, masterSystemTime=1690240050628 2023-07-24 23:07:30,691 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(328): Ignoring compaction request for testtb-testExportFileSystemStateWithMergeRegion-1,,1690240048642.062897a606bb8da4b95ee21c187a9eb2.,because compaction is disabled. 2023-07-24 23:07:30,692 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1690240048642.062897a606bb8da4b95ee21c187a9eb2. 2023-07-24 23:07:30,692 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1690240048642.062897a606bb8da4b95ee21c187a9eb2. 2023-07-24 23:07:30,693 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=062897a606bb8da4b95ee21c187a9eb2, regionState=OPEN, openSeqNum=9, regionLocation=jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:07:30,693 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690240048642.062897a606bb8da4b95ee21c187a9eb2.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1690240050693"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690240050693"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690240050693"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690240050693"}]},"ts":"1690240050693"} 2023-07-24 23:07:30,696 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=77, resume processing ppid=76 2023-07-24 23:07:30,696 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=77, ppid=76, state=SUCCESS; OpenRegionProcedure 062897a606bb8da4b95ee21c187a9eb2, server=jenkins-hbase4.apache.org,33227,1690239969957 in 220 msec 2023-07-24 23:07:30,697 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=76, resume processing ppid=71 2023-07-24 23:07:30,697 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=76, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=062897a606bb8da4b95ee21c187a9eb2, ASSIGN in 384 msec 2023-07-24 23:07:30,699 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=71, state=SUCCESS; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[6742985cd160e2fa2ac8bf4d554b8822, 8a1866c88e05658d9bf1313d31d7a57c], force=true in 835 msec 2023-07-24 23:07:30,980 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-24 23:07:30,980 INFO [Listener at jenkins-hbase4.apache.org/43617] client.HBaseAdmin$TableFuture(3541): Operation: MERGE_REGIONS, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 71 completed 2023-07-24 23:07:30,981 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-24 23:07:30,981 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690240050981 (current time:1690240050981). 2023-07-24 23:07:30,982 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-24 23:07:30,982 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] zookeeper.ReadOnlyZKClient(139): Connect 0x2afbe281 to 127.0.0.1:52881 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 23:07:31,005 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@36475ab9, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 23:07:31,006 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 23:07:31,010 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44078, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 23:07:31,011 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2afbe281 to 127.0.0.1:52881 2023-07-24 23:07:31,011 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 23:07:31,011 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] zookeeper.ReadOnlyZKClient(139): Connect 0x3285a171 to 127.0.0.1:52881 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 23:07:31,019 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@479fa24a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 23:07:31,023 DEBUG [hconnection-0x4b01ba92-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 23:07:31,036 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44088, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 23:07:31,041 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 23:07:31,062 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35430, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 23:07:31,064 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3285a171 to 127.0.0.1:52881 2023-07-24 23:07:31,064 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 23:07:31,065 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-07-24 23:07:31,065 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-24 23:07:31,066 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-24 23:07:31,076 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] procedure2.ProcedureExecutor(1029): Stored pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-24 23:07:31,078 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-24 23:07:31,083 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=78, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE; timeout=600000, timestamp=1690240651083 2023-07-24 23:07:31,083 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-24 23:07:31,083 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 23:07:31,084 DEBUG [Listener at jenkins-hbase4.apache.org/43617] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-24 23:07:31,084 DEBUG [Listener at jenkins-hbase4.apache.org/43617] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-24 23:07:31,094 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=78, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-24 23:07:31,095 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-24 23:07:31,097 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=78, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE in 19 msec 2023-07-24 23:07:31,098 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-24 23:07:31,099 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=79, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED; timeout=600000, timestamp=1690240651099 2023-07-24 23:07:31,146 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690239977721_0004_000001 (auth:SIMPLE) 2023-07-24 23:07:31,154 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 23:07:31,157 INFO [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' 2023-07-24 23:07:31,157 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 23:07:31,158 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' 2023-07-24 23:07:31,158 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1', kicking off acquire phase on members. 2023-07-24 23:07:31,159 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 23:07:31,159 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 23:07:31,160 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:39013-0x1019995a36f0002, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 23:07:31,160 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:07:31,160 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 23:07:31,160 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:33227-0x1019995a36f0003, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 23:07:31,160 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:39595-0x1019995a36f0001, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 23:07:31,160 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 23:07:31,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 23:07:31,160 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 23:07:31,161 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:07:31,161 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-24 23:07:31,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 23:07:31,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 23:07:31,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 23:07:31,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 23:07:31,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 23:07:31,162 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39013-0x1019995a36f0002, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 23:07:31,162 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39595-0x1019995a36f0001, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 23:07:31,162 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33227-0x1019995a36f0003, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 23:07:31,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-24 23:07:31,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 23:07:31,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-24 23:07:31,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 23:07:31,163 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-24 23:07:31,163 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-24 23:07:31,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-24 23:07:31,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 23:07:31,163 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-24 23:07:31,170 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 23:07:31,170 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 23:07:31,171 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1690239969801' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-24 23:07:31,171 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 23:07:31,171 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-24 23:07:31,171 DEBUG [member: 'jenkins-hbase4.apache.org,39013,1690239969874' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-24 23:07:31,171 DEBUG [member: 'jenkins-hbase4.apache.org,39013,1690239969874' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 23:07:31,171 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1690239969801' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 23:07:31,172 DEBUG [member: 'jenkins-hbase4.apache.org,39013,1690239969874' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-24 23:07:31,171 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 23:07:31,173 DEBUG [member: 'jenkins-hbase4.apache.org,39013,1690239969874' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-24 23:07:31,173 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1690239969801' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-24 23:07:31,174 DEBUG [member: 'jenkins-hbase4.apache.org,39013,1690239969874' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39013,1690239969874' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-24 23:07:31,174 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-24 23:07:31,174 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-24 23:07:31,174 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33227,1690239969957' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-24 23:07:31,174 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1690239969801' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-24 23:07:31,174 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1690239969801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39595,1690239969801' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-24 23:07:31,179 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:07:31,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:07:31,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 23:07:31,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 23:07:31,180 DEBUG [member: 'jenkins-hbase4.apache.org,39013,1690239969874' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 23:07:31,181 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1690239969801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 23:07:31,181 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 23:07:31,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 23:07:31,181 DEBUG [member: 'jenkins-hbase4.apache.org,39013,1690239969874' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39013-0x1019995a36f0002, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 23:07:31,181 DEBUG [member: 'jenkins-hbase4.apache.org,39013,1690239969874' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 23:07:31,181 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1690239969801' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39595-0x1019995a36f0001, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 23:07:31,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 23:07:31,181 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33227-0x1019995a36f0003, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 23:07:31,181 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1690239969801' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 23:07:31,182 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 23:07:31,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 23:07:31,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:07:31,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39013,1690239969874 2023-07-24 23:07:31,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39595,1690239969801 2023-07-24 23:07:31,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 23:07:31,184 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33227,1690239969957' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' on coordinator 2023-07-24 23:07:31,184 DEBUG [Listener at jenkins-hbase4.apache.org/43617] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 23:07:31,184 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'in-barrier' execution. 2023-07-24 23:07:31,184 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 23:07:31,184 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@120961b8[Count = 0] remaining members to acquire global barrier 2023-07-24 23:07:31,185 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-24 23:07:31,185 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' is still in progress! 2023-07-24 23:07:31,186 DEBUG [Listener at jenkins-hbase4.apache.org/43617] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-24 23:07:31,187 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:07:31,187 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-24 23:07:31,188 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:39013-0x1019995a36f0002, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 23:07:31,188 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 23:07:31,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 23:07:31,188 DEBUG [member: 'jenkins-hbase4.apache.org,39013,1690239969874' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-24 23:07:31,188 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:33227-0x1019995a36f0003, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 23:07:31,188 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:39595-0x1019995a36f0001, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 23:07:31,188 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 23:07:31,188 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 23:07:31,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 23:07:31,188 DEBUG [member: 'jenkins-hbase4.apache.org,39013,1690239969874' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-24 23:07:31,188 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1690239969801' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-24 23:07:31,188 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1690239969801' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-24 23:07:31,188 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1690239969801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,39595,1690239969801' in zk 2023-07-24 23:07:31,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 23:07:31,188 DEBUG [member: 'jenkins-hbase4.apache.org,39013,1690239969874' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,39013,1690239969874' in zk 2023-07-24 23:07:31,189 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-24 23:07:31,189 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 23:07:31,189 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 23:07:31,189 DEBUG [rs(jenkins-hbase4.apache.org,33227,1690239969957)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1690240048642.062897a606bb8da4b95ee21c187a9eb2. 2023-07-24 23:07:31,189 DEBUG [rs(jenkins-hbase4.apache.org,33227,1690239969957)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1690240048642.062897a606bb8da4b95ee21c187a9eb2. started... 2023-07-24 23:07:31,191 DEBUG [rs(jenkins-hbase4.apache.org,33227,1690239969957)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 062897a606bb8da4b95ee21c187a9eb2: 2023-07-24 23:07:31,192 DEBUG [member: 'jenkins-hbase4.apache.org,39013,1690239969874' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-24 23:07:31,192 DEBUG [member: 'jenkins-hbase4.apache.org,39013,1690239969874' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 23:07:31,192 DEBUG [rs(jenkins-hbase4.apache.org,33227,1690239969957)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion-1,,1690240048642.062897a606bb8da4b95ee21c187a9eb2.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 23:07:31,193 DEBUG [rs(jenkins-hbase4.apache.org,33227,1690239969957)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 23:07:31,192 DEBUG [member: 'jenkins-hbase4.apache.org,39013,1690239969874' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-24 23:07:31,194 DEBUG [rs(jenkins-hbase4.apache.org,33227,1690239969957)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/062897a606bb8da4b95ee21c187a9eb2/cf/0c12f731d52e4b8c872b2d41d2fea915.8a1866c88e05658d9bf1313d31d7a57c->hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8a1866c88e05658d9bf1313d31d7a57c/cf/0c12f731d52e4b8c872b2d41d2fea915-top, hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/062897a606bb8da4b95ee21c187a9eb2/cf/be6f10b1be4341dbb7b0ffa32ed8c101.6742985cd160e2fa2ac8bf4d554b8822->hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6742985cd160e2fa2ac8bf4d554b8822/cf/be6f10b1be4341dbb7b0ffa32ed8c101-top] hfiles 2023-07-24 23:07:31,194 DEBUG [rs(jenkins-hbase4.apache.org,33227,1690239969957)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/2): hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/062897a606bb8da4b95ee21c187a9eb2/cf/0c12f731d52e4b8c872b2d41d2fea915.8a1866c88e05658d9bf1313d31d7a57c for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 23:07:31,194 DEBUG [rs(jenkins-hbase4.apache.org,33227,1690239969957)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/2): hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/062897a606bb8da4b95ee21c187a9eb2/cf/be6f10b1be4341dbb7b0ffa32ed8c101.6742985cd160e2fa2ac8bf4d554b8822 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 23:07:31,195 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1690239969801' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-24 23:07:31,195 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1690239969801' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 23:07:31,195 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1690239969801' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-24 23:07:31,222 DEBUG [rs(jenkins-hbase4.apache.org,33227,1690239969957)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1690240048642.062897a606bb8da4b95ee21c187a9eb2. completed. 2023-07-24 23:07:31,222 DEBUG [rs(jenkins-hbase4.apache.org,33227,1690239969957)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1690240048642.062897a606bb8da4b95ee21c187a9eb2. 2023-07-24 23:07:31,222 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 23:07:31,222 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 23:07:31,222 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:07:31,223 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-24 23:07:31,223 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,33227,1690239969957' in zk 2023-07-24 23:07:31,231 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-24 23:07:31,231 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 23:07:31,231 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-24 23:07:31,232 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:07:31,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:07:31,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 23:07:31,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 23:07:31,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 23:07:31,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 23:07:31,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 23:07:31,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:07:31,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39013,1690239969874 2023-07-24 23:07:31,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39595,1690239969801 2023-07-24 23:07:31,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 23:07:31,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 23:07:31,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:07:31,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39013,1690239969874 2023-07-24 23:07:31,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39595,1690239969801 2023-07-24 23:07:31,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' member 'jenkins-hbase4.apache.org,33227,1690239969957': 2023-07-24 23:07:31,240 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33227,1690239969957' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion-1', counting down latch. Waiting for 0 more 2023-07-24 23:07:31,240 INFO [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' execution completed 2023-07-24 23:07:31,240 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-24 23:07:31,240 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-24 23:07:31,240 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 23:07:31,240 INFO [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegion-1including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-24 23:07:31,242 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 23:07:31,242 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:39013-0x1019995a36f0002, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 23:07:31,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 23:07:31,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 23:07:31,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 23:07:31,242 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 23:07:31,242 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:39013-0x1019995a36f0002, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 23:07:31,242 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:33227-0x1019995a36f0003, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 23:07:31,242 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:39595-0x1019995a36f0001, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 23:07:31,242 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:33227-0x1019995a36f0003, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 23:07:31,242 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 23:07:31,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 23:07:31,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 23:07:31,242 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 23:07:31,242 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:39595-0x1019995a36f0001, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 23:07:31,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 23:07:31,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 23:07:31,243 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 23:07:31,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 23:07:31,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 23:07:31,243 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 23:07:31,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 23:07:31,244 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:07:31,244 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 23:07:31,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 23:07:31,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 23:07:31,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 23:07:31,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 23:07:31,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 23:07:31,244 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39013,1690239969874 2023-07-24 23:07:31,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 23:07:31,245 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39595,1690239969801 2023-07-24 23:07:31,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:07:31,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39013,1690239969874 2023-07-24 23:07:31,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39595,1690239969801 2023-07-24 23:07:31,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 23:07:31,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 23:07:31,247 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:07:31,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:07:31,247 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39013,1690239969874 2023-07-24 23:07:31,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39013,1690239969874 2023-07-24 23:07:31,248 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39595,1690239969801 2023-07-24 23:07:31,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39595,1690239969801 2023-07-24 23:07:31,251 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39595,1690239969801 2023-07-24 23:07:31,251 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:39013-0x1019995a36f0002, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 23:07:31,251 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:39013-0x1019995a36f0002, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 23:07:31,251 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 23:07:31,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 23:07:31,253 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 23:07:31,254 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 23:07:31,251 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 23:07:31,254 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39013,1690239969874 2023-07-24 23:07:31,254 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:07:31,254 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 23:07:31,254 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39595,1690239969801 2023-07-24 23:07:31,254 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 23:07:31,254 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39013,1690239969874 2023-07-24 23:07:31,254 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:07:31,254 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 23:07:31,254 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 23:07:31,255 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:33227-0x1019995a36f0003, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 23:07:31,255 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:33227-0x1019995a36f0003, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 23:07:31,255 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 23:07:31,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 23:07:31,251 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:39595-0x1019995a36f0001, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 23:07:31,251 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 23:07:31,256 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 23:07:31,256 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:39595-0x1019995a36f0001, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 23:07:31,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 23:07:31,257 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 23:07:31,257 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 23:07:31,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 23:07:31,257 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 23:07:31,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 23:07:31,257 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 23:07:31,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 23:07:31,296 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 23:07:31,334 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed 2023-07-24 23:07:31,334 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 23:07:31,334 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 23:07:31,334 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 at 1690240051083Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1690240051254 (+171 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1690240051254Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1690240051265 (+11 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1690240051283 (+18 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed at 1690240051334 (+51 ms) 2023-07-24 23:07:31,337 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=79, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-24 23:07:31,338 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=79, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED in 244 msec 2023-07-24 23:07:31,386 DEBUG [Listener at jenkins-hbase4.apache.org/43617] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 23:07:31,387 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-24 23:07:31,387 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-24 23:07:31,387 INFO [Listener at jenkins-hbase4.apache.org/43617] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/export-test/export-1690240051387 2023-07-24 23:07:31,387 INFO [Listener at jenkins-hbase4.apache.org/43617] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:37611, tgtDir=hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/export-test/export-1690240051387, rawTgtDir=hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/export-test/export-1690240051387, srcFsUri=hdfs://localhost:37611, srcDir=hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb 2023-07-24 23:07:31,411 DEBUG [Listener at jenkins-hbase4.apache.org/43617] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:37611, inputRoot=hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb 2023-07-24 23:07:31,411 DEBUG [Listener at jenkins-hbase4.apache.org/43617] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1880151673_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/export-test/export-1690240051387, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/export-test/export-1690240051387/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 23:07:31,411 INFO [Listener at jenkins-hbase4.apache.org/43617] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:37611, inputRoot=hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb, snapshotDir=hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1. 2023-07-24 23:07:31,422 INFO [Listener at jenkins-hbase4.apache.org/43617] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/export-test/export-1690240051387/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 23:07:31,467 DEBUG [Listener at jenkins-hbase4.apache.org/43617] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-24 23:07:31,467 DEBUG [Listener at jenkins-hbase4.apache.org/43617] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-24 23:07:31,468 DEBUG [Listener at jenkins-hbase4.apache.org/43617] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-24 23:07:31,468 DEBUG [Listener at jenkins-hbase4.apache.org/43617] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-24 23:07:31,469 DEBUG [Listener at jenkins-hbase4.apache.org/43617] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-24 23:07:31,469 DEBUG [Listener at jenkins-hbase4.apache.org/43617] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-24 23:07:31,470 DEBUG [Listener at jenkins-hbase4.apache.org/43617] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-24 23:07:31,545 DEBUG [Listener at jenkins-hbase4.apache.org/43617] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/40a10de8-ef1a-d60f-e3da-b5fca02ca095/hadoop-956241527135526770.jar 2023-07-24 23:07:31,545 DEBUG [Listener at jenkins-hbase4.apache.org/43617] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-24 23:07:31,546 DEBUG [Listener at jenkins-hbase4.apache.org/43617] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-24 23:07:31,547 DEBUG [Listener at jenkins-hbase4.apache.org/43617] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-24 23:07:31,547 DEBUG [Listener at jenkins-hbase4.apache.org/43617] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-24 23:07:31,548 DEBUG [Listener at jenkins-hbase4.apache.org/43617] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-24 23:07:31,548 DEBUG [Listener at jenkins-hbase4.apache.org/43617] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-24 23:07:31,549 DEBUG [Listener at jenkins-hbase4.apache.org/43617] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-24 23:07:31,550 DEBUG [Listener at jenkins-hbase4.apache.org/43617] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-24 23:07:31,550 DEBUG [Listener at jenkins-hbase4.apache.org/43617] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-24 23:07:31,551 DEBUG [Listener at jenkins-hbase4.apache.org/43617] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-24 23:07:31,551 DEBUG [Listener at jenkins-hbase4.apache.org/43617] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-24 23:07:31,552 DEBUG [Listener at jenkins-hbase4.apache.org/43617] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-24 23:07:31,553 DEBUG [Listener at jenkins-hbase4.apache.org/43617] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-24 23:07:31,553 DEBUG [Listener at jenkins-hbase4.apache.org/43617] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-24 23:07:31,554 DEBUG [Listener at jenkins-hbase4.apache.org/43617] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-24 23:07:31,554 DEBUG [Listener at jenkins-hbase4.apache.org/43617] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-24 23:07:31,555 DEBUG [Listener at jenkins-hbase4.apache.org/43617] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 23:07:31,555 DEBUG [Listener at jenkins-hbase4.apache.org/43617] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 23:07:31,556 DEBUG [Listener at jenkins-hbase4.apache.org/43617] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 23:07:31,556 DEBUG [Listener at jenkins-hbase4.apache.org/43617] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 23:07:31,557 DEBUG [Listener at jenkins-hbase4.apache.org/43617] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 23:07:31,557 DEBUG [Listener at jenkins-hbase4.apache.org/43617] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 23:07:31,558 DEBUG [Listener at jenkins-hbase4.apache.org/43617] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 23:07:32,145 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-24 23:07:33,271 WARN [Listener at jenkins-hbase4.apache.org/43617] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-24 23:07:33,274 INFO [Listener at jenkins-hbase4.apache.org/43617] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithMergeRegion-1' hfile list 2023-07-24 23:07:33,277 DEBUG [Listener at jenkins-hbase4.apache.org/43617] snapshot.ExportSnapshot(671): export split=0 size=9.5 K 2023-07-24 23:07:33,376 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-24 23:07:33,376 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-24 23:07:34,160 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690239977721_0005_000001 (auth:SIMPLE) 2023-07-24 23:07:39,483 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690239977721_0005_000001 (auth:SIMPLE) 2023-07-24 23:07:41,859 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690239977721_0005_000001 (auth:SIMPLE) 2023-07-24 23:07:46,053 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690239977721_0005_000001 (auth:SIMPLE) 2023-07-24 23:07:47,510 INFO [Listener at jenkins-hbase4.apache.org/43617] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-24 23:07:47,510 INFO [Listener at jenkins-hbase4.apache.org/43617] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-24 23:07:47,518 INFO [Listener at jenkins-hbase4.apache.org/43617] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 23:07:47,518 INFO [Listener at jenkins-hbase4.apache.org/43617] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-24 23:07:47,519 INFO [Listener at jenkins-hbase4.apache.org/43617] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-24 23:07:47,519 DEBUG [Listener at jenkins-hbase4.apache.org/43617] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1273988721_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 23:07:47,519 DEBUG [Listener at jenkins-hbase4.apache.org/43617] snapshot.TestExportSnapshot(367): hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-07-24 23:07:47,520 DEBUG [Listener at jenkins-hbase4.apache.org/43617] snapshot.TestExportSnapshot(367): hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-07-24 23:07:47,520 DEBUG [Listener at jenkins-hbase4.apache.org/43617] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1273988721_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/export-test/export-1690240051387/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/export-test/export-1690240051387/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 23:07:47,520 DEBUG [Listener at jenkins-hbase4.apache.org/43617] snapshot.TestExportSnapshot(367): hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/export-test/export-1690240051387/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-07-24 23:07:47,520 DEBUG [Listener at jenkins-hbase4.apache.org/43617] snapshot.TestExportSnapshot(367): hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/export-test/export-1690240051387/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-07-24 23:07:47,527 INFO [Listener at jenkins-hbase4.apache.org/43617] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 23:07:47,528 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 23:07:47,529 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] procedure2.ProcedureExecutor(1029): Stored pid=80, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 23:07:47,532 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690240067532"}]},"ts":"1690240067532"} 2023-07-24 23:07:47,533 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-24 23:07:47,534 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLING in hbase:meta 2023-07-24 23:07:47,537 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLING 2023-07-24 23:07:47,537 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=062897a606bb8da4b95ee21c187a9eb2, UNASSIGN}] 2023-07-24 23:07:47,540 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=062897a606bb8da4b95ee21c187a9eb2, UNASSIGN 2023-07-24 23:07:47,540 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=062897a606bb8da4b95ee21c187a9eb2, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:07:47,540 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690240048642.062897a606bb8da4b95ee21c187a9eb2.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1690240067540"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690240067540"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690240067540"}]},"ts":"1690240067540"} 2023-07-24 23:07:47,542 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=82, ppid=81, state=RUNNABLE; CloseRegionProcedure 062897a606bb8da4b95ee21c187a9eb2, server=jenkins-hbase4.apache.org,33227,1690239969957}] 2023-07-24 23:07:47,634 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-24 23:07:47,695 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 062897a606bb8da4b95ee21c187a9eb2 2023-07-24 23:07:47,695 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 062897a606bb8da4b95ee21c187a9eb2, disabling compactions & flushes 2023-07-24 23:07:47,695 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1690240048642.062897a606bb8da4b95ee21c187a9eb2. 2023-07-24 23:07:47,695 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1690240048642.062897a606bb8da4b95ee21c187a9eb2. 2023-07-24 23:07:47,695 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1690240048642.062897a606bb8da4b95ee21c187a9eb2. after waiting 0 ms 2023-07-24 23:07:47,696 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1690240048642.062897a606bb8da4b95ee21c187a9eb2. 2023-07-24 23:07:47,713 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/062897a606bb8da4b95ee21c187a9eb2/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=8 2023-07-24 23:07:47,714 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 23:07:47,715 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1690240048642.062897a606bb8da4b95ee21c187a9eb2. 2023-07-24 23:07:47,715 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 062897a606bb8da4b95ee21c187a9eb2: 2023-07-24 23:07:47,718 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=062897a606bb8da4b95ee21c187a9eb2, regionState=CLOSED 2023-07-24 23:07:47,718 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690240048642.062897a606bb8da4b95ee21c187a9eb2.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1690240067718"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690240067718"}]},"ts":"1690240067718"} 2023-07-24 23:07:47,722 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 062897a606bb8da4b95ee21c187a9eb2 2023-07-24 23:07:47,728 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=82, resume processing ppid=81 2023-07-24 23:07:47,728 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=82, ppid=81, state=SUCCESS; CloseRegionProcedure 062897a606bb8da4b95ee21c187a9eb2, server=jenkins-hbase4.apache.org,33227,1690239969957 in 181 msec 2023-07-24 23:07:47,731 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=81, resume processing ppid=80 2023-07-24 23:07:47,731 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=81, ppid=80, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=062897a606bb8da4b95ee21c187a9eb2, UNASSIGN in 191 msec 2023-07-24 23:07:47,731 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690240067731"}]},"ts":"1690240067731"} 2023-07-24 23:07:47,733 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLED in hbase:meta 2023-07-24 23:07:47,735 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLED 2023-07-24 23:07:47,743 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=80, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 213 msec 2023-07-24 23:07:47,835 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-24 23:07:47,835 INFO [Listener at jenkins-hbase4.apache.org/43617] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 80 completed 2023-07-24 23:07:47,836 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 23:07:47,837 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] procedure2.ProcedureExecutor(1029): Stored pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 23:07:47,840 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 23:07:47,840 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 23:07:47,841 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=83, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 23:07:47,843 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33227] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 23:07:47,845 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 23:07:47,846 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:39013-0x1019995a36f0002, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 23:07:47,846 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:39595-0x1019995a36f0001, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 23:07:47,846 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:33227-0x1019995a36f0003, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 23:07:47,846 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-24 23:07:47,847 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-24 23:07:47,848 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-24 23:07:47,848 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-24 23:07:47,849 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/062897a606bb8da4b95ee21c187a9eb2 2023-07-24 23:07:47,850 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:39013-0x1019995a36f0002, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 23:07:47,850 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:39013-0x1019995a36f0002, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 23:07:47,850 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-24 23:07:47,849 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:33227-0x1019995a36f0003, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 23:07:47,849 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:39595-0x1019995a36f0001, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 23:07:47,851 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:39595-0x1019995a36f0001, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 23:07:47,849 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 23:07:47,851 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 23:07:47,851 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:33227-0x1019995a36f0003, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 23:07:47,852 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-24 23:07:47,852 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-24 23:07:47,852 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-24 23:07:47,852 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-24 23:07:47,858 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8a1866c88e05658d9bf1313d31d7a57c 2023-07-24 23:07:47,858 DEBUG [HFileArchiver-19] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/062897a606bb8da4b95ee21c187a9eb2/cf, FileablePath, hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/062897a606bb8da4b95ee21c187a9eb2/recovered.edits] 2023-07-24 23:07:47,859 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6742985cd160e2fa2ac8bf4d554b8822 2023-07-24 23:07:47,863 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8a1866c88e05658d9bf1313d31d7a57c/cf, FileablePath, hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8a1866c88e05658d9bf1313d31d7a57c/recovered.edits] 2023-07-24 23:07:47,865 DEBUG [HFileArchiver-20] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6742985cd160e2fa2ac8bf4d554b8822/cf, FileablePath, hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6742985cd160e2fa2ac8bf4d554b8822/recovered.edits] 2023-07-24 23:07:47,870 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/062897a606bb8da4b95ee21c187a9eb2/cf/0c12f731d52e4b8c872b2d41d2fea915.8a1866c88e05658d9bf1313d31d7a57c to hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/062897a606bb8da4b95ee21c187a9eb2/cf/0c12f731d52e4b8c872b2d41d2fea915.8a1866c88e05658d9bf1313d31d7a57c 2023-07-24 23:07:47,875 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8a1866c88e05658d9bf1313d31d7a57c/cf/0c12f731d52e4b8c872b2d41d2fea915 to hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8a1866c88e05658d9bf1313d31d7a57c/cf/0c12f731d52e4b8c872b2d41d2fea915 2023-07-24 23:07:47,882 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/062897a606bb8da4b95ee21c187a9eb2/cf/be6f10b1be4341dbb7b0ffa32ed8c101.6742985cd160e2fa2ac8bf4d554b8822 to hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/062897a606bb8da4b95ee21c187a9eb2/cf/be6f10b1be4341dbb7b0ffa32ed8c101.6742985cd160e2fa2ac8bf4d554b8822 2023-07-24 23:07:47,884 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6742985cd160e2fa2ac8bf4d554b8822/cf/be6f10b1be4341dbb7b0ffa32ed8c101 to hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6742985cd160e2fa2ac8bf4d554b8822/cf/be6f10b1be4341dbb7b0ffa32ed8c101 2023-07-24 23:07:47,884 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8a1866c88e05658d9bf1313d31d7a57c/recovered.edits/8.seqid to hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8a1866c88e05658d9bf1313d31d7a57c/recovered.edits/8.seqid 2023-07-24 23:07:47,887 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8a1866c88e05658d9bf1313d31d7a57c 2023-07-24 23:07:47,892 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6742985cd160e2fa2ac8bf4d554b8822/recovered.edits/8.seqid to hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6742985cd160e2fa2ac8bf4d554b8822/recovered.edits/8.seqid 2023-07-24 23:07:47,893 DEBUG [HFileArchiver-20] backup.HFileArchiver(596): Deleted hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6742985cd160e2fa2ac8bf4d554b8822 2023-07-24 23:07:47,898 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/062897a606bb8da4b95ee21c187a9eb2/recovered.edits/12.seqid to hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/062897a606bb8da4b95ee21c187a9eb2/recovered.edits/12.seqid 2023-07-24 23:07:47,899 DEBUG [HFileArchiver-19] backup.HFileArchiver(596): Deleted hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/062897a606bb8da4b95ee21c187a9eb2 2023-07-24 23:07:47,900 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-07-24 23:07:47,902 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=83, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 23:07:47,908 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testtb-testExportFileSystemStateWithMergeRegion-1 from hbase:meta 2023-07-24 23:07:47,912 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' descriptor. 2023-07-24 23:07:47,914 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=83, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 23:07:47,914 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' from region states. 2023-07-24 23:07:47,914 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690240048642.062897a606bb8da4b95ee21c187a9eb2.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690240067914"}]},"ts":"9223372036854775807"} 2023-07-24 23:07:47,931 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-07-24 23:07:47,931 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 062897a606bb8da4b95ee21c187a9eb2, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1690240048642.062897a606bb8da4b95ee21c187a9eb2.', STARTKEY => '', ENDKEY => ''}] 2023-07-24 23:07:47,931 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion-1' as deleted. 2023-07-24 23:07:47,931 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1690240067931"}]},"ts":"9223372036854775807"} 2023-07-24 23:07:47,946 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion-1 state from META 2023-07-24 23:07:47,948 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=83, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 23:07:47,950 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=83, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 112 msec 2023-07-24 23:07:47,953 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-24 23:07:47,953 INFO [Listener at jenkins-hbase4.apache.org/43617] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 83 completed 2023-07-24 23:07:47,954 INFO [Listener at jenkins-hbase4.apache.org/43617] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:47,954 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:47,955 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] procedure2.ProcedureExecutor(1029): Stored pid=84, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:47,959 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-24 23:07:47,960 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690240067960"}]},"ts":"1690240067960"} 2023-07-24 23:07:47,963 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLING in hbase:meta 2023-07-24 23:07:47,966 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLING 2023-07-24 23:07:47,967 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=82dd5d7cd9e029d7b4514b27ba0319dd, UNASSIGN}, {pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=dc762efe467f73b816d1c62ec8622d16, UNASSIGN}] 2023-07-24 23:07:47,968 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=82dd5d7cd9e029d7b4514b27ba0319dd, UNASSIGN 2023-07-24 23:07:47,970 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=dc762efe467f73b816d1c62ec8622d16, UNASSIGN 2023-07-24 23:07:47,971 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=dc762efe467f73b816d1c62ec8622d16, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39595,1690239969801 2023-07-24 23:07:47,971 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=82dd5d7cd9e029d7b4514b27ba0319dd, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:07:47,972 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1690240046827.dc762efe467f73b816d1c62ec8622d16.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690240067971"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690240067971"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690240067971"}]},"ts":"1690240067971"} 2023-07-24 23:07:47,972 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1690240046827.82dd5d7cd9e029d7b4514b27ba0319dd.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690240067971"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690240067971"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690240067971"}]},"ts":"1690240067971"} 2023-07-24 23:07:47,975 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=87, ppid=86, state=RUNNABLE; CloseRegionProcedure dc762efe467f73b816d1c62ec8622d16, server=jenkins-hbase4.apache.org,39595,1690239969801}] 2023-07-24 23:07:47,976 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=88, ppid=85, state=RUNNABLE; CloseRegionProcedure 82dd5d7cd9e029d7b4514b27ba0319dd, server=jenkins-hbase4.apache.org,33227,1690239969957}] 2023-07-24 23:07:48,061 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-24 23:07:48,128 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close dc762efe467f73b816d1c62ec8622d16 2023-07-24 23:07:48,129 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing dc762efe467f73b816d1c62ec8622d16, disabling compactions & flushes 2023-07-24 23:07:48,129 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1690240046827.dc762efe467f73b816d1c62ec8622d16. 2023-07-24 23:07:48,129 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1690240046827.dc762efe467f73b816d1c62ec8622d16. 2023-07-24 23:07:48,129 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1690240046827.dc762efe467f73b816d1c62ec8622d16. after waiting 0 ms 2023-07-24 23:07:48,129 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1690240046827.dc762efe467f73b816d1c62ec8622d16. 2023-07-24 23:07:48,129 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 82dd5d7cd9e029d7b4514b27ba0319dd 2023-07-24 23:07:48,129 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 82dd5d7cd9e029d7b4514b27ba0319dd, disabling compactions & flushes 2023-07-24 23:07:48,129 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1690240046827.82dd5d7cd9e029d7b4514b27ba0319dd. 2023-07-24 23:07:48,129 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1690240046827.82dd5d7cd9e029d7b4514b27ba0319dd. 2023-07-24 23:07:48,129 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1690240046827.82dd5d7cd9e029d7b4514b27ba0319dd. after waiting 0 ms 2023-07-24 23:07:48,130 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1690240046827.82dd5d7cd9e029d7b4514b27ba0319dd. 2023-07-24 23:07:48,149 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/default/testtb-testExportFileSystemStateWithMergeRegion/dc762efe467f73b816d1c62ec8622d16/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-24 23:07:48,149 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/default/testtb-testExportFileSystemStateWithMergeRegion/82dd5d7cd9e029d7b4514b27ba0319dd/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-24 23:07:48,149 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 23:07:48,151 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1690240046827.dc762efe467f73b816d1c62ec8622d16. 2023-07-24 23:07:48,151 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for dc762efe467f73b816d1c62ec8622d16: 2023-07-24 23:07:48,151 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 23:07:48,152 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1690240046827.82dd5d7cd9e029d7b4514b27ba0319dd. 2023-07-24 23:07:48,152 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 82dd5d7cd9e029d7b4514b27ba0319dd: 2023-07-24 23:07:48,154 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed dc762efe467f73b816d1c62ec8622d16 2023-07-24 23:07:48,154 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=dc762efe467f73b816d1c62ec8622d16, regionState=CLOSED 2023-07-24 23:07:48,155 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1690240046827.dc762efe467f73b816d1c62ec8622d16.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690240068154"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690240068154"}]},"ts":"1690240068154"} 2023-07-24 23:07:48,155 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 82dd5d7cd9e029d7b4514b27ba0319dd 2023-07-24 23:07:48,158 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=82dd5d7cd9e029d7b4514b27ba0319dd, regionState=CLOSED 2023-07-24 23:07:48,158 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1690240046827.82dd5d7cd9e029d7b4514b27ba0319dd.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690240068158"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690240068158"}]},"ts":"1690240068158"} 2023-07-24 23:07:48,167 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=87, resume processing ppid=86 2023-07-24 23:07:48,167 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=87, ppid=86, state=SUCCESS; CloseRegionProcedure dc762efe467f73b816d1c62ec8622d16, server=jenkins-hbase4.apache.org,39595,1690239969801 in 183 msec 2023-07-24 23:07:48,168 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=88, resume processing ppid=85 2023-07-24 23:07:48,168 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=86, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=dc762efe467f73b816d1c62ec8622d16, UNASSIGN in 200 msec 2023-07-24 23:07:48,168 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=88, ppid=85, state=SUCCESS; CloseRegionProcedure 82dd5d7cd9e029d7b4514b27ba0319dd, server=jenkins-hbase4.apache.org,33227,1690239969957 in 188 msec 2023-07-24 23:07:48,177 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=85, resume processing ppid=84 2023-07-24 23:07:48,178 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=85, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=82dd5d7cd9e029d7b4514b27ba0319dd, UNASSIGN in 201 msec 2023-07-24 23:07:48,179 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690240068178"}]},"ts":"1690240068178"} 2023-07-24 23:07:48,180 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLED in hbase:meta 2023-07-24 23:07:48,182 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLED 2023-07-24 23:07:48,184 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=84, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 228 msec 2023-07-24 23:07:48,262 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-24 23:07:48,263 INFO [Listener at jenkins-hbase4.apache.org/43617] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 84 completed 2023-07-24 23:07:48,264 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:48,265 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] procedure2.ProcedureExecutor(1029): Stored pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:48,278 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:48,278 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:48,279 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=89, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:48,281 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33227] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:48,285 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:48,285 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:39595-0x1019995a36f0001, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:48,285 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:33227-0x1019995a36f0003, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:48,286 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-24 23:07:48,286 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-24 23:07:48,286 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-24 23:07:48,286 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/dc762efe467f73b816d1c62ec8622d16 2023-07-24 23:07:48,286 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/82dd5d7cd9e029d7b4514b27ba0319dd 2023-07-24 23:07:48,287 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:39013-0x1019995a36f0002, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:48,287 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:48,287 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 23:07:48,287 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:33227-0x1019995a36f0003, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:48,287 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:39013-0x1019995a36f0002, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 23:07:48,287 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:39595-0x1019995a36f0001, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:48,287 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:39595-0x1019995a36f0001, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 23:07:48,287 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:33227-0x1019995a36f0003, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 23:07:48,288 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data null 2023-07-24 23:07:48,288 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-24 23:07:48,290 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-24 23:07:48,290 DEBUG [HFileArchiver-15] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/dc762efe467f73b816d1c62ec8622d16/cf, FileablePath, hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/dc762efe467f73b816d1c62ec8622d16/recovered.edits] 2023-07-24 23:07:48,291 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/82dd5d7cd9e029d7b4514b27ba0319dd/cf, FileablePath, hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/82dd5d7cd9e029d7b4514b27ba0319dd/recovered.edits] 2023-07-24 23:07:48,296 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/dc762efe467f73b816d1c62ec8622d16/cf/35abb0bf6e484acaaf323af1589ddfd6 to hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/dc762efe467f73b816d1c62ec8622d16/cf/35abb0bf6e484acaaf323af1589ddfd6 2023-07-24 23:07:48,297 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/82dd5d7cd9e029d7b4514b27ba0319dd/cf/183254f2d24b43b3aaacca12ebe6032d to hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/82dd5d7cd9e029d7b4514b27ba0319dd/cf/183254f2d24b43b3aaacca12ebe6032d 2023-07-24 23:07:48,304 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/dc762efe467f73b816d1c62ec8622d16/recovered.edits/9.seqid to hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/dc762efe467f73b816d1c62ec8622d16/recovered.edits/9.seqid 2023-07-24 23:07:48,305 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/82dd5d7cd9e029d7b4514b27ba0319dd/recovered.edits/9.seqid to hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/82dd5d7cd9e029d7b4514b27ba0319dd/recovered.edits/9.seqid 2023-07-24 23:07:48,305 DEBUG [HFileArchiver-15] backup.HFileArchiver(596): Deleted hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/dc762efe467f73b816d1c62ec8622d16 2023-07-24 23:07:48,306 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/82dd5d7cd9e029d7b4514b27ba0319dd 2023-07-24 23:07:48,306 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-07-24 23:07:48,310 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=89, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:48,313 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithMergeRegion from hbase:meta 2023-07-24 23:07:48,328 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion' descriptor. 2023-07-24 23:07:48,329 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=89, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:48,329 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion' from region states. 2023-07-24 23:07:48,330 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1690240046827.82dd5d7cd9e029d7b4514b27ba0319dd.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690240068329"}]},"ts":"9223372036854775807"} 2023-07-24 23:07:48,330 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1690240046827.dc762efe467f73b816d1c62ec8622d16.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690240068329"}]},"ts":"9223372036854775807"} 2023-07-24 23:07:48,332 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-24 23:07:48,332 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 82dd5d7cd9e029d7b4514b27ba0319dd, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1690240046827.82dd5d7cd9e029d7b4514b27ba0319dd.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => dc762efe467f73b816d1c62ec8622d16, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1690240046827.dc762efe467f73b816d1c62ec8622d16.', STARTKEY => '1', ENDKEY => ''}] 2023-07-24 23:07:48,332 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion' as deleted. 2023-07-24 23:07:48,332 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1690240068332"}]},"ts":"9223372036854775807"} 2023-07-24 23:07:48,334 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion state from META 2023-07-24 23:07:48,337 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=89, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:48,338 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=89, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 73 msec 2023-07-24 23:07:48,391 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-24 23:07:48,391 INFO [Listener at jenkins-hbase4.apache.org/43617] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 89 completed 2023-07-24 23:07:48,403 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithMergeRegion" 2023-07-24 23:07:48,405 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:48,406 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion" 2023-07-24 23:07:48,408 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:48,409 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion-1" 2023-07-24 23:07:48,412 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 23:07:48,444 INFO [Listener at jenkins-hbase4.apache.org/43617] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=758 (was 747) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-527448641_1 at /127.0.0.1:40358 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x2b6dd434-shared-pool-30 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1273988721_17 at /127.0.0.1:43094 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (717546083) connection to jenkins-hbase4.apache.org/172.31.14.131:37049 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x2b6dd434-shared-pool-34 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x2b6dd434-shared-pool-35 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x2b6dd434-shared-pool-33 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-3949 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-527448641_1 at /127.0.0.1:34534 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1273988721_17 at /127.0.0.1:34570 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x2b6dd434-shared-pool-31 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-19 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x2b6dd434-shared-pool-32 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-20 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=902 (was 896) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=561 (was 398) - SystemLoadAverage LEAK? -, ProcessCount=185 (was 182) - ProcessCount LEAK? -, AvailableMemoryMB=5319 (was 5818) 2023-07-24 23:07:48,444 WARN [Listener at jenkins-hbase4.apache.org/43617] hbase.ResourceChecker(130): Thread=758 is superior to 500 2023-07-24 23:07:48,466 INFO [Listener at jenkins-hbase4.apache.org/43617] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testEmptyExportFileSystemState Thread=758, OpenFileDescriptor=902, MaxFileDescriptor=60000, SystemLoadAverage=561, ProcessCount=185, AvailableMemoryMB=5317 2023-07-24 23:07:48,466 WARN [Listener at jenkins-hbase4.apache.org/43617] hbase.ResourceChecker(130): Thread=758 is superior to 500 2023-07-24 23:07:48,468 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-24 23:07:48,469 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] procedure2.ProcedureExecutor(1029): Stored pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-24 23:07:48,471 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-07-24 23:07:48,472 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testEmptyExportFileSystemState" procId is: 90 2023-07-24 23:07:48,472 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-24 23:07:48,473 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-24 23:07:48,475 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.tmp/data/default/testtb-testEmptyExportFileSystemState/2fed3f034555651fa7a6c2a80dd4f769 2023-07-24 23:07:48,475 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.tmp/data/default/testtb-testEmptyExportFileSystemState/f6a349f39da2c73c760af980e33c2251 2023-07-24 23:07:48,475 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.tmp/data/default/testtb-testEmptyExportFileSystemState/2fed3f034555651fa7a6c2a80dd4f769 empty. 2023-07-24 23:07:48,475 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.tmp/data/default/testtb-testEmptyExportFileSystemState/f6a349f39da2c73c760af980e33c2251 empty. 2023-07-24 23:07:48,476 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.tmp/data/default/testtb-testEmptyExportFileSystemState/2fed3f034555651fa7a6c2a80dd4f769 2023-07-24 23:07:48,476 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.tmp/data/default/testtb-testEmptyExportFileSystemState/f6a349f39da2c73c760af980e33c2251 2023-07-24 23:07:48,476 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-07-24 23:07:48,505 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.tmp/data/default/testtb-testEmptyExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-07-24 23:07:48,507 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => f6a349f39da2c73c760af980e33c2251, NAME => 'testtb-testEmptyExportFileSystemState,,1690240068467.f6a349f39da2c73c760af980e33c2251.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.tmp 2023-07-24 23:07:48,507 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => 2fed3f034555651fa7a6c2a80dd4f769, NAME => 'testtb-testEmptyExportFileSystemState,1,1690240068467.2fed3f034555651fa7a6c2a80dd4f769.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.tmp 2023-07-24 23:07:48,571 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1690240068467.2fed3f034555651fa7a6c2a80dd4f769.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 23:07:48,571 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing 2fed3f034555651fa7a6c2a80dd4f769, disabling compactions & flushes 2023-07-24 23:07:48,571 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1690240068467.2fed3f034555651fa7a6c2a80dd4f769. 2023-07-24 23:07:48,571 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1690240068467.2fed3f034555651fa7a6c2a80dd4f769. 2023-07-24 23:07:48,571 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1690240068467.2fed3f034555651fa7a6c2a80dd4f769. after waiting 0 ms 2023-07-24 23:07:48,571 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1690240068467.2fed3f034555651fa7a6c2a80dd4f769. 2023-07-24 23:07:48,571 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1690240068467.2fed3f034555651fa7a6c2a80dd4f769. 2023-07-24 23:07:48,571 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for 2fed3f034555651fa7a6c2a80dd4f769: 2023-07-24 23:07:48,574 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-24 23:07:48,776 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-24 23:07:48,972 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1690240068467.f6a349f39da2c73c760af980e33c2251.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 23:07:48,972 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing f6a349f39da2c73c760af980e33c2251, disabling compactions & flushes 2023-07-24 23:07:48,972 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1690240068467.f6a349f39da2c73c760af980e33c2251. 2023-07-24 23:07:48,972 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1690240068467.f6a349f39da2c73c760af980e33c2251. 2023-07-24 23:07:48,972 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1690240068467.f6a349f39da2c73c760af980e33c2251. after waiting 0 ms 2023-07-24 23:07:48,972 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1690240068467.f6a349f39da2c73c760af980e33c2251. 2023-07-24 23:07:48,972 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1690240068467.f6a349f39da2c73c760af980e33c2251. 2023-07-24 23:07:48,973 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for f6a349f39da2c73c760af980e33c2251: 2023-07-24 23:07:48,976 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-07-24 23:07:48,977 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1690240068467.2fed3f034555651fa7a6c2a80dd4f769.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690240068976"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690240068976"}]},"ts":"1690240068976"} 2023-07-24 23:07:48,977 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1690240068467.f6a349f39da2c73c760af980e33c2251.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690240068976"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690240068976"}]},"ts":"1690240068976"} 2023-07-24 23:07:48,979 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-24 23:07:48,980 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-24 23:07:48,980 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690240068980"}]},"ts":"1690240068980"} 2023-07-24 23:07:48,983 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLING in hbase:meta 2023-07-24 23:07:48,986 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-24 23:07:48,987 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-24 23:07:48,987 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-24 23:07:48,987 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-24 23:07:48,987 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-24 23:07:48,988 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=f6a349f39da2c73c760af980e33c2251, ASSIGN}, {pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=2fed3f034555651fa7a6c2a80dd4f769, ASSIGN}] 2023-07-24 23:07:48,991 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=f6a349f39da2c73c760af980e33c2251, ASSIGN 2023-07-24 23:07:48,991 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=2fed3f034555651fa7a6c2a80dd4f769, ASSIGN 2023-07-24 23:07:48,991 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=f6a349f39da2c73c760af980e33c2251, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33227,1690239969957; forceNewPlan=false, retain=false 2023-07-24 23:07:48,991 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=2fed3f034555651fa7a6c2a80dd4f769, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39595,1690239969801; forceNewPlan=false, retain=false 2023-07-24 23:07:49,077 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-24 23:07:49,142 INFO [jenkins-hbase4:37213] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-24 23:07:49,145 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=f6a349f39da2c73c760af980e33c2251, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:07:49,145 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=2fed3f034555651fa7a6c2a80dd4f769, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39595,1690239969801 2023-07-24 23:07:49,146 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1690240068467.f6a349f39da2c73c760af980e33c2251.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690240069145"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690240069145"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690240069145"}]},"ts":"1690240069145"} 2023-07-24 23:07:49,146 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1690240068467.2fed3f034555651fa7a6c2a80dd4f769.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690240069145"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690240069145"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690240069145"}]},"ts":"1690240069145"} 2023-07-24 23:07:49,149 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=93, ppid=92, state=RUNNABLE; OpenRegionProcedure 2fed3f034555651fa7a6c2a80dd4f769, server=jenkins-hbase4.apache.org,39595,1690239969801}] 2023-07-24 23:07:49,150 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=94, ppid=91, state=RUNNABLE; OpenRegionProcedure f6a349f39da2c73c760af980e33c2251, server=jenkins-hbase4.apache.org,33227,1690239969957}] 2023-07-24 23:07:49,309 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,1,1690240068467.2fed3f034555651fa7a6c2a80dd4f769. 2023-07-24 23:07:49,310 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 2fed3f034555651fa7a6c2a80dd4f769, NAME => 'testtb-testEmptyExportFileSystemState,1,1690240068467.2fed3f034555651fa7a6c2a80dd4f769.', STARTKEY => '1', ENDKEY => ''} 2023-07-24 23:07:49,310 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,1,1690240068467.2fed3f034555651fa7a6c2a80dd4f769. service=AccessControlService 2023-07-24 23:07:49,310 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 23:07:49,310 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 2fed3f034555651fa7a6c2a80dd4f769 2023-07-24 23:07:49,310 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1690240068467.2fed3f034555651fa7a6c2a80dd4f769.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 23:07:49,311 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 2fed3f034555651fa7a6c2a80dd4f769 2023-07-24 23:07:49,311 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 2fed3f034555651fa7a6c2a80dd4f769 2023-07-24 23:07:49,311 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,,1690240068467.f6a349f39da2c73c760af980e33c2251. 2023-07-24 23:07:49,311 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => f6a349f39da2c73c760af980e33c2251, NAME => 'testtb-testEmptyExportFileSystemState,,1690240068467.f6a349f39da2c73c760af980e33c2251.', STARTKEY => '', ENDKEY => '1'} 2023-07-24 23:07:49,312 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,,1690240068467.f6a349f39da2c73c760af980e33c2251. service=AccessControlService 2023-07-24 23:07:49,312 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 23:07:49,312 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState f6a349f39da2c73c760af980e33c2251 2023-07-24 23:07:49,312 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1690240068467.f6a349f39da2c73c760af980e33c2251.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 23:07:49,312 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for f6a349f39da2c73c760af980e33c2251 2023-07-24 23:07:49,312 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for f6a349f39da2c73c760af980e33c2251 2023-07-24 23:07:49,316 INFO [StoreOpener-2fed3f034555651fa7a6c2a80dd4f769-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 2fed3f034555651fa7a6c2a80dd4f769 2023-07-24 23:07:49,318 DEBUG [StoreOpener-2fed3f034555651fa7a6c2a80dd4f769-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/default/testtb-testEmptyExportFileSystemState/2fed3f034555651fa7a6c2a80dd4f769/cf 2023-07-24 23:07:49,319 DEBUG [StoreOpener-2fed3f034555651fa7a6c2a80dd4f769-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/default/testtb-testEmptyExportFileSystemState/2fed3f034555651fa7a6c2a80dd4f769/cf 2023-07-24 23:07:49,319 INFO [StoreOpener-2fed3f034555651fa7a6c2a80dd4f769-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2fed3f034555651fa7a6c2a80dd4f769 columnFamilyName cf 2023-07-24 23:07:49,320 INFO [StoreOpener-2fed3f034555651fa7a6c2a80dd4f769-1] regionserver.HStore(310): Store=2fed3f034555651fa7a6c2a80dd4f769/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 23:07:49,323 INFO [StoreOpener-f6a349f39da2c73c760af980e33c2251-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region f6a349f39da2c73c760af980e33c2251 2023-07-24 23:07:49,325 DEBUG [StoreOpener-f6a349f39da2c73c760af980e33c2251-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/default/testtb-testEmptyExportFileSystemState/f6a349f39da2c73c760af980e33c2251/cf 2023-07-24 23:07:49,325 DEBUG [StoreOpener-f6a349f39da2c73c760af980e33c2251-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/default/testtb-testEmptyExportFileSystemState/f6a349f39da2c73c760af980e33c2251/cf 2023-07-24 23:07:49,325 INFO [StoreOpener-f6a349f39da2c73c760af980e33c2251-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f6a349f39da2c73c760af980e33c2251 columnFamilyName cf 2023-07-24 23:07:49,326 INFO [StoreOpener-f6a349f39da2c73c760af980e33c2251-1] regionserver.HStore(310): Store=f6a349f39da2c73c760af980e33c2251/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 23:07:49,327 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/default/testtb-testEmptyExportFileSystemState/2fed3f034555651fa7a6c2a80dd4f769 2023-07-24 23:07:49,328 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/default/testtb-testEmptyExportFileSystemState/f6a349f39da2c73c760af980e33c2251 2023-07-24 23:07:49,328 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/default/testtb-testEmptyExportFileSystemState/2fed3f034555651fa7a6c2a80dd4f769 2023-07-24 23:07:49,329 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/default/testtb-testEmptyExportFileSystemState/f6a349f39da2c73c760af980e33c2251 2023-07-24 23:07:49,333 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for f6a349f39da2c73c760af980e33c2251 2023-07-24 23:07:49,334 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 2fed3f034555651fa7a6c2a80dd4f769 2023-07-24 23:07:49,337 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/default/testtb-testEmptyExportFileSystemState/f6a349f39da2c73c760af980e33c2251/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-24 23:07:49,337 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/default/testtb-testEmptyExportFileSystemState/2fed3f034555651fa7a6c2a80dd4f769/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-24 23:07:49,338 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened f6a349f39da2c73c760af980e33c2251; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70429880, jitterRate=0.04948699474334717}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-24 23:07:49,338 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for f6a349f39da2c73c760af980e33c2251: 2023-07-24 23:07:49,339 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 2fed3f034555651fa7a6c2a80dd4f769; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67311155, jitterRate=0.0030143707990646362}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-24 23:07:49,339 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,,1690240068467.f6a349f39da2c73c760af980e33c2251., pid=94, masterSystemTime=1690240069306 2023-07-24 23:07:49,339 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 2fed3f034555651fa7a6c2a80dd4f769: 2023-07-24 23:07:49,340 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,1,1690240068467.2fed3f034555651fa7a6c2a80dd4f769., pid=93, masterSystemTime=1690240069305 2023-07-24 23:07:49,341 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,,1690240068467.f6a349f39da2c73c760af980e33c2251. 2023-07-24 23:07:49,341 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,,1690240068467.f6a349f39da2c73c760af980e33c2251. 2023-07-24 23:07:49,341 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=f6a349f39da2c73c760af980e33c2251, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:07:49,342 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,,1690240068467.f6a349f39da2c73c760af980e33c2251.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690240069341"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690240069341"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690240069341"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690240069341"}]},"ts":"1690240069341"} 2023-07-24 23:07:49,342 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,1,1690240068467.2fed3f034555651fa7a6c2a80dd4f769. 2023-07-24 23:07:49,342 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,1,1690240068467.2fed3f034555651fa7a6c2a80dd4f769. 2023-07-24 23:07:49,342 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=2fed3f034555651fa7a6c2a80dd4f769, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39595,1690239969801 2023-07-24 23:07:49,342 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,1,1690240068467.2fed3f034555651fa7a6c2a80dd4f769.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690240069342"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690240069342"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690240069342"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690240069342"}]},"ts":"1690240069342"} 2023-07-24 23:07:49,357 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=94, resume processing ppid=91 2023-07-24 23:07:49,358 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=94, ppid=91, state=SUCCESS; OpenRegionProcedure f6a349f39da2c73c760af980e33c2251, server=jenkins-hbase4.apache.org,33227,1690239969957 in 197 msec 2023-07-24 23:07:49,358 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=93, resume processing ppid=92 2023-07-24 23:07:49,358 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=93, ppid=92, state=SUCCESS; OpenRegionProcedure 2fed3f034555651fa7a6c2a80dd4f769, server=jenkins-hbase4.apache.org,39595,1690239969801 in 198 msec 2023-07-24 23:07:49,360 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=91, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=f6a349f39da2c73c760af980e33c2251, ASSIGN in 370 msec 2023-07-24 23:07:49,361 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=92, resume processing ppid=90 2023-07-24 23:07:49,361 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=92, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=2fed3f034555651fa7a6c2a80dd4f769, ASSIGN in 370 msec 2023-07-24 23:07:49,362 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-24 23:07:49,362 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690240069362"}]},"ts":"1690240069362"} 2023-07-24 23:07:49,363 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLED in hbase:meta 2023-07-24 23:07:49,367 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-07-24 23:07:49,368 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testEmptyExportFileSystemState jenkins: RWXCA 2023-07-24 23:07:49,371 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33227] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-24 23:07:49,373 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:39595-0x1019995a36f0001, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 23:07:49,373 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:33227-0x1019995a36f0003, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 23:07:49,374 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:39013-0x1019995a36f0002, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 23:07:49,374 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 23:07:49,375 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-24 23:07:49,376 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-24 23:07:49,376 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-24 23:07:49,376 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-24 23:07:49,378 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=90, state=SUCCESS; CreateTableProcedure table=testtb-testEmptyExportFileSystemState in 908 msec 2023-07-24 23:07:49,578 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-24 23:07:49,579 INFO [Listener at jenkins-hbase4.apache.org/43617] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 90 completed 2023-07-24 23:07:49,579 DEBUG [Listener at jenkins-hbase4.apache.org/43617] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testEmptyExportFileSystemState get assigned. Timeout = 60000ms 2023-07-24 23:07:49,579 INFO [Listener at jenkins-hbase4.apache.org/43617] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-24 23:07:49,583 INFO [Listener at jenkins-hbase4.apache.org/43617] hbase.HBaseTestingUtility(3484): All regions for table testtb-testEmptyExportFileSystemState assigned to meta. Checking AM states. 2023-07-24 23:07:49,583 INFO [Listener at jenkins-hbase4.apache.org/43617] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-24 23:07:49,583 INFO [Listener at jenkins-hbase4.apache.org/43617] hbase.HBaseTestingUtility(3504): All regions for table testtb-testEmptyExportFileSystemState assigned. 2023-07-24 23:07:49,586 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-24 23:07:49,586 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690240069586 (current time:1690240069586). 2023-07-24 23:07:49,586 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-24 23:07:49,586 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] zookeeper.ReadOnlyZKClient(139): Connect 0x23eeb14b to 127.0.0.1:52881 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 23:07:49,595 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@79a5d092, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 23:07:49,601 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 23:07:49,602 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37688, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 23:07:49,603 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x23eeb14b to 127.0.0.1:52881 2023-07-24 23:07:49,603 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 23:07:49,604 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] zookeeper.ReadOnlyZKClient(139): Connect 0x3d6a9bdb to 127.0.0.1:52881 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 23:07:49,619 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6bd811d4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 23:07:49,713 DEBUG [hconnection-0x3cae6d7d-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 23:07:49,718 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37692, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 23:07:49,727 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 23:07:49,732 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36360, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 23:07:49,733 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3d6a9bdb to 127.0.0.1:52881 2023-07-24 23:07:49,733 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 23:07:49,733 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-24 23:07:49,734 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-24 23:07:49,734 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-24 23:07:49,746 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] procedure2.ProcedureExecutor(1029): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-24 23:07:49,749 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-24 23:07:49,750 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1690240669750 2023-07-24 23:07:49,751 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-24 23:07:49,751 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-07-24 23:07:49,758 DEBUG [Listener at jenkins-hbase4.apache.org/43617] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-24 23:07:49,759 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-24 23:07:49,760 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-24 23:07:49,760 DEBUG [Listener at jenkins-hbase4.apache.org/43617] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-24 23:07:49,764 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 24 msec 2023-07-24 23:07:49,770 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-24 23:07:49,770 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=96, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1690240669770 2023-07-24 23:07:49,805 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:49,805 INFO [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState' 2023-07-24 23:07:49,805 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 23:07:49,807 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-07-24 23:07:49,807 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-07-24 23:07:49,838 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:49,838 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:49,842 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:33227-0x1019995a36f0003, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 23:07:49,843 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:39595-0x1019995a36f0001, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 23:07:49,843 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:07:49,843 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 23:07:49,843 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:39013-0x1019995a36f0002, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 23:07:49,843 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 23:07:49,843 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 23:07:49,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 23:07:49,843 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:07:49,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 23:07:49,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 23:07:49,843 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39595,1690239969801 2023-07-24 23:07:49,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:49,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:49,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:49,844 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39595,1690239969801 2023-07-24 23:07:49,844 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-24 23:07:49,844 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39013-0x1019995a36f0002, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:49,844 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33227-0x1019995a36f0003, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:49,844 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39595-0x1019995a36f0001, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:49,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-24 23:07:49,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:49,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-24 23:07:49,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:49,845 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-24 23:07:49,845 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-24 23:07:49,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-24 23:07:49,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:49,849 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-24 23:07:49,858 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:49,859 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1690239969801' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-24 23:07:49,859 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1690239969801' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 23:07:49,861 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1690239969801' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-24 23:07:49,861 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1690239969801' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-24 23:07:49,861 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1690239969801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39595,1690239969801' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-24 23:07:49,863 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39595,1690239969801 2023-07-24 23:07:49,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39595,1690239969801 2023-07-24 23:07:49,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 23:07:49,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 23:07:49,863 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1690239969801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:49,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 23:07:49,865 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:49,865 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1690239969801' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39595-0x1019995a36f0001, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:49,865 DEBUG [member: 'jenkins-hbase4.apache.org,39013,1690239969874' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-24 23:07:49,865 DEBUG [member: 'jenkins-hbase4.apache.org,39013,1690239969874' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 23:07:49,865 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1690239969801' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 23:07:49,865 DEBUG [Listener at jenkins-hbase4.apache.org/43617] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 23:07:49,865 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:49,865 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-24 23:07:49,866 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 23:07:49,872 DEBUG [member: 'jenkins-hbase4.apache.org,39013,1690239969874' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-24 23:07:49,872 DEBUG [member: 'jenkins-hbase4.apache.org,39013,1690239969874' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-24 23:07:49,872 DEBUG [member: 'jenkins-hbase4.apache.org,39013,1690239969874' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39013,1690239969874' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-24 23:07:49,872 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-24 23:07:49,872 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-24 23:07:49,872 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33227,1690239969957' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-24 23:07:49,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 23:07:49,874 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-24 23:07:49,874 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-24 23:07:49,874 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:49,875 DEBUG [member: 'jenkins-hbase4.apache.org,39013,1690239969874' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:49,875 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33227-0x1019995a36f0003, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:49,875 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 23:07:49,875 DEBUG [Listener at jenkins-hbase4.apache.org/43617] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-24 23:07:49,875 DEBUG [member: 'jenkins-hbase4.apache.org,39013,1690239969874' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39013-0x1019995a36f0002, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:49,875 DEBUG [member: 'jenkins-hbase4.apache.org,39013,1690239969874' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 23:07:49,875 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:07:49,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:49,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:07:49,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39013,1690239969874 2023-07-24 23:07:49,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39595,1690239969801 2023-07-24 23:07:49,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 23:07:49,877 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39595,1690239969801' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-24 23:07:49,877 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5bdbfe8a[Count = 1] remaining members to acquire global barrier 2023-07-24 23:07:49,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:07:49,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 23:07:49,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 23:07:49,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 23:07:49,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 23:07:49,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:49,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:07:49,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39013,1690239969874 2023-07-24 23:07:49,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39595,1690239969801 2023-07-24 23:07:49,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 23:07:49,880 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33227,1690239969957' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-24 23:07:49,880 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5bdbfe8a[Count = 0] remaining members to acquire global barrier 2023-07-24 23:07:49,880 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-07-24 23:07:49,880 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:49,883 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:39013-0x1019995a36f0002, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:49,883 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:33227-0x1019995a36f0003, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:49,883 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:49,883 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:49,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:49,883 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:39595-0x1019995a36f0001, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:49,883 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-24 23:07:49,883 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:49,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:49,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:49,884 DEBUG [member: 'jenkins-hbase4.apache.org,39013,1690239969874' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-24 23:07:49,884 DEBUG [member: 'jenkins-hbase4.apache.org,39013,1690239969874' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-24 23:07:49,884 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39595,1690239969801 2023-07-24 23:07:49,884 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1690239969801' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-24 23:07:49,884 DEBUG [member: 'jenkins-hbase4.apache.org,39013,1690239969874' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,39013,1690239969874' in zk 2023-07-24 23:07:49,884 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:07:49,884 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-24 23:07:49,885 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 23:07:49,885 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 23:07:49,886 DEBUG [member: 'jenkins-hbase4.apache.org,39013,1690239969874' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-24 23:07:49,886 DEBUG [member: 'jenkins-hbase4.apache.org,39013,1690239969874' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 23:07:49,886 DEBUG [member: 'jenkins-hbase4.apache.org,39013,1690239969874' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-24 23:07:49,894 DEBUG [rs(jenkins-hbase4.apache.org,33227,1690239969957)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1690240068467.f6a349f39da2c73c760af980e33c2251. 2023-07-24 23:07:49,891 DEBUG [rs(jenkins-hbase4.apache.org,39595,1690239969801)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1690240068467.2fed3f034555651fa7a6c2a80dd4f769. 2023-07-24 23:07:49,894 DEBUG [rs(jenkins-hbase4.apache.org,33227,1690239969957)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1690240068467.f6a349f39da2c73c760af980e33c2251. started... 2023-07-24 23:07:49,890 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1690239969801' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 23:07:49,894 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1690239969801' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 23:07:49,894 DEBUG [rs(jenkins-hbase4.apache.org,39595,1690239969801)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1690240068467.2fed3f034555651fa7a6c2a80dd4f769. started... 2023-07-24 23:07:49,896 DEBUG [rs(jenkins-hbase4.apache.org,33227,1690239969957)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for f6a349f39da2c73c760af980e33c2251: 2023-07-24 23:07:49,896 DEBUG [rs(jenkins-hbase4.apache.org,33227,1690239969957)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1690240068467.f6a349f39da2c73c760af980e33c2251.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:49,896 DEBUG [rs(jenkins-hbase4.apache.org,33227,1690239969957)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 23:07:49,896 DEBUG [rs(jenkins-hbase4.apache.org,33227,1690239969957)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-24 23:07:49,920 DEBUG [rs(jenkins-hbase4.apache.org,39595,1690239969801)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 2fed3f034555651fa7a6c2a80dd4f769: 2023-07-24 23:07:49,920 DEBUG [rs(jenkins-hbase4.apache.org,39595,1690239969801)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1690240068467.2fed3f034555651fa7a6c2a80dd4f769.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:49,920 DEBUG [rs(jenkins-hbase4.apache.org,39595,1690239969801)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 23:07:49,920 DEBUG [rs(jenkins-hbase4.apache.org,39595,1690239969801)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-24 23:07:49,994 DEBUG [rs(jenkins-hbase4.apache.org,33227,1690239969957)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1690240068467.f6a349f39da2c73c760af980e33c2251. completed. 2023-07-24 23:07:49,994 DEBUG [rs(jenkins-hbase4.apache.org,33227,1690239969957)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1690240068467.f6a349f39da2c73c760af980e33c2251. 2023-07-24 23:07:49,994 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 23:07:49,994 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 23:07:49,994 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:07:49,994 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-24 23:07:49,994 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,33227,1690239969957' in zk 2023-07-24 23:07:49,996 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:07:49,996 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-24 23:07:49,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:07:49,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 23:07:49,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 23:07:49,996 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 23:07:49,997 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-24 23:07:50,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 23:07:50,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 23:07:50,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:50,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:07:50,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39013,1690239969874 2023-07-24 23:07:50,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39595,1690239969801 2023-07-24 23:07:50,009 DEBUG [rs(jenkins-hbase4.apache.org,39595,1690239969801)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1690240068467.2fed3f034555651fa7a6c2a80dd4f769. completed. 2023-07-24 23:07:50,009 DEBUG [rs(jenkins-hbase4.apache.org,39595,1690239969801)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1690240068467.2fed3f034555651fa7a6c2a80dd4f769. 2023-07-24 23:07:50,009 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1690239969801' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 23:07:50,009 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1690239969801' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 23:07:50,009 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1690239969801' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39595,1690239969801 2023-07-24 23:07:50,009 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1690239969801' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-24 23:07:50,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 23:07:50,009 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1690239969801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,39595,1690239969801' in zk 2023-07-24 23:07:50,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:50,011 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1690239969801' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-24 23:07:50,011 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39595,1690239969801 2023-07-24 23:07:50,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:07:50,011 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1690239969801' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 23:07:50,012 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1690239969801' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-24 23:07:50,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39013,1690239969874 2023-07-24 23:07:50,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39595,1690239969801 2023-07-24 23:07:50,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,33227,1690239969957': 2023-07-24 23:07:50,015 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33227,1690239969957' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-24 23:07:50,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39595,1690239969801 2023-07-24 23:07:50,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 23:07:50,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 23:07:50,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 23:07:50,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 23:07:50,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:50,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:07:50,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39013,1690239969874 2023-07-24 23:07:50,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39595,1690239969801 2023-07-24 23:07:50,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 23:07:50,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:50,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:07:50,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39013,1690239969874 2023-07-24 23:07:50,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39595,1690239969801 2023-07-24 23:07:50,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,39595,1690239969801': 2023-07-24 23:07:50,019 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39595,1690239969801' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-24 23:07:50,019 INFO [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' execution completed 2023-07-24 23:07:50,019 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-24 23:07:50,019 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-24 23:07:50,019 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:50,019 INFO [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-24 23:07:50,021 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:33227-0x1019995a36f0003, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:50,021 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:39595-0x1019995a36f0001, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:50,021 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:50,021 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:50,021 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:39595-0x1019995a36f0001, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 23:07:50,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:50,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 23:07:50,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 23:07:50,021 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:50,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:50,021 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:33227-0x1019995a36f0003, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 23:07:50,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:50,022 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 23:07:50,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 23:07:50,023 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 23:07:50,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 23:07:50,023 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:39013-0x1019995a36f0002, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:50,023 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:39013-0x1019995a36f0002, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 23:07:50,023 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:50,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:50,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:50,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:50,023 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 23:07:50,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 23:07:50,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 23:07:50,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:50,024 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:07:50,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:50,025 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39013,1690239969874 2023-07-24 23:07:50,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 23:07:50,025 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39595,1690239969801 2023-07-24 23:07:50,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:50,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:07:50,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39013,1690239969874 2023-07-24 23:07:50,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39595,1690239969801 2023-07-24 23:07:50,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 23:07:50,035 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:07:50,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:50,035 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39013,1690239969874 2023-07-24 23:07:50,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:07:50,036 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39595,1690239969801 2023-07-24 23:07:50,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39013,1690239969874 2023-07-24 23:07:50,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39595,1690239969801 2023-07-24 23:07:50,040 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:39595-0x1019995a36f0001, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 23:07:50,040 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:33227-0x1019995a36f0003, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 23:07:50,040 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 23:07:50,040 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 23:07:50,040 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39595,1690239969801 2023-07-24 23:07:50,040 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:50,040 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:39595-0x1019995a36f0001, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 23:07:50,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 23:07:50,040 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:50,040 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:50,040 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:39013-0x1019995a36f0002, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 23:07:50,041 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:39013-0x1019995a36f0002, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 23:07:50,041 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 23:07:50,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 23:07:50,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 23:07:50,040 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:33227-0x1019995a36f0003, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 23:07:50,041 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 23:07:50,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 23:07:50,041 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 23:07:50,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 23:07:50,041 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:50,041 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 23:07:50,040 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 23:07:50,040 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39013,1690239969874 2023-07-24 23:07:50,044 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:07:50,044 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:50,044 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39595,1690239969801 2023-07-24 23:07:50,044 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:50,044 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39013,1690239969874 2023-07-24 23:07:50,044 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:07:50,044 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:50,044 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:50,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 23:07:50,075 DEBUG [Listener at jenkins-hbase4.apache.org/43617] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 23:07:50,080 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-24 23:07:50,081 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-24 23:07:50,081 DEBUG [Listener at jenkins-hbase4.apache.org/43617] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-24 23:07:50,109 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:50,151 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-07-24 23:07:50,151 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:50,151 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:50,151 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1690240069751Consolidate snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1690240070040 (+289 ms)Loading Region manifests for emptySnaptb0-testEmptyExportFileSystemState at 1690240070040Writing data manifest for emptySnaptb0-testEmptyExportFileSystemState at 1690240070051 (+11 ms)Verifying snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1690240070102 (+51 ms)Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1690240070151 (+49 ms) 2023-07-24 23:07:50,157 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=96, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-24 23:07:50,158 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=96, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 401 msec 2023-07-24 23:07:50,381 DEBUG [Listener at jenkins-hbase4.apache.org/43617] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 23:07:50,382 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-24 23:07:50,382 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-24 23:07:50,390 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33227] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,,1690240068467.f6a349f39da2c73c760af980e33c2251. with WAL disabled. Data may be lost in the event of a crash. 2023-07-24 23:07:50,392 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39595] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,1,1690240068467.2fed3f034555651fa7a6c2a80dd4f769. with WAL disabled. Data may be lost in the event of a crash. 2023-07-24 23:07:50,395 DEBUG [Listener at jenkins-hbase4.apache.org/43617] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-07-24 23:07:50,396 DEBUG [Listener at jenkins-hbase4.apache.org/43617] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1690240068467.f6a349f39da2c73c760af980e33c2251. 2023-07-24 23:07:50,396 INFO [Listener at jenkins-hbase4.apache.org/43617] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-24 23:07:50,407 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-24 23:07:50,407 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690240070407 (current time:1690240070407). 2023-07-24 23:07:50,407 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-24 23:07:50,407 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] zookeeper.ReadOnlyZKClient(139): Connect 0x45b9d3ae to 127.0.0.1:52881 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 23:07:50,417 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@ab39be1, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 23:07:50,418 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 23:07:50,425 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55778, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 23:07:50,426 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x45b9d3ae to 127.0.0.1:52881 2023-07-24 23:07:50,426 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 23:07:50,427 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] zookeeper.ReadOnlyZKClient(139): Connect 0x0c53cb81 to 127.0.0.1:52881 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 23:07:50,436 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7fc4d06, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 23:07:50,438 DEBUG [hconnection-0x1186a28b-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 23:07:50,439 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55786, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 23:07:50,443 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 23:07:50,444 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54676, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 23:07:50,445 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0c53cb81 to 127.0.0.1:52881 2023-07-24 23:07:50,445 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 23:07:50,445 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-24 23:07:50,446 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-24 23:07:50,446 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-24 23:07:50,448 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] procedure2.ProcedureExecutor(1029): Stored pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-24 23:07:50,449 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-24 23:07:50,450 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=97, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1690240670450 2023-07-24 23:07:50,450 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-07-24 23:07:50,450 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-24 23:07:50,451 DEBUG [Listener at jenkins-hbase4.apache.org/43617] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-24 23:07:50,452 DEBUG [Listener at jenkins-hbase4.apache.org/43617] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-24 23:07:50,452 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-24 23:07:50,453 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=97, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-24 23:07:50,454 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=97, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 6 msec 2023-07-24 23:07:50,455 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-24 23:07:50,455 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=98, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1690240670455 2023-07-24 23:07:50,470 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:50,470 INFO [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testEmptyExportFileSystemState' 2023-07-24 23:07:50,470 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 23:07:50,471 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-07-24 23:07:50,472 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-07-24 23:07:50,472 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:50,472 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:50,473 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:39013-0x1019995a36f0002, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 23:07:50,473 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:39595-0x1019995a36f0001, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 23:07:50,473 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 23:07:50,474 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 23:07:50,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 23:07:50,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 23:07:50,474 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:07:50,473 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:33227-0x1019995a36f0003, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 23:07:50,474 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 23:07:50,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 23:07:50,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:50,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:50,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:50,475 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:07:50,475 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39595,1690239969801 2023-07-24 23:07:50,475 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39595-0x1019995a36f0001, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:50,475 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39013-0x1019995a36f0002, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:50,475 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39595,1690239969801 2023-07-24 23:07:50,477 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-24 23:07:50,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-24 23:07:50,475 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33227-0x1019995a36f0003, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:50,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:50,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-24 23:07:50,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:50,477 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-24 23:07:50,477 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-24 23:07:50,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-24 23:07:50,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:50,477 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-24 23:07:50,477 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:50,477 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1690239969801' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-24 23:07:50,478 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1690239969801' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 23:07:50,478 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:50,479 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:50,479 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-24 23:07:50,479 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 23:07:50,479 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1690239969801' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-24 23:07:50,481 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1690239969801' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-24 23:07:50,480 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-24 23:07:50,479 DEBUG [member: 'jenkins-hbase4.apache.org,39013,1690239969874' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-24 23:07:50,481 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-24 23:07:50,481 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1690239969801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39595,1690239969801' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-24 23:07:50,481 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33227,1690239969957' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-24 23:07:50,481 DEBUG [member: 'jenkins-hbase4.apache.org,39013,1690239969874' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 23:07:50,484 DEBUG [member: 'jenkins-hbase4.apache.org,39013,1690239969874' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-24 23:07:50,484 DEBUG [member: 'jenkins-hbase4.apache.org,39013,1690239969874' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-24 23:07:50,484 DEBUG [member: 'jenkins-hbase4.apache.org,39013,1690239969874' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39013,1690239969874' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-24 23:07:50,486 DEBUG [member: 'jenkins-hbase4.apache.org,39013,1690239969874' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:50,486 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:07:50,486 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:50,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:07:50,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 23:07:50,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 23:07:50,486 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1690239969801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:50,486 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39595,1690239969801 2023-07-24 23:07:50,486 DEBUG [member: 'jenkins-hbase4.apache.org,39013,1690239969874' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39013-0x1019995a36f0002, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:50,487 DEBUG [member: 'jenkins-hbase4.apache.org,39013,1690239969874' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 23:07:50,487 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33227-0x1019995a36f0003, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:50,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 23:07:50,487 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 23:07:50,487 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1690239969801' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39595-0x1019995a36f0001, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:50,487 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1690239969801' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 23:07:50,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 23:07:50,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:50,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:07:50,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39013,1690239969874 2023-07-24 23:07:50,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39595,1690239969801 2023-07-24 23:07:50,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 23:07:50,488 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33227,1690239969957' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-24 23:07:50,489 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1dc68ec8[Count = 1] remaining members to acquire global barrier 2023-07-24 23:07:50,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39595,1690239969801 2023-07-24 23:07:50,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 23:07:50,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 23:07:50,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 23:07:50,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 23:07:50,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:50,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:07:50,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39013,1690239969874 2023-07-24 23:07:50,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39595,1690239969801 2023-07-24 23:07:50,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 23:07:50,491 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39595,1690239969801' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-24 23:07:50,491 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1dc68ec8[Count = 0] remaining members to acquire global barrier 2023-07-24 23:07:50,491 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-07-24 23:07:50,491 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:50,497 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:39595-0x1019995a36f0001, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:50,497 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:33227-0x1019995a36f0003, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:50,497 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:50,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:50,497 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:39013-0x1019995a36f0002, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:50,497 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-24 23:07:50,497 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:50,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:50,497 DEBUG [member: 'jenkins-hbase4.apache.org,39013,1690239969874' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-24 23:07:50,497 DEBUG [member: 'jenkins-hbase4.apache.org,39013,1690239969874' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-24 23:07:50,498 DEBUG [member: 'jenkins-hbase4.apache.org,39013,1690239969874' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,39013,1690239969874' in zk 2023-07-24 23:07:50,498 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:07:50,497 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:50,498 DEBUG [rs(jenkins-hbase4.apache.org,33227,1690239969957)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1690240068467.f6a349f39da2c73c760af980e33c2251. 2023-07-24 23:07:50,497 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 23:07:50,498 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 23:07:50,498 DEBUG [rs(jenkins-hbase4.apache.org,33227,1690239969957)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1690240068467.f6a349f39da2c73c760af980e33c2251. started... 2023-07-24 23:07:50,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:50,498 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39595,1690239969801 2023-07-24 23:07:50,498 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-24 23:07:50,498 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1690239969801' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-24 23:07:50,498 INFO [rs(jenkins-hbase4.apache.org,33227,1690239969957)-snapshot-pool-0] regionserver.HRegion(2745): Flushing f6a349f39da2c73c760af980e33c2251 1/1 column families, dataSize=132 B heapSize=544 B 2023-07-24 23:07:50,498 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1690239969801' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 23:07:50,498 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1690239969801' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 23:07:50,498 DEBUG [rs(jenkins-hbase4.apache.org,39595,1690239969801)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1690240068467.2fed3f034555651fa7a6c2a80dd4f769. 2023-07-24 23:07:50,499 DEBUG [rs(jenkins-hbase4.apache.org,39595,1690239969801)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1690240068467.2fed3f034555651fa7a6c2a80dd4f769. started... 2023-07-24 23:07:50,499 INFO [rs(jenkins-hbase4.apache.org,39595,1690239969801)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 2fed3f034555651fa7a6c2a80dd4f769 1/1 column families, dataSize=3.13 KB heapSize=7 KB 2023-07-24 23:07:50,499 DEBUG [member: 'jenkins-hbase4.apache.org,39013,1690239969874' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-24 23:07:50,499 DEBUG [member: 'jenkins-hbase4.apache.org,39013,1690239969874' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 23:07:50,499 DEBUG [member: 'jenkins-hbase4.apache.org,39013,1690239969874' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-24 23:07:50,535 INFO [rs(jenkins-hbase4.apache.org,33227,1690239969957)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=132 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/default/testtb-testEmptyExportFileSystemState/f6a349f39da2c73c760af980e33c2251/.tmp/cf/6f44579e0922418292118e5e98747e52 2023-07-24 23:07:50,539 INFO [rs(jenkins-hbase4.apache.org,39595,1690239969801)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.13 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/default/testtb-testEmptyExportFileSystemState/2fed3f034555651fa7a6c2a80dd4f769/.tmp/cf/0ab2199aa7374f10b09c8adc81fb3221 2023-07-24 23:07:50,543 DEBUG [rs(jenkins-hbase4.apache.org,33227,1690239969957)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/default/testtb-testEmptyExportFileSystemState/f6a349f39da2c73c760af980e33c2251/.tmp/cf/6f44579e0922418292118e5e98747e52 as hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/default/testtb-testEmptyExportFileSystemState/f6a349f39da2c73c760af980e33c2251/cf/6f44579e0922418292118e5e98747e52 2023-07-24 23:07:50,546 DEBUG [rs(jenkins-hbase4.apache.org,39595,1690239969801)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/default/testtb-testEmptyExportFileSystemState/2fed3f034555651fa7a6c2a80dd4f769/.tmp/cf/0ab2199aa7374f10b09c8adc81fb3221 as hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/default/testtb-testEmptyExportFileSystemState/2fed3f034555651fa7a6c2a80dd4f769/cf/0ab2199aa7374f10b09c8adc81fb3221 2023-07-24 23:07:50,551 INFO [rs(jenkins-hbase4.apache.org,33227,1690239969957)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/default/testtb-testEmptyExportFileSystemState/f6a349f39da2c73c760af980e33c2251/cf/6f44579e0922418292118e5e98747e52, entries=2, sequenceid=6, filesize=5.0 K 2023-07-24 23:07:50,552 DEBUG [Listener at jenkins-hbase4.apache.org/43617] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 23:07:50,552 INFO [rs(jenkins-hbase4.apache.org,33227,1690239969957)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~132 B/132, heapSize ~528 B/528, currentSize=0 B/0 for f6a349f39da2c73c760af980e33c2251 in 54ms, sequenceid=6, compaction requested=false 2023-07-24 23:07:50,553 DEBUG [rs(jenkins-hbase4.apache.org,33227,1690239969957)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testEmptyExportFileSystemState' 2023-07-24 23:07:50,553 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-24 23:07:50,553 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-24 23:07:50,553 DEBUG [Listener at jenkins-hbase4.apache.org/43617] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-24 23:07:50,553 DEBUG [rs(jenkins-hbase4.apache.org,33227,1690239969957)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for f6a349f39da2c73c760af980e33c2251: 2023-07-24 23:07:50,553 DEBUG [rs(jenkins-hbase4.apache.org,33227,1690239969957)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1690240068467.f6a349f39da2c73c760af980e33c2251.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:50,553 DEBUG [rs(jenkins-hbase4.apache.org,33227,1690239969957)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 23:07:50,554 DEBUG [rs(jenkins-hbase4.apache.org,33227,1690239969957)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/default/testtb-testEmptyExportFileSystemState/f6a349f39da2c73c760af980e33c2251/cf/6f44579e0922418292118e5e98747e52] hfiles 2023-07-24 23:07:50,554 DEBUG [rs(jenkins-hbase4.apache.org,33227,1690239969957)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/default/testtb-testEmptyExportFileSystemState/f6a349f39da2c73c760af980e33c2251/cf/6f44579e0922418292118e5e98747e52 for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:50,554 INFO [rs(jenkins-hbase4.apache.org,39595,1690239969801)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/default/testtb-testEmptyExportFileSystemState/2fed3f034555651fa7a6c2a80dd4f769/cf/0ab2199aa7374f10b09c8adc81fb3221, entries=48, sequenceid=6, filesize=8.1 K 2023-07-24 23:07:50,555 INFO [rs(jenkins-hbase4.apache.org,39595,1690239969801)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.13 KB/3204, heapSize ~6.98 KB/7152, currentSize=0 B/0 for 2fed3f034555651fa7a6c2a80dd4f769 in 56ms, sequenceid=6, compaction requested=false 2023-07-24 23:07:50,560 DEBUG [rs(jenkins-hbase4.apache.org,39595,1690239969801)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 2fed3f034555651fa7a6c2a80dd4f769: 2023-07-24 23:07:50,560 DEBUG [rs(jenkins-hbase4.apache.org,39595,1690239969801)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1690240068467.2fed3f034555651fa7a6c2a80dd4f769.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:50,560 DEBUG [rs(jenkins-hbase4.apache.org,39595,1690239969801)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 23:07:50,561 DEBUG [rs(jenkins-hbase4.apache.org,39595,1690239969801)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/default/testtb-testEmptyExportFileSystemState/2fed3f034555651fa7a6c2a80dd4f769/cf/0ab2199aa7374f10b09c8adc81fb3221] hfiles 2023-07-24 23:07:50,561 DEBUG [rs(jenkins-hbase4.apache.org,39595,1690239969801)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/default/testtb-testEmptyExportFileSystemState/2fed3f034555651fa7a6c2a80dd4f769/cf/0ab2199aa7374f10b09c8adc81fb3221 for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:50,587 DEBUG [rs(jenkins-hbase4.apache.org,33227,1690239969957)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1690240068467.f6a349f39da2c73c760af980e33c2251. completed. 2023-07-24 23:07:50,587 DEBUG [rs(jenkins-hbase4.apache.org,33227,1690239969957)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1690240068467.f6a349f39da2c73c760af980e33c2251. 2023-07-24 23:07:50,587 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 23:07:50,587 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 23:07:50,587 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:07:50,594 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-24 23:07:50,595 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,33227,1690239969957' in zk 2023-07-24 23:07:50,597 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:07:50,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:07:50,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 23:07:50,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 23:07:50,597 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-24 23:07:50,597 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 23:07:50,597 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-24 23:07:50,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 23:07:50,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 23:07:50,601 DEBUG [rs(jenkins-hbase4.apache.org,39595,1690239969801)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1690240068467.2fed3f034555651fa7a6c2a80dd4f769. completed. 2023-07-24 23:07:50,601 DEBUG [rs(jenkins-hbase4.apache.org,39595,1690239969801)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1690240068467.2fed3f034555651fa7a6c2a80dd4f769. 2023-07-24 23:07:50,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:50,601 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1690239969801' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 23:07:50,601 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1690239969801' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 23:07:50,601 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1690239969801' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39595,1690239969801 2023-07-24 23:07:50,601 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1690239969801' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-24 23:07:50,601 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1690239969801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,39595,1690239969801' in zk 2023-07-24 23:07:50,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:07:50,607 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39595,1690239969801 2023-07-24 23:07:50,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39013,1690239969874 2023-07-24 23:07:50,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39595,1690239969801 2023-07-24 23:07:50,608 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1690239969801' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-24 23:07:50,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 23:07:50,608 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1690239969801' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 23:07:50,608 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1690239969801' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-24 23:07:50,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:50,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:07:50,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39013,1690239969874 2023-07-24 23:07:50,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39595,1690239969801 2023-07-24 23:07:50,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,33227,1690239969957': 2023-07-24 23:07:50,612 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33227,1690239969957' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-24 23:07:50,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39595,1690239969801 2023-07-24 23:07:50,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 23:07:50,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 23:07:50,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 23:07:50,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 23:07:50,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:50,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:07:50,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39013,1690239969874 2023-07-24 23:07:50,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39595,1690239969801 2023-07-24 23:07:50,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 23:07:50,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:50,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:07:50,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39013,1690239969874 2023-07-24 23:07:50,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39595,1690239969801 2023-07-24 23:07:50,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,39595,1690239969801': 2023-07-24 23:07:50,616 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39595,1690239969801' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-24 23:07:50,616 INFO [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testEmptyExportFileSystemState' execution completed 2023-07-24 23:07:50,616 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-24 23:07:50,616 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-24 23:07:50,616 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:50,616 INFO [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-24 23:07:50,621 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:50,621 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:39013-0x1019995a36f0002, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:50,621 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:39013-0x1019995a36f0002, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 23:07:50,621 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:50,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:50,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 23:07:50,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 23:07:50,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:50,621 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:33227-0x1019995a36f0003, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:50,621 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:33227-0x1019995a36f0003, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 23:07:50,621 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:39595-0x1019995a36f0001, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:50,621 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:50,621 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:50,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:50,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:50,621 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:39595-0x1019995a36f0001, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 23:07:50,622 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 23:07:50,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 23:07:50,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 23:07:50,622 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 23:07:50,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 23:07:50,623 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:07:50,623 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 23:07:50,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 23:07:50,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:50,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:50,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:50,623 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39013,1690239969874 2023-07-24 23:07:50,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:50,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 23:07:50,624 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39595,1690239969801 2023-07-24 23:07:50,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:50,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:07:50,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39013,1690239969874 2023-07-24 23:07:50,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39595,1690239969801 2023-07-24 23:07:50,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 23:07:50,627 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:07:50,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:50,627 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39013,1690239969874 2023-07-24 23:07:50,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:07:50,628 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39595,1690239969801 2023-07-24 23:07:50,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39013,1690239969874 2023-07-24 23:07:50,636 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:39595-0x1019995a36f0001, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 23:07:50,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39595,1690239969801 2023-07-24 23:07:50,636 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:39013-0x1019995a36f0002, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 23:07:50,636 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:39013-0x1019995a36f0002, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 23:07:50,636 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 23:07:50,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 23:07:50,636 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 23:07:50,636 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 23:07:50,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 23:07:50,636 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:39595-0x1019995a36f0001, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 23:07:50,636 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39595,1690239969801 2023-07-24 23:07:50,638 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:50,638 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39013,1690239969874 2023-07-24 23:07:50,636 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:50,636 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:33227-0x1019995a36f0003, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 23:07:50,639 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:50,639 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 23:07:50,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 23:07:50,639 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:33227-0x1019995a36f0003, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 23:07:50,638 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:07:50,639 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:50,639 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39595,1690239969801 2023-07-24 23:07:50,639 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:50,639 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39013,1690239969874 2023-07-24 23:07:50,639 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:07:50,639 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:50,639 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:50,639 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 23:07:50,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 23:07:50,639 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 23:07:50,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 23:07:50,640 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:50,640 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 23:07:50,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 23:07:50,640 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Unable to get data of znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState because node does not exist (not an error) 2023-07-24 23:07:50,724 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState to hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.hbase-snapshot/snaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:50,753 DEBUG [Listener at jenkins-hbase4.apache.org/43617] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 23:07:50,755 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-24 23:07:50,755 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-24 23:07:50,755 DEBUG [Listener at jenkins-hbase4.apache.org/43617] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-24 23:07:50,799 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-07-24 23:07:50,799 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:50,800 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:50,800 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1690240070450Consolidate snapshot: snaptb0-testEmptyExportFileSystemState at 1690240070639 (+189 ms)Loading Region manifests for snaptb0-testEmptyExportFileSystemState at 1690240070639Writing data manifest for snaptb0-testEmptyExportFileSystemState at 1690240070660 (+21 ms)Verifying snapshot: snaptb0-testEmptyExportFileSystemState at 1690240070707 (+47 ms)Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1690240070799 (+92 ms) 2023-07-24 23:07:50,803 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=98, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-24 23:07:50,805 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=98, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 352 msec 2023-07-24 23:07:51,055 DEBUG [Listener at jenkins-hbase4.apache.org/43617] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 23:07:51,057 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-24 23:07:51,057 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-24 23:07:51,057 INFO [Listener at jenkins-hbase4.apache.org/43617] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/export-test/export-1690240071057 2023-07-24 23:07:51,057 INFO [Listener at jenkins-hbase4.apache.org/43617] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:37611, tgtDir=hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/export-test/export-1690240071057, rawTgtDir=hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/export-test/export-1690240071057, srcFsUri=hdfs://localhost:37611, srcDir=hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb 2023-07-24 23:07:51,083 DEBUG [Listener at jenkins-hbase4.apache.org/43617] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:37611, inputRoot=hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb 2023-07-24 23:07:51,083 DEBUG [Listener at jenkins-hbase4.apache.org/43617] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1654032816_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/export-test/export-1690240071057, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/export-test/export-1690240071057/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:51,083 INFO [Listener at jenkins-hbase4.apache.org/43617] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:37611, inputRoot=hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb, snapshotDir=hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState. 2023-07-24 23:07:51,096 INFO [Listener at jenkins-hbase4.apache.org/43617] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/export-test/export-1690240071057/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:51,139 DEBUG [Listener at jenkins-hbase4.apache.org/43617] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-24 23:07:51,139 DEBUG [Listener at jenkins-hbase4.apache.org/43617] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-24 23:07:51,140 DEBUG [Listener at jenkins-hbase4.apache.org/43617] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-24 23:07:51,140 DEBUG [Listener at jenkins-hbase4.apache.org/43617] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-24 23:07:51,141 DEBUG [Listener at jenkins-hbase4.apache.org/43617] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-24 23:07:51,141 DEBUG [Listener at jenkins-hbase4.apache.org/43617] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-24 23:07:51,141 DEBUG [Listener at jenkins-hbase4.apache.org/43617] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-24 23:07:51,221 DEBUG [Listener at jenkins-hbase4.apache.org/43617] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/40a10de8-ef1a-d60f-e3da-b5fca02ca095/hadoop-6134465025238749552.jar 2023-07-24 23:07:51,221 DEBUG [Listener at jenkins-hbase4.apache.org/43617] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-24 23:07:51,221 DEBUG [Listener at jenkins-hbase4.apache.org/43617] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-24 23:07:51,222 DEBUG [Listener at jenkins-hbase4.apache.org/43617] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-24 23:07:51,222 DEBUG [Listener at jenkins-hbase4.apache.org/43617] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-24 23:07:51,222 DEBUG [Listener at jenkins-hbase4.apache.org/43617] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-24 23:07:51,223 DEBUG [Listener at jenkins-hbase4.apache.org/43617] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-24 23:07:51,223 DEBUG [Listener at jenkins-hbase4.apache.org/43617] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-24 23:07:51,223 DEBUG [Listener at jenkins-hbase4.apache.org/43617] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-24 23:07:51,224 DEBUG [Listener at jenkins-hbase4.apache.org/43617] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-24 23:07:51,224 DEBUG [Listener at jenkins-hbase4.apache.org/43617] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-24 23:07:51,224 DEBUG [Listener at jenkins-hbase4.apache.org/43617] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-24 23:07:51,225 DEBUG [Listener at jenkins-hbase4.apache.org/43617] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-24 23:07:51,225 DEBUG [Listener at jenkins-hbase4.apache.org/43617] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-24 23:07:51,225 DEBUG [Listener at jenkins-hbase4.apache.org/43617] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-24 23:07:51,226 DEBUG [Listener at jenkins-hbase4.apache.org/43617] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-24 23:07:51,226 DEBUG [Listener at jenkins-hbase4.apache.org/43617] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-24 23:07:51,226 DEBUG [Listener at jenkins-hbase4.apache.org/43617] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 23:07:51,227 DEBUG [Listener at jenkins-hbase4.apache.org/43617] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 23:07:51,227 DEBUG [Listener at jenkins-hbase4.apache.org/43617] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 23:07:51,227 DEBUG [Listener at jenkins-hbase4.apache.org/43617] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 23:07:51,227 DEBUG [Listener at jenkins-hbase4.apache.org/43617] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 23:07:51,228 DEBUG [Listener at jenkins-hbase4.apache.org/43617] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 23:07:51,228 DEBUG [Listener at jenkins-hbase4.apache.org/43617] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 23:07:52,175 WARN [Listener at jenkins-hbase4.apache.org/43617] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-24 23:07:52,177 INFO [Listener at jenkins-hbase4.apache.org/43617] snapshot.ExportSnapshot(578): Loading Snapshot 'emptySnaptb0-testEmptyExportFileSystemState' hfile list 2023-07-24 23:07:52,268 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690239977721_0005_000001 (auth:SIMPLE) 2023-07-24 23:07:52,282 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-24 23:07:52,282 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-24 23:07:53,188 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690239977721_0006_000001 (auth:SIMPLE) 2023-07-24 23:07:53,306 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-24 23:07:59,347 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690239977721_0006_000001 (auth:SIMPLE) 2023-07-24 23:08:02,650 INFO [Listener at jenkins-hbase4.apache.org/43617] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-24 23:08:02,665 INFO [Listener at jenkins-hbase4.apache.org/43617] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-24 23:08:02,676 INFO [Listener at jenkins-hbase4.apache.org/43617] snapshot.ExportSnapshot(1127): Export Completed: emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 23:08:02,676 INFO [Listener at jenkins-hbase4.apache.org/43617] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-24 23:08:02,677 INFO [Listener at jenkins-hbase4.apache.org/43617] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-24 23:08:02,677 DEBUG [Listener at jenkins-hbase4.apache.org/43617] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1273988721_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 23:08:02,677 DEBUG [Listener at jenkins-hbase4.apache.org/43617] snapshot.TestExportSnapshot(367): hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-07-24 23:08:02,677 DEBUG [Listener at jenkins-hbase4.apache.org/43617] snapshot.TestExportSnapshot(367): hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-07-24 23:08:02,677 DEBUG [Listener at jenkins-hbase4.apache.org/43617] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1273988721_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/export-test/export-1690240071057/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/export-test/export-1690240071057/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 23:08:02,678 DEBUG [Listener at jenkins-hbase4.apache.org/43617] snapshot.TestExportSnapshot(367): hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/export-test/export-1690240071057/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-07-24 23:08:02,678 DEBUG [Listener at jenkins-hbase4.apache.org/43617] snapshot.TestExportSnapshot(367): hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/export-test/export-1690240071057/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-07-24 23:08:02,687 INFO [Listener at jenkins-hbase4.apache.org/43617] client.HBaseAdmin$15(890): Started disable of testtb-testEmptyExportFileSystemState 2023-07-24 23:08:02,688 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testEmptyExportFileSystemState 2023-07-24 23:08:02,689 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] procedure2.ProcedureExecutor(1029): Stored pid=99, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-24 23:08:02,693 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690240082693"}]},"ts":"1690240082693"} 2023-07-24 23:08:02,693 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-24 23:08:02,695 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLING in hbase:meta 2023-07-24 23:08:02,697 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testEmptyExportFileSystemState to state=DISABLING 2023-07-24 23:08:02,698 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=f6a349f39da2c73c760af980e33c2251, UNASSIGN}, {pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=2fed3f034555651fa7a6c2a80dd4f769, UNASSIGN}] 2023-07-24 23:08:02,700 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=f6a349f39da2c73c760af980e33c2251, UNASSIGN 2023-07-24 23:08:02,701 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=2fed3f034555651fa7a6c2a80dd4f769, UNASSIGN 2023-07-24 23:08:02,702 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=f6a349f39da2c73c760af980e33c2251, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:08:02,702 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1690240068467.f6a349f39da2c73c760af980e33c2251.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690240082702"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690240082702"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690240082702"}]},"ts":"1690240082702"} 2023-07-24 23:08:02,702 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=2fed3f034555651fa7a6c2a80dd4f769, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39595,1690239969801 2023-07-24 23:08:02,702 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1690240068467.2fed3f034555651fa7a6c2a80dd4f769.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690240082702"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690240082702"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690240082702"}]},"ts":"1690240082702"} 2023-07-24 23:08:02,704 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=102, ppid=100, state=RUNNABLE; CloseRegionProcedure f6a349f39da2c73c760af980e33c2251, server=jenkins-hbase4.apache.org,33227,1690239969957}] 2023-07-24 23:08:02,733 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=103, ppid=101, state=RUNNABLE; CloseRegionProcedure 2fed3f034555651fa7a6c2a80dd4f769, server=jenkins-hbase4.apache.org,39595,1690239969801}] 2023-07-24 23:08:02,795 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-24 23:08:02,884 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 2fed3f034555651fa7a6c2a80dd4f769 2023-07-24 23:08:02,884 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close f6a349f39da2c73c760af980e33c2251 2023-07-24 23:08:02,885 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 2fed3f034555651fa7a6c2a80dd4f769, disabling compactions & flushes 2023-07-24 23:08:02,885 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing f6a349f39da2c73c760af980e33c2251, disabling compactions & flushes 2023-07-24 23:08:02,885 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1690240068467.2fed3f034555651fa7a6c2a80dd4f769. 2023-07-24 23:08:02,885 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1690240068467.f6a349f39da2c73c760af980e33c2251. 2023-07-24 23:08:02,885 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1690240068467.2fed3f034555651fa7a6c2a80dd4f769. 2023-07-24 23:08:02,885 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1690240068467.f6a349f39da2c73c760af980e33c2251. 2023-07-24 23:08:02,885 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1690240068467.2fed3f034555651fa7a6c2a80dd4f769. after waiting 0 ms 2023-07-24 23:08:02,885 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1690240068467.f6a349f39da2c73c760af980e33c2251. after waiting 0 ms 2023-07-24 23:08:02,885 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1690240068467.f6a349f39da2c73c760af980e33c2251. 2023-07-24 23:08:02,885 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1690240068467.2fed3f034555651fa7a6c2a80dd4f769. 2023-07-24 23:08:02,899 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/default/testtb-testEmptyExportFileSystemState/2fed3f034555651fa7a6c2a80dd4f769/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-24 23:08:02,899 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 23:08:02,900 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1690240068467.2fed3f034555651fa7a6c2a80dd4f769. 2023-07-24 23:08:02,900 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 2fed3f034555651fa7a6c2a80dd4f769: 2023-07-24 23:08:02,900 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/default/testtb-testEmptyExportFileSystemState/f6a349f39da2c73c760af980e33c2251/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-24 23:08:02,901 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 23:08:02,903 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1690240068467.f6a349f39da2c73c760af980e33c2251. 2023-07-24 23:08:02,903 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for f6a349f39da2c73c760af980e33c2251: 2023-07-24 23:08:02,903 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 2fed3f034555651fa7a6c2a80dd4f769 2023-07-24 23:08:02,905 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=2fed3f034555651fa7a6c2a80dd4f769, regionState=CLOSED 2023-07-24 23:08:02,905 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1690240068467.2fed3f034555651fa7a6c2a80dd4f769.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690240082905"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690240082905"}]},"ts":"1690240082905"} 2023-07-24 23:08:02,905 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed f6a349f39da2c73c760af980e33c2251 2023-07-24 23:08:02,906 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=f6a349f39da2c73c760af980e33c2251, regionState=CLOSED 2023-07-24 23:08:02,906 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1690240068467.f6a349f39da2c73c760af980e33c2251.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690240082906"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690240082906"}]},"ts":"1690240082906"} 2023-07-24 23:08:02,909 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=103, resume processing ppid=101 2023-07-24 23:08:02,909 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=103, ppid=101, state=SUCCESS; CloseRegionProcedure 2fed3f034555651fa7a6c2a80dd4f769, server=jenkins-hbase4.apache.org,39595,1690239969801 in 173 msec 2023-07-24 23:08:02,909 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=102, resume processing ppid=100 2023-07-24 23:08:02,909 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=102, ppid=100, state=SUCCESS; CloseRegionProcedure f6a349f39da2c73c760af980e33c2251, server=jenkins-hbase4.apache.org,33227,1690239969957 in 203 msec 2023-07-24 23:08:02,910 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=101, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=2fed3f034555651fa7a6c2a80dd4f769, UNASSIGN in 211 msec 2023-07-24 23:08:02,911 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=100, resume processing ppid=99 2023-07-24 23:08:02,911 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=100, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=f6a349f39da2c73c760af980e33c2251, UNASSIGN in 211 msec 2023-07-24 23:08:02,912 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690240082912"}]},"ts":"1690240082912"} 2023-07-24 23:08:02,918 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLED in hbase:meta 2023-07-24 23:08:02,920 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testEmptyExportFileSystemState to state=DISABLED 2023-07-24 23:08:02,922 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=99, state=SUCCESS; DisableTableProcedure table=testtb-testEmptyExportFileSystemState in 232 msec 2023-07-24 23:08:02,996 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-24 23:08:02,998 INFO [Listener at jenkins-hbase4.apache.org/43617] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 99 completed 2023-07-24 23:08:02,999 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testEmptyExportFileSystemState 2023-07-24 23:08:03,000 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] procedure2.ProcedureExecutor(1029): Stored pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-24 23:08:03,002 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-24 23:08:03,002 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] access.PermissionStorage(259): Removing permissions of removed table testtb-testEmptyExportFileSystemState 2023-07-24 23:08:03,003 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=104, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-24 23:08:03,004 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33227] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testEmptyExportFileSystemState 2023-07-24 23:08:03,008 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.tmp/data/default/testtb-testEmptyExportFileSystemState/2fed3f034555651fa7a6c2a80dd4f769 2023-07-24 23:08:03,008 DEBUG [HFileArchiver-21] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.tmp/data/default/testtb-testEmptyExportFileSystemState/f6a349f39da2c73c760af980e33c2251 2023-07-24 23:08:03,009 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:33227-0x1019995a36f0003, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-24 23:08:03,009 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:39595-0x1019995a36f0001, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-24 23:08:03,009 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:39013-0x1019995a36f0002, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-24 23:08:03,009 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-24 23:08:03,010 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-24 23:08:03,010 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-24 23:08:03,011 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:33227-0x1019995a36f0003, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-24 23:08:03,011 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:39595-0x1019995a36f0001, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-24 23:08:03,011 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data null 2023-07-24 23:08:03,011 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 23:08:03,011 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-24 23:08:03,011 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:39595-0x1019995a36f0001, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 23:08:03,011 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data null 2023-07-24 23:08:03,011 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-24 23:08:03,011 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:39013-0x1019995a36f0002, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 23:08:03,011 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:33227-0x1019995a36f0003, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 23:08:03,013 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.tmp/data/default/testtb-testEmptyExportFileSystemState/2fed3f034555651fa7a6c2a80dd4f769/cf, FileablePath, hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.tmp/data/default/testtb-testEmptyExportFileSystemState/2fed3f034555651fa7a6c2a80dd4f769/recovered.edits] 2023-07-24 23:08:03,015 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-24 23:08:03,020 DEBUG [HFileArchiver-21] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.tmp/data/default/testtb-testEmptyExportFileSystemState/f6a349f39da2c73c760af980e33c2251/cf, FileablePath, hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.tmp/data/default/testtb-testEmptyExportFileSystemState/f6a349f39da2c73c760af980e33c2251/recovered.edits] 2023-07-24 23:08:03,024 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.tmp/data/default/testtb-testEmptyExportFileSystemState/2fed3f034555651fa7a6c2a80dd4f769/cf/0ab2199aa7374f10b09c8adc81fb3221 to hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/archive/data/default/testtb-testEmptyExportFileSystemState/2fed3f034555651fa7a6c2a80dd4f769/cf/0ab2199aa7374f10b09c8adc81fb3221 2023-07-24 23:08:03,027 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.tmp/data/default/testtb-testEmptyExportFileSystemState/f6a349f39da2c73c760af980e33c2251/cf/6f44579e0922418292118e5e98747e52 to hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/archive/data/default/testtb-testEmptyExportFileSystemState/f6a349f39da2c73c760af980e33c2251/cf/6f44579e0922418292118e5e98747e52 2023-07-24 23:08:03,029 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.tmp/data/default/testtb-testEmptyExportFileSystemState/2fed3f034555651fa7a6c2a80dd4f769/recovered.edits/9.seqid to hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/archive/data/default/testtb-testEmptyExportFileSystemState/2fed3f034555651fa7a6c2a80dd4f769/recovered.edits/9.seqid 2023-07-24 23:08:03,030 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.tmp/data/default/testtb-testEmptyExportFileSystemState/2fed3f034555651fa7a6c2a80dd4f769 2023-07-24 23:08:03,032 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.tmp/data/default/testtb-testEmptyExportFileSystemState/f6a349f39da2c73c760af980e33c2251/recovered.edits/9.seqid to hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/archive/data/default/testtb-testEmptyExportFileSystemState/f6a349f39da2c73c760af980e33c2251/recovered.edits/9.seqid 2023-07-24 23:08:03,032 DEBUG [HFileArchiver-21] backup.HFileArchiver(596): Deleted hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.tmp/data/default/testtb-testEmptyExportFileSystemState/f6a349f39da2c73c760af980e33c2251 2023-07-24 23:08:03,032 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-07-24 23:08:03,035 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=104, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-24 23:08:03,037 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testEmptyExportFileSystemState from hbase:meta 2023-07-24 23:08:03,039 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testEmptyExportFileSystemState' descriptor. 2023-07-24 23:08:03,041 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=104, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-24 23:08:03,041 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testEmptyExportFileSystemState' from region states. 2023-07-24 23:08:03,041 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,,1690240068467.f6a349f39da2c73c760af980e33c2251.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690240083041"}]},"ts":"9223372036854775807"} 2023-07-24 23:08:03,042 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,1,1690240068467.2fed3f034555651fa7a6c2a80dd4f769.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690240083041"}]},"ts":"9223372036854775807"} 2023-07-24 23:08:03,045 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-24 23:08:03,045 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => f6a349f39da2c73c760af980e33c2251, NAME => 'testtb-testEmptyExportFileSystemState,,1690240068467.f6a349f39da2c73c760af980e33c2251.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 2fed3f034555651fa7a6c2a80dd4f769, NAME => 'testtb-testEmptyExportFileSystemState,1,1690240068467.2fed3f034555651fa7a6c2a80dd4f769.', STARTKEY => '1', ENDKEY => ''}] 2023-07-24 23:08:03,045 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testEmptyExportFileSystemState' as deleted. 2023-07-24 23:08:03,045 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1690240083045"}]},"ts":"9223372036854775807"} 2023-07-24 23:08:03,047 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testEmptyExportFileSystemState state from META 2023-07-24 23:08:03,050 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=104, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-24 23:08:03,051 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=104, state=SUCCESS; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState in 51 msec 2023-07-24 23:08:03,120 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-24 23:08:03,121 INFO [Listener at jenkins-hbase4.apache.org/43617] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 104 completed 2023-07-24 23:08:03,136 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testEmptyExportFileSystemState" 2023-07-24 23:08:03,138 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 23:08:03,140 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testEmptyExportFileSystemState" 2023-07-24 23:08:03,141 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testEmptyExportFileSystemState 2023-07-24 23:08:03,179 INFO [Listener at jenkins-hbase4.apache.org/43617] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testEmptyExportFileSystemState Thread=762 (was 758) Potentially hanging thread: hconnection-0x2b6dd434-shared-pool-37 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x2b6dd434-shared-pool-38 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1273988721_17 at /127.0.0.1:35992 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1273988721_17 at /127.0.0.1:37488 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1273988721_17 at /127.0.0.1:55622 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-4600 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: hconnection-0x2b6dd434-shared-pool-39 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_2063092735_1 at /127.0.0.1:37462 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_2063092735_1 at /127.0.0.1:35970 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x2b6dd434-shared-pool-36 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (717546083) connection to jenkins-hbase4.apache.org/172.31.14.131:43087 from appattempt_1690239977721_0006_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: IPC Client (717546083) connection to jenkins-hbase4.apache.org/172.31.14.131:43617 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: ApplicationMasterLauncher #10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-21 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (717546083) connection to jenkins-hbase4.apache.org/172.31.14.131:38617 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) - Thread LEAK? -, OpenFileDescriptor=912 (was 902) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=643 (was 561) - SystemLoadAverage LEAK? -, ProcessCount=182 (was 185), AvailableMemoryMB=4513 (was 5317) 2023-07-24 23:08:03,179 WARN [Listener at jenkins-hbase4.apache.org/43617] hbase.ResourceChecker(130): Thread=762 is superior to 500 2023-07-24 23:08:03,202 INFO [Listener at jenkins-hbase4.apache.org/43617] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=762, OpenFileDescriptor=910, MaxFileDescriptor=60000, SystemLoadAverage=643, ProcessCount=182, AvailableMemoryMB=4511 2023-07-24 23:08:03,202 WARN [Listener at jenkins-hbase4.apache.org/43617] hbase.ResourceChecker(130): Thread=762 is superior to 500 2023-07-24 23:08:03,204 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-24 23:08:03,205 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] procedure2.ProcedureExecutor(1029): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:03,207 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_PRE_OPERATION 2023-07-24 23:08:03,208 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithSkipTmp" procId is: 105 2023-07-24 23:08:03,208 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-24 23:08:03,209 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-24 23:08:03,211 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/5532b625b4ff2e76cc8bf1c92e78f458 2023-07-24 23:08:03,211 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/5cd7062fa62f155a72c04e65b0f8d07d 2023-07-24 23:08:03,211 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/5cd7062fa62f155a72c04e65b0f8d07d empty. 2023-07-24 23:08:03,211 DEBUG [HFileArchiver-20] backup.HFileArchiver(153): Directory hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/5532b625b4ff2e76cc8bf1c92e78f458 empty. 2023-07-24 23:08:03,212 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/5cd7062fa62f155a72c04e65b0f8d07d 2023-07-24 23:08:03,212 DEBUG [HFileArchiver-20] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/5532b625b4ff2e76cc8bf1c92e78f458 2023-07-24 23:08:03,212 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-07-24 23:08:03,250 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/.tabledesc/.tableinfo.0000000001 2023-07-24 23:08:03,251 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(7675): creating {ENCODED => 5532b625b4ff2e76cc8bf1c92e78f458, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1690240083204.5532b625b4ff2e76cc8bf1c92e78f458.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.tmp 2023-07-24 23:08:03,252 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(7675): creating {ENCODED => 5cd7062fa62f155a72c04e65b0f8d07d, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1690240083204.5cd7062fa62f155a72c04e65b0f8d07d.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.tmp 2023-07-24 23:08:03,310 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-24 23:08:03,328 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1690240083204.5532b625b4ff2e76cc8bf1c92e78f458.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 23:08:03,328 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1604): Closing 5532b625b4ff2e76cc8bf1c92e78f458, disabling compactions & flushes 2023-07-24 23:08:03,328 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1690240083204.5532b625b4ff2e76cc8bf1c92e78f458. 2023-07-24 23:08:03,328 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1690240083204.5532b625b4ff2e76cc8bf1c92e78f458. 2023-07-24 23:08:03,328 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1690240083204.5532b625b4ff2e76cc8bf1c92e78f458. after waiting 0 ms 2023-07-24 23:08:03,328 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1690240083204.5532b625b4ff2e76cc8bf1c92e78f458. 2023-07-24 23:08:03,328 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1690240083204.5532b625b4ff2e76cc8bf1c92e78f458. 2023-07-24 23:08:03,328 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1558): Region close journal for 5532b625b4ff2e76cc8bf1c92e78f458: 2023-07-24 23:08:03,335 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1690240083204.5cd7062fa62f155a72c04e65b0f8d07d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 23:08:03,335 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1604): Closing 5cd7062fa62f155a72c04e65b0f8d07d, disabling compactions & flushes 2023-07-24 23:08:03,335 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1690240083204.5cd7062fa62f155a72c04e65b0f8d07d. 2023-07-24 23:08:03,335 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1690240083204.5cd7062fa62f155a72c04e65b0f8d07d. 2023-07-24 23:08:03,335 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1690240083204.5cd7062fa62f155a72c04e65b0f8d07d. after waiting 0 ms 2023-07-24 23:08:03,335 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1690240083204.5cd7062fa62f155a72c04e65b0f8d07d. 2023-07-24 23:08:03,335 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1690240083204.5cd7062fa62f155a72c04e65b0f8d07d. 2023-07-24 23:08:03,335 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1558): Region close journal for 5cd7062fa62f155a72c04e65b0f8d07d: 2023-07-24 23:08:03,339 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ADD_TO_META 2023-07-24 23:08:03,343 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1690240083204.5532b625b4ff2e76cc8bf1c92e78f458.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690240083342"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690240083342"}]},"ts":"1690240083342"} 2023-07-24 23:08:03,343 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1690240083204.5cd7062fa62f155a72c04e65b0f8d07d.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690240083342"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690240083342"}]},"ts":"1690240083342"} 2023-07-24 23:08:03,345 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-24 23:08:03,346 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-24 23:08:03,347 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690240083346"}]},"ts":"1690240083346"} 2023-07-24 23:08:03,348 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLING in hbase:meta 2023-07-24 23:08:03,352 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-24 23:08:03,353 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-24 23:08:03,353 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-24 23:08:03,354 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-24 23:08:03,354 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-24 23:08:03,354 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=5532b625b4ff2e76cc8bf1c92e78f458, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=5cd7062fa62f155a72c04e65b0f8d07d, ASSIGN}] 2023-07-24 23:08:03,360 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=5cd7062fa62f155a72c04e65b0f8d07d, ASSIGN 2023-07-24 23:08:03,360 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=5532b625b4ff2e76cc8bf1c92e78f458, ASSIGN 2023-07-24 23:08:03,362 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=5532b625b4ff2e76cc8bf1c92e78f458, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33227,1690239969957; forceNewPlan=false, retain=false 2023-07-24 23:08:03,362 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=5cd7062fa62f155a72c04e65b0f8d07d, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39013,1690239969874; forceNewPlan=false, retain=false 2023-07-24 23:08:03,511 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-24 23:08:03,512 INFO [jenkins-hbase4:37213] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-24 23:08:03,516 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=5cd7062fa62f155a72c04e65b0f8d07d, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39013,1690239969874 2023-07-24 23:08:03,516 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1690240083204.5cd7062fa62f155a72c04e65b0f8d07d.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690240083515"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690240083515"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690240083515"}]},"ts":"1690240083515"} 2023-07-24 23:08:03,516 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=5532b625b4ff2e76cc8bf1c92e78f458, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:08:03,516 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1690240083204.5532b625b4ff2e76cc8bf1c92e78f458.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690240083515"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690240083515"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690240083515"}]},"ts":"1690240083515"} 2023-07-24 23:08:03,520 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=108, ppid=107, state=RUNNABLE; OpenRegionProcedure 5cd7062fa62f155a72c04e65b0f8d07d, server=jenkins-hbase4.apache.org,39013,1690239969874}] 2023-07-24 23:08:03,521 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=109, ppid=106, state=RUNNABLE; OpenRegionProcedure 5532b625b4ff2e76cc8bf1c92e78f458, server=jenkins-hbase4.apache.org,33227,1690239969957}] 2023-07-24 23:08:03,682 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,1,1690240083204.5cd7062fa62f155a72c04e65b0f8d07d. 2023-07-24 23:08:03,682 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 5cd7062fa62f155a72c04e65b0f8d07d, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1690240083204.5cd7062fa62f155a72c04e65b0f8d07d.', STARTKEY => '1', ENDKEY => ''} 2023-07-24 23:08:03,682 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,1,1690240083204.5cd7062fa62f155a72c04e65b0f8d07d. service=AccessControlService 2023-07-24 23:08:03,683 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 23:08:03,683 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp 5cd7062fa62f155a72c04e65b0f8d07d 2023-07-24 23:08:03,683 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1690240083204.5cd7062fa62f155a72c04e65b0f8d07d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 23:08:03,683 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 5cd7062fa62f155a72c04e65b0f8d07d 2023-07-24 23:08:03,683 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 5cd7062fa62f155a72c04e65b0f8d07d 2023-07-24 23:08:03,684 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,,1690240083204.5532b625b4ff2e76cc8bf1c92e78f458. 2023-07-24 23:08:03,684 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 5532b625b4ff2e76cc8bf1c92e78f458, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1690240083204.5532b625b4ff2e76cc8bf1c92e78f458.', STARTKEY => '', ENDKEY => '1'} 2023-07-24 23:08:03,684 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,,1690240083204.5532b625b4ff2e76cc8bf1c92e78f458. service=AccessControlService 2023-07-24 23:08:03,685 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 23:08:03,685 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp 5532b625b4ff2e76cc8bf1c92e78f458 2023-07-24 23:08:03,685 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1690240083204.5532b625b4ff2e76cc8bf1c92e78f458.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 23:08:03,685 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 5532b625b4ff2e76cc8bf1c92e78f458 2023-07-24 23:08:03,685 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 5532b625b4ff2e76cc8bf1c92e78f458 2023-07-24 23:08:03,686 INFO [StoreOpener-5532b625b4ff2e76cc8bf1c92e78f458-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 5532b625b4ff2e76cc8bf1c92e78f458 2023-07-24 23:08:03,688 DEBUG [StoreOpener-5532b625b4ff2e76cc8bf1c92e78f458-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/default/testtb-testExportFileSystemStateWithSkipTmp/5532b625b4ff2e76cc8bf1c92e78f458/cf 2023-07-24 23:08:03,688 DEBUG [StoreOpener-5532b625b4ff2e76cc8bf1c92e78f458-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/default/testtb-testExportFileSystemStateWithSkipTmp/5532b625b4ff2e76cc8bf1c92e78f458/cf 2023-07-24 23:08:03,688 INFO [StoreOpener-5532b625b4ff2e76cc8bf1c92e78f458-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5532b625b4ff2e76cc8bf1c92e78f458 columnFamilyName cf 2023-07-24 23:08:03,689 INFO [StoreOpener-5532b625b4ff2e76cc8bf1c92e78f458-1] regionserver.HStore(310): Store=5532b625b4ff2e76cc8bf1c92e78f458/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 23:08:03,695 INFO [StoreOpener-5cd7062fa62f155a72c04e65b0f8d07d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 5cd7062fa62f155a72c04e65b0f8d07d 2023-07-24 23:08:03,695 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/default/testtb-testExportFileSystemStateWithSkipTmp/5532b625b4ff2e76cc8bf1c92e78f458 2023-07-24 23:08:03,696 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/default/testtb-testExportFileSystemStateWithSkipTmp/5532b625b4ff2e76cc8bf1c92e78f458 2023-07-24 23:08:03,696 DEBUG [StoreOpener-5cd7062fa62f155a72c04e65b0f8d07d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/default/testtb-testExportFileSystemStateWithSkipTmp/5cd7062fa62f155a72c04e65b0f8d07d/cf 2023-07-24 23:08:03,696 DEBUG [StoreOpener-5cd7062fa62f155a72c04e65b0f8d07d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/default/testtb-testExportFileSystemStateWithSkipTmp/5cd7062fa62f155a72c04e65b0f8d07d/cf 2023-07-24 23:08:03,699 INFO [StoreOpener-5cd7062fa62f155a72c04e65b0f8d07d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5cd7062fa62f155a72c04e65b0f8d07d columnFamilyName cf 2023-07-24 23:08:03,699 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 5532b625b4ff2e76cc8bf1c92e78f458 2023-07-24 23:08:03,701 INFO [StoreOpener-5cd7062fa62f155a72c04e65b0f8d07d-1] regionserver.HStore(310): Store=5cd7062fa62f155a72c04e65b0f8d07d/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 23:08:03,702 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/default/testtb-testExportFileSystemStateWithSkipTmp/5532b625b4ff2e76cc8bf1c92e78f458/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-24 23:08:03,702 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/default/testtb-testExportFileSystemStateWithSkipTmp/5cd7062fa62f155a72c04e65b0f8d07d 2023-07-24 23:08:03,703 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/default/testtb-testExportFileSystemStateWithSkipTmp/5cd7062fa62f155a72c04e65b0f8d07d 2023-07-24 23:08:03,703 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 5532b625b4ff2e76cc8bf1c92e78f458; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60344912, jitterRate=-0.10079073905944824}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-24 23:08:03,703 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 5532b625b4ff2e76cc8bf1c92e78f458: 2023-07-24 23:08:03,704 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,,1690240083204.5532b625b4ff2e76cc8bf1c92e78f458., pid=109, masterSystemTime=1690240083675 2023-07-24 23:08:03,706 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,,1690240083204.5532b625b4ff2e76cc8bf1c92e78f458. 2023-07-24 23:08:03,706 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,,1690240083204.5532b625b4ff2e76cc8bf1c92e78f458. 2023-07-24 23:08:03,706 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=5532b625b4ff2e76cc8bf1c92e78f458, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:08:03,707 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1690240083204.5532b625b4ff2e76cc8bf1c92e78f458.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690240083706"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690240083706"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690240083706"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690240083706"}]},"ts":"1690240083706"} 2023-07-24 23:08:03,708 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 5cd7062fa62f155a72c04e65b0f8d07d 2023-07-24 23:08:03,711 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/default/testtb-testExportFileSystemStateWithSkipTmp/5cd7062fa62f155a72c04e65b0f8d07d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-24 23:08:03,712 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=109, resume processing ppid=106 2023-07-24 23:08:03,712 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=109, ppid=106, state=SUCCESS; OpenRegionProcedure 5532b625b4ff2e76cc8bf1c92e78f458, server=jenkins-hbase4.apache.org,33227,1690239969957 in 189 msec 2023-07-24 23:08:03,712 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 5cd7062fa62f155a72c04e65b0f8d07d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65346285, jitterRate=-0.026264473795890808}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-24 23:08:03,712 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 5cd7062fa62f155a72c04e65b0f8d07d: 2023-07-24 23:08:03,713 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,1,1690240083204.5cd7062fa62f155a72c04e65b0f8d07d., pid=108, masterSystemTime=1690240083674 2023-07-24 23:08:03,714 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=5532b625b4ff2e76cc8bf1c92e78f458, ASSIGN in 358 msec 2023-07-24 23:08:03,716 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=5cd7062fa62f155a72c04e65b0f8d07d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39013,1690239969874 2023-07-24 23:08:03,716 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,1,1690240083204.5cd7062fa62f155a72c04e65b0f8d07d. 2023-07-24 23:08:03,716 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,1,1690240083204.5cd7062fa62f155a72c04e65b0f8d07d. 2023-07-24 23:08:03,716 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1690240083204.5cd7062fa62f155a72c04e65b0f8d07d.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690240083716"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690240083716"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690240083716"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690240083716"}]},"ts":"1690240083716"} 2023-07-24 23:08:03,721 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=108, resume processing ppid=107 2023-07-24 23:08:03,721 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=108, ppid=107, state=SUCCESS; OpenRegionProcedure 5cd7062fa62f155a72c04e65b0f8d07d, server=jenkins-hbase4.apache.org,39013,1690239969874 in 198 msec 2023-07-24 23:08:03,723 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=107, resume processing ppid=105 2023-07-24 23:08:03,723 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=5cd7062fa62f155a72c04e65b0f8d07d, ASSIGN in 367 msec 2023-07-24 23:08:03,725 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-24 23:08:03,725 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690240083725"}]},"ts":"1690240083725"} 2023-07-24 23:08:03,727 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLED in hbase:meta 2023-07-24 23:08:03,730 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_POST_OPERATION 2023-07-24 23:08:03,730 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithSkipTmp jenkins: RWXCA 2023-07-24 23:08:03,733 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33227] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-24 23:08:03,735 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:39595-0x1019995a36f0001, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 23:08:03,735 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:33227-0x1019995a36f0003, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 23:08:03,735 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:39013-0x1019995a36f0002, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 23:08:03,735 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 23:08:03,736 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-24 23:08:03,736 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-24 23:08:03,737 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-24 23:08:03,737 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-24 23:08:03,742 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=105, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 534 msec 2023-07-24 23:08:03,813 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-24 23:08:03,813 INFO [Listener at jenkins-hbase4.apache.org/43617] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 105 completed 2023-07-24 23:08:03,814 DEBUG [Listener at jenkins-hbase4.apache.org/43617] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testExportFileSystemStateWithSkipTmp get assigned. Timeout = 60000ms 2023-07-24 23:08:03,814 INFO [Listener at jenkins-hbase4.apache.org/43617] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-24 23:08:03,818 INFO [Listener at jenkins-hbase4.apache.org/43617] hbase.HBaseTestingUtility(3484): All regions for table testtb-testExportFileSystemStateWithSkipTmp assigned to meta. Checking AM states. 2023-07-24 23:08:03,818 INFO [Listener at jenkins-hbase4.apache.org/43617] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-24 23:08:03,819 INFO [Listener at jenkins-hbase4.apache.org/43617] hbase.HBaseTestingUtility(3504): All regions for table testtb-testExportFileSystemStateWithSkipTmp assigned. 2023-07-24 23:08:03,836 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-24 23:08:03,836 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690240083836 (current time:1690240083836). 2023-07-24 23:08:03,836 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-24 23:08:03,837 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] zookeeper.ReadOnlyZKClient(139): Connect 0x017abee9 to 127.0.0.1:52881 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 23:08:03,864 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6903481f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 23:08:03,866 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 23:08:03,869 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44312, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 23:08:03,871 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x017abee9 to 127.0.0.1:52881 2023-07-24 23:08:03,871 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 23:08:03,871 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] zookeeper.ReadOnlyZKClient(139): Connect 0x1937aa2d to 127.0.0.1:52881 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 23:08:03,887 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4d6ec214, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 23:08:03,888 DEBUG [hconnection-0x3e5e3816-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 23:08:03,891 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44318, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 23:08:03,895 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 23:08:03,898 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46152, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 23:08:03,900 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1937aa2d to 127.0.0.1:52881 2023-07-24 23:08:03,900 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 23:08:03,900 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-24 23:08:03,901 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-24 23:08:03,901 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-24 23:08:03,903 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] procedure2.ProcedureExecutor(1029): Stored pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-24 23:08:03,906 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-24 23:08:03,908 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=110, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1690240683908 2023-07-24 23:08:03,908 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-24 23:08:03,908 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:03,908 DEBUG [Listener at jenkins-hbase4.apache.org/43617] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-24 23:08:03,910 DEBUG [Listener at jenkins-hbase4.apache.org/43617] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-24 23:08:03,912 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=110, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-24 23:08:03,912 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-24 23:08:03,913 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=110, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 9 msec 2023-07-24 23:08:03,914 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-24 23:08:03,914 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=111, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1690240683914 2023-07-24 23:08:04,010 DEBUG [Listener at jenkins-hbase4.apache.org/43617] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 23:08:04,011 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-24 23:08:04,011 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-24 23:08:04,012 DEBUG [Listener at jenkins-hbase4.apache.org/43617] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-24 23:08:04,212 DEBUG [Listener at jenkins-hbase4.apache.org/43617] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 23:08:04,213 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-24 23:08:04,213 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-24 23:08:04,213 DEBUG [Listener at jenkins-hbase4.apache.org/43617] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-24 23:08:04,375 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:04,375 INFO [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' 2023-07-24 23:08:04,375 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 23:08:04,375 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-07-24 23:08:04,375 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-07-24 23:08:04,375 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:04,375 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:04,378 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:39595-0x1019995a36f0001, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 23:08:04,378 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:33227-0x1019995a36f0003, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 23:08:04,378 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:39013-0x1019995a36f0002, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 23:08:04,378 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 23:08:04,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 23:08:04,378 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 23:08:04,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 23:08:04,378 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:08:04,378 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 23:08:04,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:04,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 23:08:04,380 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:08:04,380 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39013,1690239969874 2023-07-24 23:08:04,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:04,380 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39013-0x1019995a36f0002, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:04,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:04,380 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39013,1690239969874 2023-07-24 23:08:04,380 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-24 23:08:04,380 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39595-0x1019995a36f0001, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:04,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-24 23:08:04,381 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33227-0x1019995a36f0003, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:04,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:04,381 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-24 23:08:04,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-24 23:08:04,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:04,381 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-24 23:08:04,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-24 23:08:04,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:04,382 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-24 23:08:04,382 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:04,383 DEBUG [member: 'jenkins-hbase4.apache.org,39013,1690239969874' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-24 23:08:04,383 DEBUG [member: 'jenkins-hbase4.apache.org,39013,1690239969874' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 23:08:04,384 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:04,397 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-24 23:08:04,397 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 23:08:04,394 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:04,386 DEBUG [member: 'jenkins-hbase4.apache.org,39013,1690239969874' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-24 23:08:04,400 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1690239969801' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-24 23:08:04,400 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-24 23:08:04,400 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-24 23:08:04,400 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33227,1690239969957' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-24 23:08:04,400 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1690239969801' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 23:08:04,400 DEBUG [member: 'jenkins-hbase4.apache.org,39013,1690239969874' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-24 23:08:04,400 DEBUG [member: 'jenkins-hbase4.apache.org,39013,1690239969874' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39013,1690239969874' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-24 23:08:04,402 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1690239969801' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-24 23:08:04,402 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1690239969801' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-24 23:08:04,402 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1690239969801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39595,1690239969801' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-24 23:08:04,412 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39013,1690239969874 2023-07-24 23:08:04,412 DEBUG [member: 'jenkins-hbase4.apache.org,39013,1690239969874' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:04,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39013,1690239969874 2023-07-24 23:08:04,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 23:08:04,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 23:08:04,413 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:08:04,413 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:04,414 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1690239969801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:04,414 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33227-0x1019995a36f0003, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:04,414 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 23:08:04,414 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1690239969801' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39595-0x1019995a36f0001, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:04,414 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1690239969801' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 23:08:04,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 23:08:04,414 DEBUG [member: 'jenkins-hbase4.apache.org,39013,1690239969874' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39013-0x1019995a36f0002, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:04,414 DEBUG [member: 'jenkins-hbase4.apache.org,39013,1690239969874' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 23:08:04,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 23:08:04,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:04,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:08:04,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39013,1690239969874 2023-07-24 23:08:04,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39595,1690239969801 2023-07-24 23:08:04,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 23:08:04,418 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39013,1690239969874' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-24 23:08:04,418 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@40957bf7[Count = 1] remaining members to acquire global barrier 2023-07-24 23:08:04,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:08:04,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 23:08:04,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 23:08:04,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 23:08:04,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 23:08:04,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:04,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:08:04,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39013,1690239969874 2023-07-24 23:08:04,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39595,1690239969801 2023-07-24 23:08:04,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 23:08:04,421 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33227,1690239969957' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-24 23:08:04,421 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@40957bf7[Count = 0] remaining members to acquire global barrier 2023-07-24 23:08:04,421 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-07-24 23:08:04,421 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:04,429 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:33227-0x1019995a36f0003, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:04,429 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:39013-0x1019995a36f0002, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:04,429 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:04,429 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:39595-0x1019995a36f0001, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:04,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:04,429 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:04,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:04,429 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-24 23:08:04,429 DEBUG [member: 'jenkins-hbase4.apache.org,39013,1690239969874' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-24 23:08:04,429 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:04,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:04,429 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39013,1690239969874 2023-07-24 23:08:04,429 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1690239969801' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-24 23:08:04,429 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1690239969801' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-24 23:08:04,429 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1690239969801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,39595,1690239969801' in zk 2023-07-24 23:08:04,430 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:08:04,430 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-24 23:08:04,431 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1690239969801' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-24 23:08:04,431 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1690239969801' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 23:08:04,431 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1690239969801' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-24 23:08:04,434 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 23:08:04,451 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 23:08:04,451 DEBUG [rs(jenkins-hbase4.apache.org,33227,1690239969957)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1690240083204.5532b625b4ff2e76cc8bf1c92e78f458. 2023-07-24 23:08:04,451 DEBUG [rs(jenkins-hbase4.apache.org,39013,1690239969874)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1690240083204.5cd7062fa62f155a72c04e65b0f8d07d. 2023-07-24 23:08:04,451 DEBUG [rs(jenkins-hbase4.apache.org,33227,1690239969957)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1690240083204.5532b625b4ff2e76cc8bf1c92e78f458. started... 2023-07-24 23:08:04,450 DEBUG [member: 'jenkins-hbase4.apache.org,39013,1690239969874' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 23:08:04,451 DEBUG [member: 'jenkins-hbase4.apache.org,39013,1690239969874' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 23:08:04,451 DEBUG [rs(jenkins-hbase4.apache.org,39013,1690239969874)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1690240083204.5cd7062fa62f155a72c04e65b0f8d07d. started... 2023-07-24 23:08:04,453 DEBUG [rs(jenkins-hbase4.apache.org,33227,1690239969957)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 5532b625b4ff2e76cc8bf1c92e78f458: 2023-07-24 23:08:04,455 DEBUG [rs(jenkins-hbase4.apache.org,33227,1690239969957)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1690240083204.5532b625b4ff2e76cc8bf1c92e78f458.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:04,455 DEBUG [rs(jenkins-hbase4.apache.org,33227,1690239969957)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 23:08:04,455 DEBUG [rs(jenkins-hbase4.apache.org,33227,1690239969957)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-24 23:08:04,455 DEBUG [rs(jenkins-hbase4.apache.org,39013,1690239969874)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 5cd7062fa62f155a72c04e65b0f8d07d: 2023-07-24 23:08:04,455 DEBUG [rs(jenkins-hbase4.apache.org,39013,1690239969874)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1690240083204.5cd7062fa62f155a72c04e65b0f8d07d.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:04,455 DEBUG [rs(jenkins-hbase4.apache.org,39013,1690239969874)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 23:08:04,455 DEBUG [rs(jenkins-hbase4.apache.org,39013,1690239969874)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-24 23:08:04,513 DEBUG [Listener at jenkins-hbase4.apache.org/43617] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 23:08:04,514 DEBUG [rs(jenkins-hbase4.apache.org,39013,1690239969874)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1690240083204.5cd7062fa62f155a72c04e65b0f8d07d. completed. 2023-07-24 23:08:04,514 DEBUG [rs(jenkins-hbase4.apache.org,39013,1690239969874)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1690240083204.5cd7062fa62f155a72c04e65b0f8d07d. 2023-07-24 23:08:04,514 DEBUG [member: 'jenkins-hbase4.apache.org,39013,1690239969874' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 23:08:04,514 DEBUG [member: 'jenkins-hbase4.apache.org,39013,1690239969874' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 23:08:04,514 DEBUG [member: 'jenkins-hbase4.apache.org,39013,1690239969874' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39013,1690239969874 2023-07-24 23:08:04,514 DEBUG [member: 'jenkins-hbase4.apache.org,39013,1690239969874' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-24 23:08:04,514 DEBUG [member: 'jenkins-hbase4.apache.org,39013,1690239969874' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,39013,1690239969874' in zk 2023-07-24 23:08:04,514 DEBUG [rs(jenkins-hbase4.apache.org,33227,1690239969957)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1690240083204.5532b625b4ff2e76cc8bf1c92e78f458. completed. 2023-07-24 23:08:04,514 DEBUG [rs(jenkins-hbase4.apache.org,33227,1690239969957)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1690240083204.5532b625b4ff2e76cc8bf1c92e78f458. 2023-07-24 23:08:04,515 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-24 23:08:04,515 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 23:08:04,515 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 23:08:04,515 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:08:04,515 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-24 23:08:04,515 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,33227,1690239969957' in zk 2023-07-24 23:08:04,515 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-24 23:08:04,516 DEBUG [Listener at jenkins-hbase4.apache.org/43617] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-24 23:08:04,517 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39013,1690239969874 2023-07-24 23:08:04,517 DEBUG [member: 'jenkins-hbase4.apache.org,39013,1690239969874' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-24 23:08:04,517 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:08:04,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39013,1690239969874 2023-07-24 23:08:04,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 23:08:04,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 23:08:04,517 DEBUG [member: 'jenkins-hbase4.apache.org,39013,1690239969874' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 23:08:04,517 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-24 23:08:04,517 DEBUG [member: 'jenkins-hbase4.apache.org,39013,1690239969874' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-24 23:08:04,518 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 23:08:04,519 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-24 23:08:04,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 23:08:04,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 23:08:04,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:04,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:08:04,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39013,1690239969874 2023-07-24 23:08:04,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39595,1690239969801 2023-07-24 23:08:04,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 23:08:04,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:04,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:08:04,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39013,1690239969874 2023-07-24 23:08:04,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39595,1690239969801 2023-07-24 23:08:04,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,39013,1690239969874': 2023-07-24 23:08:04,525 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39013,1690239969874' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-07-24 23:08:04,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:08:04,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 23:08:04,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 23:08:04,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 23:08:04,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 23:08:04,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:04,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:08:04,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39013,1690239969874 2023-07-24 23:08:04,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39595,1690239969801 2023-07-24 23:08:04,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 23:08:04,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:04,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:08:04,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39013,1690239969874 2023-07-24 23:08:04,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39595,1690239969801 2023-07-24 23:08:04,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,33227,1690239969957': 2023-07-24 23:08:04,529 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33227,1690239969957' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-07-24 23:08:04,529 INFO [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-07-24 23:08:04,530 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-24 23:08:04,530 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-24 23:08:04,530 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:04,530 INFO [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-24 23:08:04,541 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:39013-0x1019995a36f0002, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:04,541 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:33227-0x1019995a36f0003, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:04,541 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:04,541 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:39595-0x1019995a36f0001, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:04,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:04,541 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:04,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 23:08:04,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:04,541 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:39595-0x1019995a36f0001, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 23:08:04,541 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:04,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:04,541 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:33227-0x1019995a36f0003, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 23:08:04,541 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:04,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:04,541 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:39013-0x1019995a36f0002, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 23:08:04,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 23:08:04,542 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 23:08:04,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 23:08:04,542 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:08:04,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 23:08:04,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:04,542 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 23:08:04,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 23:08:04,542 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 23:08:04,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 23:08:04,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:04,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:04,543 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39013,1690239969874 2023-07-24 23:08:04,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:04,544 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39595,1690239969801 2023-07-24 23:08:04,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 23:08:04,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:04,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:08:04,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39013,1690239969874 2023-07-24 23:08:04,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39595,1690239969801 2023-07-24 23:08:04,545 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:08:04,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 23:08:04,546 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39013,1690239969874 2023-07-24 23:08:04,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:04,546 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39595,1690239969801 2023-07-24 23:08:04,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:08:04,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39013,1690239969874 2023-07-24 23:08:04,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39595,1690239969801 2023-07-24 23:08:04,552 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:33227-0x1019995a36f0003, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 23:08:04,552 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:39595-0x1019995a36f0001, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 23:08:04,552 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 23:08:04,552 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:33227-0x1019995a36f0003, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 23:08:04,552 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39595,1690239969801 2023-07-24 23:08:04,553 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:04,553 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39013,1690239969874 2023-07-24 23:08:04,553 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:08:04,553 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:04,553 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39595,1690239969801 2023-07-24 23:08:04,553 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:04,553 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39013,1690239969874 2023-07-24 23:08:04,553 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:39013-0x1019995a36f0002, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 23:08:04,553 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 23:08:04,553 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 23:08:04,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 23:08:04,552 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 23:08:04,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 23:08:04,552 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:39595-0x1019995a36f0001, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 23:08:04,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 23:08:04,553 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:39013-0x1019995a36f0002, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 23:08:04,553 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:04,553 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:08:04,555 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:04,555 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:04,555 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 23:08:04,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 23:08:04,555 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:04,555 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 23:08:04,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 23:08:04,556 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:04,558 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 23:08:04,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 23:08:05,016 DEBUG [Listener at jenkins-hbase4.apache.org/43617] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 23:08:05,017 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-24 23:08:05,018 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-24 23:08:05,018 DEBUG [Listener at jenkins-hbase4.apache.org/43617] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-07-24 23:08:05,039 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:05,128 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-07-24 23:08:05,128 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:05,129 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:05,129 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1690240083908Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1690240084555 (+647 ms)Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1690240084555Writing data manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1690240084568 (+13 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1690240085005 (+437 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1690240085128 (+123 ms) 2023-07-24 23:08:05,132 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=111, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-24 23:08:05,134 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=111, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 1.2220 sec 2023-07-24 23:08:06,018 DEBUG [Listener at jenkins-hbase4.apache.org/43617] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 23:08:06,019 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-24 23:08:06,019 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-24 23:08:06,025 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33227] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,,1690240083204.5532b625b4ff2e76cc8bf1c92e78f458. with WAL disabled. Data may be lost in the event of a crash. 2023-07-24 23:08:06,026 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39013] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,1,1690240083204.5cd7062fa62f155a72c04e65b0f8d07d. with WAL disabled. Data may be lost in the event of a crash. 2023-07-24 23:08:06,029 DEBUG [Listener at jenkins-hbase4.apache.org/43617] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:06,029 DEBUG [Listener at jenkins-hbase4.apache.org/43617] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1690240083204.5532b625b4ff2e76cc8bf1c92e78f458. 2023-07-24 23:08:06,029 INFO [Listener at jenkins-hbase4.apache.org/43617] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-24 23:08:06,042 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-24 23:08:06,043 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690240086043 (current time:1690240086043). 2023-07-24 23:08:06,043 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-24 23:08:06,043 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] zookeeper.ReadOnlyZKClient(139): Connect 0x023617bc to 127.0.0.1:52881 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 23:08:06,051 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4d671164, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 23:08:06,052 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 23:08:06,053 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44326, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 23:08:06,054 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x023617bc to 127.0.0.1:52881 2023-07-24 23:08:06,054 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 23:08:06,055 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] zookeeper.ReadOnlyZKClient(139): Connect 0x7cae14dd to 127.0.0.1:52881 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 23:08:06,060 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4e176703, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 23:08:06,062 DEBUG [hconnection-0x3b8eb394-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 23:08:06,065 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44338, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 23:08:06,069 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 23:08:06,071 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46154, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 23:08:06,072 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7cae14dd to 127.0.0.1:52881 2023-07-24 23:08:06,072 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 23:08:06,072 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-24 23:08:06,073 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-24 23:08:06,073 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-24 23:08:06,075 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] procedure2.ProcedureExecutor(1029): Stored pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-24 23:08:06,076 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-24 23:08:06,077 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=112, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1690240686077 2023-07-24 23:08:06,077 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:06,077 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-24 23:08:06,078 DEBUG [Listener at jenkins-hbase4.apache.org/43617] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-24 23:08:06,078 DEBUG [Listener at jenkins-hbase4.apache.org/43617] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-24 23:08:06,078 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-24 23:08:06,079 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=112, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-24 23:08:06,080 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=112, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 5 msec 2023-07-24 23:08:06,081 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-24 23:08:06,081 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=113, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1690240686081 2023-07-24 23:08:06,090 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:06,090 INFO [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' 2023-07-24 23:08:06,090 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 23:08:06,091 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-07-24 23:08:06,091 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-07-24 23:08:06,091 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:06,091 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:06,093 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:08:06,093 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:33227-0x1019995a36f0003, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 23:08:06,093 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:39595-0x1019995a36f0001, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 23:08:06,093 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 23:08:06,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 23:08:06,093 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:39013-0x1019995a36f0002, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 23:08:06,093 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 23:08:06,093 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 23:08:06,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 23:08:06,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 23:08:06,093 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:08:06,093 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39013,1690239969874 2023-07-24 23:08:06,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:06,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:06,094 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33227-0x1019995a36f0003, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:06,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:06,094 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39013,1690239969874 2023-07-24 23:08:06,094 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-24 23:08:06,094 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39595-0x1019995a36f0001, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:06,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-24 23:08:06,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:06,094 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39013-0x1019995a36f0002, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:06,094 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-24 23:08:06,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-24 23:08:06,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:06,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-24 23:08:06,094 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-24 23:08:06,094 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:06,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:06,095 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-24 23:08:06,095 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:06,095 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-24 23:08:06,095 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1690239969801' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-24 23:08:06,095 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1690239969801' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 23:08:06,095 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 23:08:06,096 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:06,096 DEBUG [member: 'jenkins-hbase4.apache.org,39013,1690239969874' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-24 23:08:06,096 DEBUG [member: 'jenkins-hbase4.apache.org,39013,1690239969874' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 23:08:06,096 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1690239969801' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-24 23:08:06,097 DEBUG [member: 'jenkins-hbase4.apache.org,39013,1690239969874' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-24 23:08:06,096 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-24 23:08:06,097 DEBUG [member: 'jenkins-hbase4.apache.org,39013,1690239969874' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-24 23:08:06,097 DEBUG [member: 'jenkins-hbase4.apache.org,39013,1690239969874' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39013,1690239969874' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-24 23:08:06,097 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1690239969801' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-24 23:08:06,097 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1690239969801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39595,1690239969801' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-24 23:08:06,097 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-24 23:08:06,097 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33227,1690239969957' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-24 23:08:06,100 DEBUG [member: 'jenkins-hbase4.apache.org,39013,1690239969874' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:06,100 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39013,1690239969874 2023-07-24 23:08:06,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39013,1690239969874 2023-07-24 23:08:06,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 23:08:06,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 23:08:06,101 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1690239969801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:06,101 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:06,101 DEBUG [member: 'jenkins-hbase4.apache.org,39013,1690239969874' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39013-0x1019995a36f0002, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:06,101 DEBUG [member: 'jenkins-hbase4.apache.org,39013,1690239969874' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 23:08:06,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 23:08:06,101 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:08:06,102 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1690239969801' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39595-0x1019995a36f0001, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:06,102 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1690239969801' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 23:08:06,102 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33227-0x1019995a36f0003, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:06,102 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 23:08:06,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 23:08:06,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:06,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:08:06,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39013,1690239969874 2023-07-24 23:08:06,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39595,1690239969801 2023-07-24 23:08:06,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 23:08:06,104 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39013,1690239969874' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-24 23:08:06,104 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1948c6fc[Count = 1] remaining members to acquire global barrier 2023-07-24 23:08:06,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:08:06,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 23:08:06,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 23:08:06,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 23:08:06,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 23:08:06,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:06,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:08:06,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39013,1690239969874 2023-07-24 23:08:06,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39595,1690239969801 2023-07-24 23:08:06,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 23:08:06,106 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33227,1690239969957' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-24 23:08:06,106 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1948c6fc[Count = 0] remaining members to acquire global barrier 2023-07-24 23:08:06,106 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-07-24 23:08:06,106 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:06,111 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:39595-0x1019995a36f0001, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:06,111 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:06,111 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:33227-0x1019995a36f0003, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:06,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:06,111 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:06,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:06,111 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:39013-0x1019995a36f0002, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:06,111 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-24 23:08:06,111 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:06,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:06,111 DEBUG [member: 'jenkins-hbase4.apache.org,39013,1690239969874' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-24 23:08:06,111 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39013,1690239969874 2023-07-24 23:08:06,111 DEBUG [member: 'jenkins-hbase4.apache.org,39013,1690239969874' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 23:08:06,111 DEBUG [member: 'jenkins-hbase4.apache.org,39013,1690239969874' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 23:08:06,111 DEBUG [rs(jenkins-hbase4.apache.org,39013,1690239969874)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1690240083204.5cd7062fa62f155a72c04e65b0f8d07d. 2023-07-24 23:08:06,111 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 23:08:06,112 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 23:08:06,112 DEBUG [rs(jenkins-hbase4.apache.org,39013,1690239969874)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1690240083204.5cd7062fa62f155a72c04e65b0f8d07d. started... 2023-07-24 23:08:06,112 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1690239969801' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-24 23:08:06,111 DEBUG [rs(jenkins-hbase4.apache.org,33227,1690239969957)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1690240083204.5532b625b4ff2e76cc8bf1c92e78f458. 2023-07-24 23:08:06,112 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:08:06,112 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-24 23:08:06,112 DEBUG [rs(jenkins-hbase4.apache.org,33227,1690239969957)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1690240083204.5532b625b4ff2e76cc8bf1c92e78f458. started... 2023-07-24 23:08:06,112 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1690239969801' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-24 23:08:06,112 INFO [rs(jenkins-hbase4.apache.org,39013,1690239969874)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 5cd7062fa62f155a72c04e65b0f8d07d 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-07-24 23:08:06,112 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1690239969801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,39595,1690239969801' in zk 2023-07-24 23:08:06,112 INFO [rs(jenkins-hbase4.apache.org,33227,1690239969957)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 5532b625b4ff2e76cc8bf1c92e78f458 1/1 column families, dataSize=199 B heapSize=688 B 2023-07-24 23:08:06,114 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1690239969801' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-24 23:08:06,114 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1690239969801' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 23:08:06,114 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1690239969801' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-24 23:08:06,125 INFO [rs(jenkins-hbase4.apache.org,33227,1690239969957)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=199 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/default/testtb-testExportFileSystemStateWithSkipTmp/5532b625b4ff2e76cc8bf1c92e78f458/.tmp/cf/b74c95a2f5714b53b45f67e1d0f77be7 2023-07-24 23:08:06,127 INFO [rs(jenkins-hbase4.apache.org,39013,1690239969874)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.06 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/default/testtb-testExportFileSystemStateWithSkipTmp/5cd7062fa62f155a72c04e65b0f8d07d/.tmp/cf/be419cc0d61b431e909d156487a60468 2023-07-24 23:08:06,131 DEBUG [rs(jenkins-hbase4.apache.org,33227,1690239969957)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/default/testtb-testExportFileSystemStateWithSkipTmp/5532b625b4ff2e76cc8bf1c92e78f458/.tmp/cf/b74c95a2f5714b53b45f67e1d0f77be7 as hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/default/testtb-testExportFileSystemStateWithSkipTmp/5532b625b4ff2e76cc8bf1c92e78f458/cf/b74c95a2f5714b53b45f67e1d0f77be7 2023-07-24 23:08:06,132 DEBUG [rs(jenkins-hbase4.apache.org,39013,1690239969874)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/default/testtb-testExportFileSystemStateWithSkipTmp/5cd7062fa62f155a72c04e65b0f8d07d/.tmp/cf/be419cc0d61b431e909d156487a60468 as hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/default/testtb-testExportFileSystemStateWithSkipTmp/5cd7062fa62f155a72c04e65b0f8d07d/cf/be419cc0d61b431e909d156487a60468 2023-07-24 23:08:06,137 INFO [rs(jenkins-hbase4.apache.org,33227,1690239969957)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/default/testtb-testExportFileSystemStateWithSkipTmp/5532b625b4ff2e76cc8bf1c92e78f458/cf/b74c95a2f5714b53b45f67e1d0f77be7, entries=3, sequenceid=6, filesize=5.0 K 2023-07-24 23:08:06,138 INFO [rs(jenkins-hbase4.apache.org,39013,1690239969874)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/default/testtb-testExportFileSystemStateWithSkipTmp/5cd7062fa62f155a72c04e65b0f8d07d/cf/be419cc0d61b431e909d156487a60468, entries=47, sequenceid=6, filesize=8.0 K 2023-07-24 23:08:06,138 INFO [rs(jenkins-hbase4.apache.org,33227,1690239969957)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for 5532b625b4ff2e76cc8bf1c92e78f458 in 26ms, sequenceid=6, compaction requested=false 2023-07-24 23:08:06,138 DEBUG [rs(jenkins-hbase4.apache.org,33227,1690239969957)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithSkipTmp' 2023-07-24 23:08:06,138 DEBUG [rs(jenkins-hbase4.apache.org,33227,1690239969957)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 5532b625b4ff2e76cc8bf1c92e78f458: 2023-07-24 23:08:06,138 INFO [rs(jenkins-hbase4.apache.org,39013,1690239969874)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for 5cd7062fa62f155a72c04e65b0f8d07d in 26ms, sequenceid=6, compaction requested=false 2023-07-24 23:08:06,140 DEBUG [rs(jenkins-hbase4.apache.org,39013,1690239969874)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 5cd7062fa62f155a72c04e65b0f8d07d: 2023-07-24 23:08:06,140 DEBUG [rs(jenkins-hbase4.apache.org,33227,1690239969957)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1690240083204.5532b625b4ff2e76cc8bf1c92e78f458.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:06,140 DEBUG [rs(jenkins-hbase4.apache.org,39013,1690239969874)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1690240083204.5cd7062fa62f155a72c04e65b0f8d07d.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:06,140 DEBUG [rs(jenkins-hbase4.apache.org,33227,1690239969957)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 23:08:06,140 DEBUG [rs(jenkins-hbase4.apache.org,39013,1690239969874)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 23:08:06,140 DEBUG [rs(jenkins-hbase4.apache.org,33227,1690239969957)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/default/testtb-testExportFileSystemStateWithSkipTmp/5532b625b4ff2e76cc8bf1c92e78f458/cf/b74c95a2f5714b53b45f67e1d0f77be7] hfiles 2023-07-24 23:08:06,140 DEBUG [rs(jenkins-hbase4.apache.org,39013,1690239969874)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/default/testtb-testExportFileSystemStateWithSkipTmp/5cd7062fa62f155a72c04e65b0f8d07d/cf/be419cc0d61b431e909d156487a60468] hfiles 2023-07-24 23:08:06,140 DEBUG [rs(jenkins-hbase4.apache.org,39013,1690239969874)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/default/testtb-testExportFileSystemStateWithSkipTmp/5cd7062fa62f155a72c04e65b0f8d07d/cf/be419cc0d61b431e909d156487a60468 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:06,140 DEBUG [rs(jenkins-hbase4.apache.org,33227,1690239969957)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/default/testtb-testExportFileSystemStateWithSkipTmp/5532b625b4ff2e76cc8bf1c92e78f458/cf/b74c95a2f5714b53b45f67e1d0f77be7 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:06,164 DEBUG [rs(jenkins-hbase4.apache.org,39013,1690239969874)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1690240083204.5cd7062fa62f155a72c04e65b0f8d07d. completed. 2023-07-24 23:08:06,164 DEBUG [rs(jenkins-hbase4.apache.org,39013,1690239969874)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1690240083204.5cd7062fa62f155a72c04e65b0f8d07d. 2023-07-24 23:08:06,164 DEBUG [member: 'jenkins-hbase4.apache.org,39013,1690239969874' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 23:08:06,164 DEBUG [member: 'jenkins-hbase4.apache.org,39013,1690239969874' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 23:08:06,164 DEBUG [member: 'jenkins-hbase4.apache.org,39013,1690239969874' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39013,1690239969874 2023-07-24 23:08:06,164 DEBUG [member: 'jenkins-hbase4.apache.org,39013,1690239969874' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-24 23:08:06,164 DEBUG [member: 'jenkins-hbase4.apache.org,39013,1690239969874' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,39013,1690239969874' in zk 2023-07-24 23:08:06,166 DEBUG [rs(jenkins-hbase4.apache.org,33227,1690239969957)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1690240083204.5532b625b4ff2e76cc8bf1c92e78f458. completed. 2023-07-24 23:08:06,166 DEBUG [rs(jenkins-hbase4.apache.org,33227,1690239969957)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1690240083204.5532b625b4ff2e76cc8bf1c92e78f458. 2023-07-24 23:08:06,166 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 23:08:06,166 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 23:08:06,166 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:08:06,166 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-24 23:08:06,166 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,33227,1690239969957' in zk 2023-07-24 23:08:06,166 DEBUG [member: 'jenkins-hbase4.apache.org,39013,1690239969874' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-24 23:08:06,167 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39013,1690239969874 2023-07-24 23:08:06,167 DEBUG [member: 'jenkins-hbase4.apache.org,39013,1690239969874' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 23:08:06,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39013,1690239969874 2023-07-24 23:08:06,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 23:08:06,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 23:08:06,167 DEBUG [member: 'jenkins-hbase4.apache.org,39013,1690239969874' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-24 23:08:06,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 23:08:06,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 23:08:06,170 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:08:06,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:06,170 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-24 23:08:06,170 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 23:08:06,170 DEBUG [member: 'jenkins-hbase4.apache.org,33227,1690239969957' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-24 23:08:06,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:08:06,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39013,1690239969874 2023-07-24 23:08:06,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39595,1690239969801 2023-07-24 23:08:06,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 23:08:06,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:06,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:08:06,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39013,1690239969874 2023-07-24 23:08:06,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39595,1690239969801 2023-07-24 23:08:06,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,39013,1690239969874': 2023-07-24 23:08:06,174 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39013,1690239969874' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-07-24 23:08:06,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:08:06,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 23:08:06,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 23:08:06,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 23:08:06,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 23:08:06,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:06,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:08:06,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39013,1690239969874 2023-07-24 23:08:06,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39595,1690239969801 2023-07-24 23:08:06,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 23:08:06,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:06,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:08:06,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39013,1690239969874 2023-07-24 23:08:06,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39595,1690239969801 2023-07-24 23:08:06,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,33227,1690239969957': 2023-07-24 23:08:06,177 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33227,1690239969957' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-07-24 23:08:06,177 INFO [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-07-24 23:08:06,177 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-24 23:08:06,177 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-24 23:08:06,177 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:06,177 INFO [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-24 23:08:06,179 DEBUG [Listener at jenkins-hbase4.apache.org/43617] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 23:08:06,179 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-24 23:08:06,179 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-24 23:08:06,180 DEBUG [Listener at jenkins-hbase4.apache.org/43617] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-24 23:08:06,180 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:39595-0x1019995a36f0001, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:06,180 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:33227-0x1019995a36f0003, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:06,180 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:06,180 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:33227-0x1019995a36f0003, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 23:08:06,180 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:06,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:06,180 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:06,180 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:39595-0x1019995a36f0001, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 23:08:06,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:06,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 23:08:06,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 23:08:06,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:06,181 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:08:06,181 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 23:08:06,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 23:08:06,181 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 23:08:06,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 23:08:06,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 23:08:06,181 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39013,1690239969874 2023-07-24 23:08:06,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:06,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:06,182 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39595,1690239969801 2023-07-24 23:08:06,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:06,183 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:39013-0x1019995a36f0002, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:06,183 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:39013-0x1019995a36f0002, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 23:08:06,183 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:06,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:06,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 23:08:06,185 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 23:08:06,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 23:08:06,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:06,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:06,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:08:06,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39013,1690239969874 2023-07-24 23:08:06,187 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:08:06,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39595,1690239969801 2023-07-24 23:08:06,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 23:08:06,191 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39013,1690239969874 2023-07-24 23:08:06,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:06,192 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39595,1690239969801 2023-07-24 23:08:06,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:08:06,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39013,1690239969874 2023-07-24 23:08:06,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39595,1690239969801 2023-07-24 23:08:06,196 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:33227-0x1019995a36f0003, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 23:08:06,196 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:33227-0x1019995a36f0003, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 23:08:06,196 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:39595-0x1019995a36f0001, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 23:08:06,196 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:39595-0x1019995a36f0001, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 23:08:06,196 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 23:08:06,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 23:08:06,196 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:39013-0x1019995a36f0002, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 23:08:06,196 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:39013-0x1019995a36f0002, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 23:08:06,196 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 23:08:06,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 23:08:06,196 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 23:08:06,196 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39595,1690239969801 2023-07-24 23:08:06,196 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:06,196 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39013,1690239969874 2023-07-24 23:08:06,196 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:08:06,196 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:06,196 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39595,1690239969801 2023-07-24 23:08:06,196 DEBUG [(jenkins-hbase4.apache.org,37213,1690239968296)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 23:08:06,197 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:06,199 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:06,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 23:08:06,196 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:06,199 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39013,1690239969874 2023-07-24 23:08:06,199 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:08:06,199 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:06,200 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:06,200 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:06,200 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 23:08:06,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 23:08:06,200 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 23:08:06,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 23:08:06,200 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 23:08:06,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 23:08:06,224 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:06,286 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-07-24 23:08:06,286 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:06,286 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:06,287 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1690240086077Consolidate snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1690240086199 (+122 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithSkipTmp at 1690240086199Writing data manifest for snaptb0-testExportFileSystemStateWithSkipTmp at 1690240086204 (+5 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1690240086215 (+11 ms)Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1690240086286 (+71 ms) 2023-07-24 23:08:06,290 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=113, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-24 23:08:06,291 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=113, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 212 msec 2023-07-24 23:08:06,380 DEBUG [Listener at jenkins-hbase4.apache.org/43617] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 23:08:06,381 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-24 23:08:06,381 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-24 23:08:06,381 INFO [Listener at jenkins-hbase4.apache.org/43617] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/export-test/export-1690240086381 2023-07-24 23:08:06,381 INFO [Listener at jenkins-hbase4.apache.org/43617] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:37611, tgtDir=hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/export-test/export-1690240086381, rawTgtDir=hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/export-test/export-1690240086381, srcFsUri=hdfs://localhost:37611, srcDir=hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb 2023-07-24 23:08:06,407 DEBUG [Listener at jenkins-hbase4.apache.org/43617] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:37611, inputRoot=hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb 2023-07-24 23:08:06,407 DEBUG [Listener at jenkins-hbase4.apache.org/43617] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-272306933_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/export-test/export-1690240086381, skipTmp=true, initialOutputSnapshotDir=hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/export-test/export-1690240086381/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:06,407 INFO [Listener at jenkins-hbase4.apache.org/43617] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:37611, inputRoot=hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb, snapshotDir=hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp. 2023-07-24 23:08:06,430 INFO [Listener at jenkins-hbase4.apache.org/43617] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/export-test/export-1690240086381/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:06,470 DEBUG [Listener at jenkins-hbase4.apache.org/43617] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-24 23:08:06,470 DEBUG [Listener at jenkins-hbase4.apache.org/43617] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-24 23:08:06,471 DEBUG [Listener at jenkins-hbase4.apache.org/43617] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-24 23:08:06,471 DEBUG [Listener at jenkins-hbase4.apache.org/43617] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-24 23:08:06,471 DEBUG [Listener at jenkins-hbase4.apache.org/43617] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-24 23:08:06,472 DEBUG [Listener at jenkins-hbase4.apache.org/43617] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-24 23:08:06,472 DEBUG [Listener at jenkins-hbase4.apache.org/43617] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-24 23:08:06,555 DEBUG [Listener at jenkins-hbase4.apache.org/43617] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/40a10de8-ef1a-d60f-e3da-b5fca02ca095/hadoop-890389643459031462.jar 2023-07-24 23:08:06,556 DEBUG [Listener at jenkins-hbase4.apache.org/43617] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-24 23:08:06,556 DEBUG [Listener at jenkins-hbase4.apache.org/43617] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-24 23:08:06,557 DEBUG [Listener at jenkins-hbase4.apache.org/43617] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-24 23:08:06,557 DEBUG [Listener at jenkins-hbase4.apache.org/43617] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-24 23:08:06,558 DEBUG [Listener at jenkins-hbase4.apache.org/43617] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-24 23:08:06,558 DEBUG [Listener at jenkins-hbase4.apache.org/43617] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-24 23:08:06,559 DEBUG [Listener at jenkins-hbase4.apache.org/43617] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-24 23:08:06,560 DEBUG [Listener at jenkins-hbase4.apache.org/43617] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-24 23:08:06,560 DEBUG [Listener at jenkins-hbase4.apache.org/43617] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-24 23:08:06,561 DEBUG [Listener at jenkins-hbase4.apache.org/43617] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-24 23:08:06,561 DEBUG [Listener at jenkins-hbase4.apache.org/43617] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-24 23:08:06,562 DEBUG [Listener at jenkins-hbase4.apache.org/43617] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-24 23:08:06,562 DEBUG [Listener at jenkins-hbase4.apache.org/43617] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-24 23:08:06,563 DEBUG [Listener at jenkins-hbase4.apache.org/43617] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-24 23:08:06,563 DEBUG [Listener at jenkins-hbase4.apache.org/43617] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-24 23:08:06,564 DEBUG [Listener at jenkins-hbase4.apache.org/43617] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-24 23:08:06,565 DEBUG [Listener at jenkins-hbase4.apache.org/43617] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 23:08:06,565 DEBUG [Listener at jenkins-hbase4.apache.org/43617] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 23:08:06,566 DEBUG [Listener at jenkins-hbase4.apache.org/43617] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 23:08:06,566 DEBUG [Listener at jenkins-hbase4.apache.org/43617] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 23:08:06,566 DEBUG [Listener at jenkins-hbase4.apache.org/43617] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 23:08:06,567 DEBUG [Listener at jenkins-hbase4.apache.org/43617] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 23:08:06,568 DEBUG [Listener at jenkins-hbase4.apache.org/43617] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 23:08:06,822 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690239977721_0006_000001 (auth:SIMPLE) 2023-07-24 23:08:07,651 WARN [Listener at jenkins-hbase4.apache.org/43617] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-24 23:08:07,653 INFO [Listener at jenkins-hbase4.apache.org/43617] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithSkipTmp' hfile list 2023-07-24 23:08:07,655 DEBUG [Listener at jenkins-hbase4.apache.org/43617] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-24 23:08:07,715 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-24 23:08:07,717 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-24 23:08:07,830 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690239977721_0007_000001 (auth:SIMPLE) 2023-07-24 23:08:08,505 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-24 23:08:13,377 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690239977721_0007_000001 (auth:SIMPLE) 2023-07-24 23:08:15,715 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690239977721_0007_000001 (auth:SIMPLE) 2023-07-24 23:08:21,882 INFO [Listener at jenkins-hbase4.apache.org/43617] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-24 23:08:21,883 INFO [Listener at jenkins-hbase4.apache.org/43617] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-24 23:08:21,897 INFO [Listener at jenkins-hbase4.apache.org/43617] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:21,898 INFO [Listener at jenkins-hbase4.apache.org/43617] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-24 23:08:21,898 INFO [Listener at jenkins-hbase4.apache.org/43617] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-24 23:08:21,898 DEBUG [Listener at jenkins-hbase4.apache.org/43617] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1273988721_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:21,899 DEBUG [Listener at jenkins-hbase4.apache.org/43617] snapshot.TestExportSnapshot(367): hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-07-24 23:08:21,899 DEBUG [Listener at jenkins-hbase4.apache.org/43617] snapshot.TestExportSnapshot(367): hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-07-24 23:08:21,899 DEBUG [Listener at jenkins-hbase4.apache.org/43617] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1273988721_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/export-test/export-1690240086381/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/export-test/export-1690240086381/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:21,899 DEBUG [Listener at jenkins-hbase4.apache.org/43617] snapshot.TestExportSnapshot(367): hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/export-test/export-1690240086381/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-07-24 23:08:21,900 DEBUG [Listener at jenkins-hbase4.apache.org/43617] snapshot.TestExportSnapshot(367): hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/export-test/export-1690240086381/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-07-24 23:08:21,912 INFO [Listener at jenkins-hbase4.apache.org/43617] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:21,912 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:21,913 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] procedure2.ProcedureExecutor(1029): Stored pid=114, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:21,918 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-24 23:08:21,919 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690240101919"}]},"ts":"1690240101919"} 2023-07-24 23:08:21,921 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLING in hbase:meta 2023-07-24 23:08:21,923 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLING 2023-07-24 23:08:21,924 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=5532b625b4ff2e76cc8bf1c92e78f458, UNASSIGN}, {pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=5cd7062fa62f155a72c04e65b0f8d07d, UNASSIGN}] 2023-07-24 23:08:21,927 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=5cd7062fa62f155a72c04e65b0f8d07d, UNASSIGN 2023-07-24 23:08:21,927 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=5532b625b4ff2e76cc8bf1c92e78f458, UNASSIGN 2023-07-24 23:08:21,930 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=5cd7062fa62f155a72c04e65b0f8d07d, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39013,1690239969874 2023-07-24 23:08:21,930 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=5532b625b4ff2e76cc8bf1c92e78f458, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:08:21,930 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1690240083204.5cd7062fa62f155a72c04e65b0f8d07d.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690240101930"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690240101930"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690240101930"}]},"ts":"1690240101930"} 2023-07-24 23:08:21,930 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1690240083204.5532b625b4ff2e76cc8bf1c92e78f458.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690240101930"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690240101930"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690240101930"}]},"ts":"1690240101930"} 2023-07-24 23:08:21,933 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=117, ppid=116, state=RUNNABLE; CloseRegionProcedure 5cd7062fa62f155a72c04e65b0f8d07d, server=jenkins-hbase4.apache.org,39013,1690239969874}] 2023-07-24 23:08:21,933 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=118, ppid=115, state=RUNNABLE; CloseRegionProcedure 5532b625b4ff2e76cc8bf1c92e78f458, server=jenkins-hbase4.apache.org,33227,1690239969957}] 2023-07-24 23:08:22,019 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-24 23:08:22,086 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 5cd7062fa62f155a72c04e65b0f8d07d 2023-07-24 23:08:22,086 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 5532b625b4ff2e76cc8bf1c92e78f458 2023-07-24 23:08:22,086 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 5cd7062fa62f155a72c04e65b0f8d07d, disabling compactions & flushes 2023-07-24 23:08:22,086 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 5532b625b4ff2e76cc8bf1c92e78f458, disabling compactions & flushes 2023-07-24 23:08:22,086 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1690240083204.5cd7062fa62f155a72c04e65b0f8d07d. 2023-07-24 23:08:22,086 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1690240083204.5532b625b4ff2e76cc8bf1c92e78f458. 2023-07-24 23:08:22,086 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1690240083204.5cd7062fa62f155a72c04e65b0f8d07d. 2023-07-24 23:08:22,086 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1690240083204.5532b625b4ff2e76cc8bf1c92e78f458. 2023-07-24 23:08:22,086 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1690240083204.5cd7062fa62f155a72c04e65b0f8d07d. after waiting 0 ms 2023-07-24 23:08:22,086 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1690240083204.5532b625b4ff2e76cc8bf1c92e78f458. after waiting 0 ms 2023-07-24 23:08:22,086 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1690240083204.5532b625b4ff2e76cc8bf1c92e78f458. 2023-07-24 23:08:22,086 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1690240083204.5cd7062fa62f155a72c04e65b0f8d07d. 2023-07-24 23:08:22,103 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/default/testtb-testExportFileSystemStateWithSkipTmp/5532b625b4ff2e76cc8bf1c92e78f458/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-24 23:08:22,105 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 23:08:22,107 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1690240083204.5532b625b4ff2e76cc8bf1c92e78f458. 2023-07-24 23:08:22,107 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 5532b625b4ff2e76cc8bf1c92e78f458: 2023-07-24 23:08:22,108 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/default/testtb-testExportFileSystemStateWithSkipTmp/5cd7062fa62f155a72c04e65b0f8d07d/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-24 23:08:22,109 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 23:08:22,110 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 5532b625b4ff2e76cc8bf1c92e78f458 2023-07-24 23:08:22,110 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=5532b625b4ff2e76cc8bf1c92e78f458, regionState=CLOSED 2023-07-24 23:08:22,110 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1690240083204.5532b625b4ff2e76cc8bf1c92e78f458.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690240102110"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690240102110"}]},"ts":"1690240102110"} 2023-07-24 23:08:22,114 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=118, resume processing ppid=115 2023-07-24 23:08:22,114 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=118, ppid=115, state=SUCCESS; CloseRegionProcedure 5532b625b4ff2e76cc8bf1c92e78f458, server=jenkins-hbase4.apache.org,33227,1690239969957 in 179 msec 2023-07-24 23:08:22,116 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=115, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=5532b625b4ff2e76cc8bf1c92e78f458, UNASSIGN in 191 msec 2023-07-24 23:08:22,124 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1690240083204.5cd7062fa62f155a72c04e65b0f8d07d. 2023-07-24 23:08:22,124 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 5cd7062fa62f155a72c04e65b0f8d07d: 2023-07-24 23:08:22,127 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 5cd7062fa62f155a72c04e65b0f8d07d 2023-07-24 23:08:22,127 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=5cd7062fa62f155a72c04e65b0f8d07d, regionState=CLOSED 2023-07-24 23:08:22,127 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1690240083204.5cd7062fa62f155a72c04e65b0f8d07d.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690240102127"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690240102127"}]},"ts":"1690240102127"} 2023-07-24 23:08:22,132 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=117, resume processing ppid=116 2023-07-24 23:08:22,132 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=117, ppid=116, state=SUCCESS; CloseRegionProcedure 5cd7062fa62f155a72c04e65b0f8d07d, server=jenkins-hbase4.apache.org,39013,1690239969874 in 197 msec 2023-07-24 23:08:22,135 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=116, resume processing ppid=114 2023-07-24 23:08:22,135 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=116, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=5cd7062fa62f155a72c04e65b0f8d07d, UNASSIGN in 208 msec 2023-07-24 23:08:22,136 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690240102136"}]},"ts":"1690240102136"} 2023-07-24 23:08:22,138 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLED in hbase:meta 2023-07-24 23:08:22,141 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLED 2023-07-24 23:08:22,144 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=114, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 230 msec 2023-07-24 23:08:22,220 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-24 23:08:22,220 INFO [Listener at jenkins-hbase4.apache.org/43617] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 114 completed 2023-07-24 23:08:22,221 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:22,222 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] procedure2.ProcedureExecutor(1029): Stored pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:22,231 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:22,231 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:22,234 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=119, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:22,235 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33227] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:22,239 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:39013-0x1019995a36f0002, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:22,239 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:33227-0x1019995a36f0003, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:22,239 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:22,239 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:39595-0x1019995a36f0001, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:22,239 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-24 23:08:22,239 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-24 23:08:22,240 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-24 23:08:22,240 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-24 23:08:22,241 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:33227-0x1019995a36f0003, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:22,241 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:33227-0x1019995a36f0003, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 23:08:22,241 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:39595-0x1019995a36f0001, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:22,241 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:39595-0x1019995a36f0001, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 23:08:22,241 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:39013-0x1019995a36f0002, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:22,241 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:39013-0x1019995a36f0002, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 23:08:22,241 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:22,242 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 23:08:22,243 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-24 23:08:22,246 DEBUG [HFileArchiver-22] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/5532b625b4ff2e76cc8bf1c92e78f458 2023-07-24 23:08:22,247 DEBUG [HFileArchiver-23] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/5cd7062fa62f155a72c04e65b0f8d07d 2023-07-24 23:08:22,248 DEBUG [HFileArchiver-22] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/5532b625b4ff2e76cc8bf1c92e78f458/cf, FileablePath, hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/5532b625b4ff2e76cc8bf1c92e78f458/recovered.edits] 2023-07-24 23:08:22,249 DEBUG [HFileArchiver-23] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/5cd7062fa62f155a72c04e65b0f8d07d/cf, FileablePath, hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/5cd7062fa62f155a72c04e65b0f8d07d/recovered.edits] 2023-07-24 23:08:22,254 DEBUG [HFileArchiver-22] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/5532b625b4ff2e76cc8bf1c92e78f458/cf/b74c95a2f5714b53b45f67e1d0f77be7 to hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/5532b625b4ff2e76cc8bf1c92e78f458/cf/b74c95a2f5714b53b45f67e1d0f77be7 2023-07-24 23:08:22,257 DEBUG [HFileArchiver-23] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/5cd7062fa62f155a72c04e65b0f8d07d/cf/be419cc0d61b431e909d156487a60468 to hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/5cd7062fa62f155a72c04e65b0f8d07d/cf/be419cc0d61b431e909d156487a60468 2023-07-24 23:08:22,260 DEBUG [HFileArchiver-22] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/5532b625b4ff2e76cc8bf1c92e78f458/recovered.edits/9.seqid to hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/5532b625b4ff2e76cc8bf1c92e78f458/recovered.edits/9.seqid 2023-07-24 23:08:22,262 DEBUG [HFileArchiver-22] backup.HFileArchiver(596): Deleted hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/5532b625b4ff2e76cc8bf1c92e78f458 2023-07-24 23:08:22,264 DEBUG [HFileArchiver-23] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/5cd7062fa62f155a72c04e65b0f8d07d/recovered.edits/9.seqid to hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/5cd7062fa62f155a72c04e65b0f8d07d/recovered.edits/9.seqid 2023-07-24 23:08:22,265 DEBUG [HFileArchiver-23] backup.HFileArchiver(596): Deleted hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/5cd7062fa62f155a72c04e65b0f8d07d 2023-07-24 23:08:22,265 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-07-24 23:08:22,268 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=119, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:22,270 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithSkipTmp from hbase:meta 2023-07-24 23:08:22,302 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithSkipTmp' descriptor. 2023-07-24 23:08:22,304 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=119, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:22,304 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithSkipTmp' from region states. 2023-07-24 23:08:22,304 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1690240083204.5532b625b4ff2e76cc8bf1c92e78f458.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690240102304"}]},"ts":"9223372036854775807"} 2023-07-24 23:08:22,304 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1690240083204.5cd7062fa62f155a72c04e65b0f8d07d.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690240102304"}]},"ts":"9223372036854775807"} 2023-07-24 23:08:22,309 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-24 23:08:22,309 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 5532b625b4ff2e76cc8bf1c92e78f458, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1690240083204.5532b625b4ff2e76cc8bf1c92e78f458.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 5cd7062fa62f155a72c04e65b0f8d07d, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1690240083204.5cd7062fa62f155a72c04e65b0f8d07d.', STARTKEY => '1', ENDKEY => ''}] 2023-07-24 23:08:22,309 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithSkipTmp' as deleted. 2023-07-24 23:08:22,309 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1690240102309"}]},"ts":"9223372036854775807"} 2023-07-24 23:08:22,324 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithSkipTmp state from META 2023-07-24 23:08:22,327 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=119, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:22,331 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=119, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 106 msec 2023-07-24 23:08:22,344 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-24 23:08:22,344 INFO [Listener at jenkins-hbase4.apache.org/43617] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 119 completed 2023-07-24 23:08:22,356 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithSkipTmp" 2023-07-24 23:08:22,359 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37213] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:22,361 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37213] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithSkipTmp" 2023-07-24 23:08:22,368 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37213] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:22,431 INFO [Listener at jenkins-hbase4.apache.org/43617] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=764 (was 762) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1273988721_17 at /127.0.0.1:37722 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1273988721_17 at /127.0.0.1:44442 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-444258592_1 at /127.0.0.1:49608 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (717546083) connection to jenkins-hbase4.apache.org/172.31.14.131:44433 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-444258592_1 at /127.0.0.1:55704 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-23 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1273988721_17 at /127.0.0.1:52290 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-22 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x2b6dd434-shared-pool-46 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x2b6dd434-shared-pool-47 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x2b6dd434-shared-pool-44 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-5209 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: hconnection-0x2b6dd434-shared-pool-45 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=901 (was 910), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=754 (was 643) - SystemLoadAverage LEAK? -, ProcessCount=182 (was 182), AvailableMemoryMB=3937 (was 4511) 2023-07-24 23:08:22,432 WARN [Listener at jenkins-hbase4.apache.org/43617] hbase.ResourceChecker(130): Thread=764 is superior to 500 2023-07-24 23:08:22,432 INFO [Listener at jenkins-hbase4.apache.org/43617] hbase.HBaseTestingUtility(2762): Stopping mini mapreduce cluster... 2023-07-24 23:08:22,451 INFO [Listener at jenkins-hbase4.apache.org/43617] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-24 23:08:22,579 WARN [ContainersLauncher #0] nodemanager.DefaultContainerExecutor(305): Exit code from container container_1690239977721_0007_01_000001 is : 143 2023-07-24 23:08:27,684 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-24 23:08:36,707 INFO [Listener at jenkins-hbase4.apache.org/43617] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-24 23:08:50,826 ERROR [Thread[Thread-411,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-24 23:08:50,827 INFO [Listener at jenkins-hbase4.apache.org/43617] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-24 23:08:50,943 WARN [ApplicationMaster Launcher] amlauncher.ApplicationMasterLauncher$LauncherThread(122): org.apache.hadoop.yarn.server.resourcemanager.amlauncher.ApplicationMasterLauncher$LauncherThread interrupted. Returning. 2023-07-24 23:08:50,954 ERROR [SchedulerEventDispatcher:Event Processor] event.EventDispatcher$EventProcessor(61): Returning, interrupted : java.lang.InterruptedException 2023-07-24 23:08:50,955 ERROR [Thread[Thread-421,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-24 23:08:50,975 INFO [Listener at jenkins-hbase4.apache.org/43617] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-24 23:08:51,080 ERROR [Thread[Thread-386,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-24 23:08:51,080 INFO [Listener at jenkins-hbase4.apache.org/43617] hbase.HBaseTestingUtility(2765): Mini mapreduce cluster stopped 2023-07-24 23:08:51,080 INFO [Listener at jenkins-hbase4.apache.org/43617] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-07-24 23:08:51,080 INFO [Listener at jenkins-hbase4.apache.org/43617] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-24 23:08:51,080 DEBUG [Listener at jenkins-hbase4.apache.org/43617] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x695cdb1e to 127.0.0.1:52881 2023-07-24 23:08:51,080 DEBUG [Listener at jenkins-hbase4.apache.org/43617] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 23:08:51,081 DEBUG [Listener at jenkins-hbase4.apache.org/43617] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-07-24 23:08:51,081 DEBUG [Listener at jenkins-hbase4.apache.org/43617] util.JVMClusterUtil(257): Found active master hash=273323641, stopped=false 2023-07-24 23:08:51,081 DEBUG [Listener at jenkins-hbase4.apache.org/43617] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 23:08:51,081 DEBUG [Listener at jenkins-hbase4.apache.org/43617] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-24 23:08:51,081 INFO [Listener at jenkins-hbase4.apache.org/43617] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,37213,1690239968296 2023-07-24 23:08:51,083 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:33227-0x1019995a36f0003, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-24 23:08:51,083 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:39595-0x1019995a36f0001, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-24 23:08:51,083 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:39013-0x1019995a36f0002, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-24 23:08:51,083 INFO [Listener at jenkins-hbase4.apache.org/43617] procedure2.ProcedureExecutor(629): Stopping 2023-07-24 23:08:51,083 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-24 23:08:51,083 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-24 23:08:51,083 DEBUG [Listener at jenkins-hbase4.apache.org/43617] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6779f1ce to 127.0.0.1:52881 2023-07-24 23:08:51,083 DEBUG [Listener at jenkins-hbase4.apache.org/43617] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 23:08:51,084 INFO [Listener at jenkins-hbase4.apache.org/43617] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,39595,1690239969801' ***** 2023-07-24 23:08:51,084 DEBUG [Listener at jenkins-hbase4.apache.org/43617] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 23:08:51,084 INFO [Listener at jenkins-hbase4.apache.org/43617] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-24 23:08:51,084 INFO [Listener at jenkins-hbase4.apache.org/43617] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,39013,1690239969874' ***** 2023-07-24 23:08:51,084 DEBUG [Listener at jenkins-hbase4.apache.org/43617] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 23:08:51,084 INFO [Listener at jenkins-hbase4.apache.org/43617] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-24 23:08:51,084 INFO [Listener at jenkins-hbase4.apache.org/43617] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,33227,1690239969957' ***** 2023-07-24 23:08:51,084 DEBUG [Listener at jenkins-hbase4.apache.org/43617] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 23:08:51,084 INFO [Listener at jenkins-hbase4.apache.org/43617] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-24 23:08:51,084 INFO [RS:1;jenkins-hbase4:39013] regionserver.HeapMemoryManager(220): Stopping 2023-07-24 23:08:51,085 INFO [RS:0;jenkins-hbase4:39595] regionserver.HeapMemoryManager(220): Stopping 2023-07-24 23:08:51,085 INFO [RS:1;jenkins-hbase4:39013] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-24 23:08:51,085 INFO [RS:0;jenkins-hbase4:39595] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-24 23:08:51,085 INFO [RS:1;jenkins-hbase4:39013] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-24 23:08:51,085 INFO [RS:0;jenkins-hbase4:39595] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-24 23:08:51,085 INFO [RS:1;jenkins-hbase4:39013] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,39013,1690239969874 2023-07-24 23:08:51,085 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-24 23:08:51,085 INFO [RS:0;jenkins-hbase4:39595] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,39595,1690239969801 2023-07-24 23:08:51,085 INFO [RS:2;jenkins-hbase4:33227] regionserver.HeapMemoryManager(220): Stopping 2023-07-24 23:08:51,085 DEBUG [RS:1;jenkins-hbase4:39013] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x07011121 to 127.0.0.1:52881 2023-07-24 23:08:51,085 INFO [RS:2;jenkins-hbase4:33227] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-24 23:08:51,085 DEBUG [RS:1;jenkins-hbase4:39013] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 23:08:51,085 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-24 23:08:51,085 DEBUG [RS:0;jenkins-hbase4:39595] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x49d307de to 127.0.0.1:52881 2023-07-24 23:08:51,086 DEBUG [RS:0;jenkins-hbase4:39595] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 23:08:51,085 INFO [RS:2;jenkins-hbase4:33227] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-24 23:08:51,088 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-24 23:08:51,088 INFO [RS:2;jenkins-hbase4:33227] regionserver.HRegionServer(3305): Received CLOSE for 491925dfdedb8219e0d8fb183d9a55b9 2023-07-24 23:08:51,088 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39595-0x1019995a36f0001, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-24 23:08:51,088 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39013-0x1019995a36f0002, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-24 23:08:51,089 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-24 23:08:51,088 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33227-0x1019995a36f0003, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-24 23:08:51,089 INFO [RS:2;jenkins-hbase4:33227] regionserver.HRegionServer(3305): Received CLOSE for 9774cede2296795241d588aec34e45f8 2023-07-24 23:08:51,089 INFO [RS:2;jenkins-hbase4:33227] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:08:51,089 DEBUG [RS:2;jenkins-hbase4:33227] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x77dfde30 to 127.0.0.1:52881 2023-07-24 23:08:51,089 DEBUG [RS:2;jenkins-hbase4:33227] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 23:08:51,091 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 491925dfdedb8219e0d8fb183d9a55b9, disabling compactions & flushes 2023-07-24 23:08:51,091 INFO [RS:1;jenkins-hbase4:39013] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-24 23:08:51,091 INFO [RS:1;jenkins-hbase4:39013] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-24 23:08:51,091 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:acl,,1690239973596.491925dfdedb8219e0d8fb183d9a55b9. 2023-07-24 23:08:51,091 INFO [RS:0;jenkins-hbase4:39595] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,39595,1690239969801; all regions closed. 2023-07-24 23:08:51,091 INFO [RS:2;jenkins-hbase4:33227] regionserver.HRegionServer(1474): Waiting on 2 regions to close 2023-07-24 23:08:51,091 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1690239973596.491925dfdedb8219e0d8fb183d9a55b9. 2023-07-24 23:08:51,091 INFO [RS:1;jenkins-hbase4:39013] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-24 23:08:51,091 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1690239973596.491925dfdedb8219e0d8fb183d9a55b9. after waiting 0 ms 2023-07-24 23:08:51,091 INFO [RS:1;jenkins-hbase4:39013] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-07-24 23:08:51,091 DEBUG [RS:2;jenkins-hbase4:33227] regionserver.HRegionServer(1478): Online Regions={491925dfdedb8219e0d8fb183d9a55b9=hbase:acl,,1690239973596.491925dfdedb8219e0d8fb183d9a55b9., 9774cede2296795241d588aec34e45f8=hbase:namespace,,1690239972831.9774cede2296795241d588aec34e45f8.} 2023-07-24 23:08:51,091 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1690239973596.491925dfdedb8219e0d8fb183d9a55b9. 2023-07-24 23:08:51,092 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 491925dfdedb8219e0d8fb183d9a55b9 1/1 column families, dataSize=914 B heapSize=2.17 KB 2023-07-24 23:08:51,093 INFO [RS:1;jenkins-hbase4:39013] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-07-24 23:08:51,093 DEBUG [RS:2;jenkins-hbase4:33227] regionserver.HRegionServer(1504): Waiting on 491925dfdedb8219e0d8fb183d9a55b9, 9774cede2296795241d588aec34e45f8 2023-07-24 23:08:51,094 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-24 23:08:51,094 DEBUG [RS:1;jenkins-hbase4:39013] regionserver.HRegionServer(1478): Online Regions={1588230740=hbase:meta,,1.1588230740} 2023-07-24 23:08:51,094 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-24 23:08:51,094 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-24 23:08:51,094 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-24 23:08:51,094 DEBUG [RS:1;jenkins-hbase4:39013] regionserver.HRegionServer(1504): Waiting on 1588230740 2023-07-24 23:08:51,094 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-24 23:08:51,094 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-24 23:08:51,094 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=45.93 KB heapSize=71.92 KB 2023-07-24 23:08:51,112 DEBUG [RS:0;jenkins-hbase4:39595] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/oldWALs 2023-07-24 23:08:51,112 INFO [RS:0;jenkins-hbase4:39595] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C39595%2C1690239969801:(num 1690239972128) 2023-07-24 23:08:51,112 DEBUG [RS:0;jenkins-hbase4:39595] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 23:08:51,112 INFO [RS:0;jenkins-hbase4:39595] regionserver.LeaseManager(133): Closed leases 2023-07-24 23:08:51,113 INFO [RS:0;jenkins-hbase4:39595] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-07-24 23:08:51,113 INFO [RS:0;jenkins-hbase4:39595] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-24 23:08:51,113 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-24 23:08:51,113 INFO [RS:0;jenkins-hbase4:39595] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-24 23:08:51,113 INFO [RS:0;jenkins-hbase4:39595] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-24 23:08:51,119 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=914 B at sequenceid=18 (bloomFilter=false), to=hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/hbase/acl/491925dfdedb8219e0d8fb183d9a55b9/.tmp/l/7c796161870f447da708b4afd7c5e507 2023-07-24 23:08:51,122 INFO [RS:0;jenkins-hbase4:39595] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:39595 2023-07-24 23:08:51,124 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=40.45 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/hbase/meta/1588230740/.tmp/info/1590bfab6f684954aa9f44638ed73b0a 2023-07-24 23:08:51,127 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7c796161870f447da708b4afd7c5e507 2023-07-24 23:08:51,128 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/hbase/acl/491925dfdedb8219e0d8fb183d9a55b9/.tmp/l/7c796161870f447da708b4afd7c5e507 as hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/hbase/acl/491925dfdedb8219e0d8fb183d9a55b9/l/7c796161870f447da708b4afd7c5e507 2023-07-24 23:08:51,131 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:33227-0x1019995a36f0003, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,39595,1690239969801 2023-07-24 23:08:51,131 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:39595-0x1019995a36f0001, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,39595,1690239969801 2023-07-24 23:08:51,131 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:39595-0x1019995a36f0001, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-24 23:08:51,131 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:39013-0x1019995a36f0002, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,39595,1690239969801 2023-07-24 23:08:51,131 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:39013-0x1019995a36f0002, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-24 23:08:51,131 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:33227-0x1019995a36f0003, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-24 23:08:51,131 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-24 23:08:51,132 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,39595,1690239969801] 2023-07-24 23:08:51,132 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1590bfab6f684954aa9f44638ed73b0a 2023-07-24 23:08:51,132 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,39595,1690239969801; numProcessing=1 2023-07-24 23:08:51,134 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,39595,1690239969801 already deleted, retry=false 2023-07-24 23:08:51,134 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,39595,1690239969801 expired; onlineServers=2 2023-07-24 23:08:51,135 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7c796161870f447da708b4afd7c5e507 2023-07-24 23:08:51,135 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/hbase/acl/491925dfdedb8219e0d8fb183d9a55b9/l/7c796161870f447da708b4afd7c5e507, entries=7, sequenceid=18, filesize=5.2 K 2023-07-24 23:08:51,136 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~914 B/914, heapSize ~2.16 KB/2208, currentSize=0 B/0 for 491925dfdedb8219e0d8fb183d9a55b9 in 43ms, sequenceid=18, compaction requested=false 2023-07-24 23:08:51,145 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/hbase/acl/491925dfdedb8219e0d8fb183d9a55b9/recovered.edits/21.seqid, newMaxSeqId=21, maxSeqId=1 2023-07-24 23:08:51,147 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 23:08:51,147 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:acl,,1690239973596.491925dfdedb8219e0d8fb183d9a55b9. 2023-07-24 23:08:51,147 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 491925dfdedb8219e0d8fb183d9a55b9: 2023-07-24 23:08:51,148 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:acl,,1690239973596.491925dfdedb8219e0d8fb183d9a55b9. 2023-07-24 23:08:51,148 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 9774cede2296795241d588aec34e45f8, disabling compactions & flushes 2023-07-24 23:08:51,148 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1690239972831.9774cede2296795241d588aec34e45f8. 2023-07-24 23:08:51,148 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1690239972831.9774cede2296795241d588aec34e45f8. 2023-07-24 23:08:51,148 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1690239972831.9774cede2296795241d588aec34e45f8. after waiting 0 ms 2023-07-24 23:08:51,148 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1690239972831.9774cede2296795241d588aec34e45f8. 2023-07-24 23:08:51,148 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 9774cede2296795241d588aec34e45f8 1/1 column families, dataSize=78 B heapSize=488 B 2023-07-24 23:08:51,150 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.50 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/hbase/meta/1588230740/.tmp/rep_barrier/0264730d34994bbf89a368d395a2d19f 2023-07-24 23:08:51,155 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0264730d34994bbf89a368d395a2d19f 2023-07-24 23:08:51,162 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/hbase/namespace/9774cede2296795241d588aec34e45f8/.tmp/info/5d5c8236648c42d9969a7decdd260b7f 2023-07-24 23:08:51,168 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/hbase/namespace/9774cede2296795241d588aec34e45f8/.tmp/info/5d5c8236648c42d9969a7decdd260b7f as hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/hbase/namespace/9774cede2296795241d588aec34e45f8/info/5d5c8236648c42d9969a7decdd260b7f 2023-07-24 23:08:51,173 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/hbase/namespace/9774cede2296795241d588aec34e45f8/info/5d5c8236648c42d9969a7decdd260b7f, entries=2, sequenceid=6, filesize=4.8 K 2023-07-24 23:08:51,174 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 9774cede2296795241d588aec34e45f8 in 26ms, sequenceid=6, compaction requested=false 2023-07-24 23:08:51,184 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-24 23:08:51,184 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-24 23:08:51,186 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.98 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/hbase/meta/1588230740/.tmp/table/daeb6405583d44af8db7adcd982c3180 2023-07-24 23:08:51,189 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/hbase/namespace/9774cede2296795241d588aec34e45f8/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-24 23:08:51,189 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 23:08:51,190 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1690239972831.9774cede2296795241d588aec34e45f8. 2023-07-24 23:08:51,190 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 9774cede2296795241d588aec34e45f8: 2023-07-24 23:08:51,190 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1690239972831.9774cede2296795241d588aec34e45f8. 2023-07-24 23:08:51,191 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for daeb6405583d44af8db7adcd982c3180 2023-07-24 23:08:51,192 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/hbase/meta/1588230740/.tmp/info/1590bfab6f684954aa9f44638ed73b0a as hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/hbase/meta/1588230740/info/1590bfab6f684954aa9f44638ed73b0a 2023-07-24 23:08:51,196 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1590bfab6f684954aa9f44638ed73b0a 2023-07-24 23:08:51,197 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/hbase/meta/1588230740/info/1590bfab6f684954aa9f44638ed73b0a, entries=48, sequenceid=131, filesize=10.3 K 2023-07-24 23:08:51,197 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/hbase/meta/1588230740/.tmp/rep_barrier/0264730d34994bbf89a368d395a2d19f as hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/hbase/meta/1588230740/rep_barrier/0264730d34994bbf89a368d395a2d19f 2023-07-24 23:08:51,202 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0264730d34994bbf89a368d395a2d19f 2023-07-24 23:08:51,202 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/hbase/meta/1588230740/rep_barrier/0264730d34994bbf89a368d395a2d19f, entries=13, sequenceid=131, filesize=6.4 K 2023-07-24 23:08:51,203 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/hbase/meta/1588230740/.tmp/table/daeb6405583d44af8db7adcd982c3180 as hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/hbase/meta/1588230740/table/daeb6405583d44af8db7adcd982c3180 2023-07-24 23:08:51,207 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for daeb6405583d44af8db7adcd982c3180 2023-07-24 23:08:51,208 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/hbase/meta/1588230740/table/daeb6405583d44af8db7adcd982c3180, entries=24, sequenceid=131, filesize=6.9 K 2023-07-24 23:08:51,209 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~45.93 KB/47028, heapSize ~71.88 KB/73600, currentSize=0 B/0 for 1588230740 in 115ms, sequenceid=131, compaction requested=false 2023-07-24 23:08:51,221 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/data/hbase/meta/1588230740/recovered.edits/134.seqid, newMaxSeqId=134, maxSeqId=1 2023-07-24 23:08:51,222 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 23:08:51,222 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-24 23:08:51,223 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-24 23:08:51,223 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-24 23:08:51,223 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-07-24 23:08:51,233 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:39595-0x1019995a36f0001, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-24 23:08:51,233 INFO [RS:0;jenkins-hbase4:39595] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,39595,1690239969801; zookeeper connection closed. 2023-07-24 23:08:51,233 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:39595-0x1019995a36f0001, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-24 23:08:51,234 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@69a3a55e] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@69a3a55e 2023-07-24 23:08:51,293 INFO [RS:2;jenkins-hbase4:33227] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,33227,1690239969957; all regions closed. 2023-07-24 23:08:51,294 INFO [RS:1;jenkins-hbase4:39013] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,39013,1690239969874; all regions closed. 2023-07-24 23:08:51,302 DEBUG [RS:2;jenkins-hbase4:33227] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/oldWALs 2023-07-24 23:08:51,302 INFO [RS:2;jenkins-hbase4:33227] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C33227%2C1690239969957:(num 1690239972131) 2023-07-24 23:08:51,302 DEBUG [RS:1;jenkins-hbase4:39013] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/oldWALs 2023-07-24 23:08:51,302 DEBUG [RS:2;jenkins-hbase4:33227] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 23:08:51,302 INFO [RS:1;jenkins-hbase4:39013] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C39013%2C1690239969874.meta:.meta(num 1690239972505) 2023-07-24 23:08:51,302 INFO [RS:2;jenkins-hbase4:33227] regionserver.LeaseManager(133): Closed leases 2023-07-24 23:08:51,302 INFO [RS:2;jenkins-hbase4:33227] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-07-24 23:08:51,303 INFO [RS:2;jenkins-hbase4:33227] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-24 23:08:51,303 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-24 23:08:51,303 INFO [RS:2;jenkins-hbase4:33227] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-24 23:08:51,303 INFO [RS:2;jenkins-hbase4:33227] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-24 23:08:51,303 INFO [RS:2;jenkins-hbase4:33227] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:33227 2023-07-24 23:08:51,306 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:33227-0x1019995a36f0003, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:08:51,306 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:39013-0x1019995a36f0002, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,33227,1690239969957 2023-07-24 23:08:51,306 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-24 23:08:51,307 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,33227,1690239969957] 2023-07-24 23:08:51,307 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,33227,1690239969957; numProcessing=2 2023-07-24 23:08:51,308 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,33227,1690239969957 already deleted, retry=false 2023-07-24 23:08:51,308 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,33227,1690239969957 expired; onlineServers=1 2023-07-24 23:08:51,310 DEBUG [RS:1;jenkins-hbase4:39013] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/oldWALs 2023-07-24 23:08:51,310 INFO [RS:1;jenkins-hbase4:39013] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C39013%2C1690239969874:(num 1690239972129) 2023-07-24 23:08:51,310 DEBUG [RS:1;jenkins-hbase4:39013] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 23:08:51,310 INFO [RS:1;jenkins-hbase4:39013] regionserver.LeaseManager(133): Closed leases 2023-07-24 23:08:51,311 INFO [RS:1;jenkins-hbase4:39013] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-07-24 23:08:51,311 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-24 23:08:51,312 INFO [RS:1;jenkins-hbase4:39013] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:39013 2023-07-24 23:08:51,411 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:33227-0x1019995a36f0003, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-24 23:08:51,411 INFO [RS:2;jenkins-hbase4:33227] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,33227,1690239969957; zookeeper connection closed. 2023-07-24 23:08:51,411 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:33227-0x1019995a36f0003, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-24 23:08:51,411 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@39480e19] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@39480e19 2023-07-24 23:08:51,412 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:39013-0x1019995a36f0002, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,39013,1690239969874 2023-07-24 23:08:51,412 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-24 23:08:51,413 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,39013,1690239969874] 2023-07-24 23:08:51,413 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,39013,1690239969874; numProcessing=3 2023-07-24 23:08:51,414 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,39013,1690239969874 already deleted, retry=false 2023-07-24 23:08:51,414 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,39013,1690239969874 expired; onlineServers=0 2023-07-24 23:08:51,414 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,37213,1690239968296' ***** 2023-07-24 23:08:51,414 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-07-24 23:08:51,415 DEBUG [M:0;jenkins-hbase4:37213] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@51779c42, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-24 23:08:51,415 INFO [M:0;jenkins-hbase4:37213] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,37213,1690239968296 2023-07-24 23:08:51,415 INFO [M:0;jenkins-hbase4:37213] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,37213,1690239968296; all regions closed. 2023-07-24 23:08:51,415 DEBUG [M:0;jenkins-hbase4:37213] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 23:08:51,415 DEBUG [M:0;jenkins-hbase4:37213] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-07-24 23:08:51,415 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-07-24 23:08:51,415 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1690239971563] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1690239971563,5,FailOnTimeoutGroup] 2023-07-24 23:08:51,415 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1690239971566] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1690239971566,5,FailOnTimeoutGroup] 2023-07-24 23:08:51,415 DEBUG [M:0;jenkins-hbase4:37213] cleaner.HFileCleaner(317): Stopping file delete threads 2023-07-24 23:08:51,416 INFO [M:0;jenkins-hbase4:37213] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-07-24 23:08:51,416 INFO [M:0;jenkins-hbase4:37213] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-07-24 23:08:51,416 INFO [M:0;jenkins-hbase4:37213] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-07-24 23:08:51,416 DEBUG [M:0;jenkins-hbase4:37213] master.HMaster(1512): Stopping service threads 2023-07-24 23:08:51,416 INFO [M:0;jenkins-hbase4:37213] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-07-24 23:08:51,416 ERROR [M:0;jenkins-hbase4:37213] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-22,5,PEWorkerGroup] Thread[HFileArchiver-23,5,PEWorkerGroup] 2023-07-24 23:08:51,417 INFO [M:0;jenkins-hbase4:37213] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-07-24 23:08:51,417 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-07-24 23:08:51,417 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-07-24 23:08:51,417 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-24 23:08:51,418 DEBUG [M:0;jenkins-hbase4:37213] zookeeper.ZKUtil(398): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-07-24 23:08:51,418 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-24 23:08:51,418 WARN [M:0;jenkins-hbase4:37213] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-07-24 23:08:51,418 INFO [M:0;jenkins-hbase4:37213] assignment.AssignmentManager(315): Stopping assignment manager 2023-07-24 23:08:51,418 INFO [M:0;jenkins-hbase4:37213] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-07-24 23:08:51,419 DEBUG [M:0;jenkins-hbase4:37213] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-24 23:08:51,419 INFO [M:0;jenkins-hbase4:37213] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-24 23:08:51,419 DEBUG [M:0;jenkins-hbase4:37213] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-24 23:08:51,419 DEBUG [M:0;jenkins-hbase4:37213] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-24 23:08:51,419 DEBUG [M:0;jenkins-hbase4:37213] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-24 23:08:51,419 INFO [M:0;jenkins-hbase4:37213] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=373.09 KB heapSize=449.30 KB 2023-07-24 23:08:51,435 INFO [M:0;jenkins-hbase4:37213] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=373.09 KB at sequenceid=899 (bloomFilter=true), to=hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/0dc9aef8ec3b4e9881be5ca306687598 2023-07-24 23:08:51,440 INFO [M:0;jenkins-hbase4:37213] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0dc9aef8ec3b4e9881be5ca306687598 2023-07-24 23:08:51,441 DEBUG [M:0;jenkins-hbase4:37213] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/0dc9aef8ec3b4e9881be5ca306687598 as hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/0dc9aef8ec3b4e9881be5ca306687598 2023-07-24 23:08:51,445 INFO [M:0;jenkins-hbase4:37213] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0dc9aef8ec3b4e9881be5ca306687598 2023-07-24 23:08:51,445 INFO [M:0;jenkins-hbase4:37213] regionserver.HStore(1080): Added hdfs://localhost:37611/user/jenkins/test-data/061cee67-d462-43c9-3f3b-c6d6557694bb/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/0dc9aef8ec3b4e9881be5ca306687598, entries=119, sequenceid=899, filesize=28.4 K 2023-07-24 23:08:51,446 INFO [M:0;jenkins-hbase4:37213] regionserver.HRegion(2948): Finished flush of dataSize ~373.09 KB/382043, heapSize ~449.29 KB/460072, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 27ms, sequenceid=899, compaction requested=false 2023-07-24 23:08:51,448 INFO [M:0;jenkins-hbase4:37213] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-24 23:08:51,448 DEBUG [M:0;jenkins-hbase4:37213] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-24 23:08:51,452 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-24 23:08:51,452 INFO [M:0;jenkins-hbase4:37213] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-07-24 23:08:51,453 INFO [M:0;jenkins-hbase4:37213] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:37213 2023-07-24 23:08:51,455 DEBUG [M:0;jenkins-hbase4:37213] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,37213,1690239968296 already deleted, retry=false 2023-07-24 23:08:51,513 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:39013-0x1019995a36f0002, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-24 23:08:51,513 INFO [RS:1;jenkins-hbase4:39013] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,39013,1690239969874; zookeeper connection closed. 2023-07-24 23:08:51,514 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): regionserver:39013-0x1019995a36f0002, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-24 23:08:51,514 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@2c0a4efd] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@2c0a4efd 2023-07-24 23:08:51,514 INFO [Listener at jenkins-hbase4.apache.org/43617] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 3 regionserver(s) complete 2023-07-24 23:08:51,614 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-24 23:08:51,614 INFO [M:0;jenkins-hbase4:37213] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,37213,1690239968296; zookeeper connection closed. 2023-07-24 23:08:51,614 DEBUG [Listener at localhost/35321-EventThread] zookeeper.ZKWatcher(600): master:37213-0x1019995a36f0000, quorum=127.0.0.1:52881, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-24 23:08:51,616 WARN [Listener at jenkins-hbase4.apache.org/43617] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-24 23:08:51,622 INFO [Listener at jenkins-hbase4.apache.org/43617] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-24 23:08:51,726 WARN [BP-746932889-172.31.14.131-1690239964228 heartbeating to localhost/127.0.0.1:37611] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-24 23:08:51,726 WARN [BP-746932889-172.31.14.131-1690239964228 heartbeating to localhost/127.0.0.1:37611] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-746932889-172.31.14.131-1690239964228 (Datanode Uuid b06a4373-d70b-4af2-84a5-113626559784) service to localhost/127.0.0.1:37611 2023-07-24 23:08:51,728 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/40a10de8-ef1a-d60f-e3da-b5fca02ca095/cluster_8078c43e-6fde-7452-062d-548ef0e9fbe8/dfs/data/data5/current/BP-746932889-172.31.14.131-1690239964228] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-24 23:08:51,728 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/40a10de8-ef1a-d60f-e3da-b5fca02ca095/cluster_8078c43e-6fde-7452-062d-548ef0e9fbe8/dfs/data/data6/current/BP-746932889-172.31.14.131-1690239964228] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-24 23:08:51,730 WARN [Listener at jenkins-hbase4.apache.org/43617] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-24 23:08:51,733 INFO [Listener at jenkins-hbase4.apache.org/43617] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-24 23:08:51,835 WARN [BP-746932889-172.31.14.131-1690239964228 heartbeating to localhost/127.0.0.1:37611] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-24 23:08:51,835 WARN [BP-746932889-172.31.14.131-1690239964228 heartbeating to localhost/127.0.0.1:37611] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-746932889-172.31.14.131-1690239964228 (Datanode Uuid b5027cd5-49e0-442c-b538-32219f13e7ec) service to localhost/127.0.0.1:37611 2023-07-24 23:08:51,836 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/40a10de8-ef1a-d60f-e3da-b5fca02ca095/cluster_8078c43e-6fde-7452-062d-548ef0e9fbe8/dfs/data/data3/current/BP-746932889-172.31.14.131-1690239964228] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-24 23:08:51,837 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/40a10de8-ef1a-d60f-e3da-b5fca02ca095/cluster_8078c43e-6fde-7452-062d-548ef0e9fbe8/dfs/data/data4/current/BP-746932889-172.31.14.131-1690239964228] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-24 23:08:51,838 WARN [Listener at jenkins-hbase4.apache.org/43617] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-24 23:08:51,840 INFO [Listener at jenkins-hbase4.apache.org/43617] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-24 23:08:51,917 WARN [BP-746932889-172.31.14.131-1690239964228 heartbeating to localhost/127.0.0.1:37611] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-746932889-172.31.14.131-1690239964228 (Datanode Uuid 412770a8-1c86-4606-af47-63555c1c339e) service to localhost/127.0.0.1:37611 2023-07-24 23:08:51,918 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/40a10de8-ef1a-d60f-e3da-b5fca02ca095/cluster_8078c43e-6fde-7452-062d-548ef0e9fbe8/dfs/data/data1/current/BP-746932889-172.31.14.131-1690239964228] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-24 23:08:51,919 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/40a10de8-ef1a-d60f-e3da-b5fca02ca095/cluster_8078c43e-6fde-7452-062d-548ef0e9fbe8/dfs/data/data2/current/BP-746932889-172.31.14.131-1690239964228] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-24 23:08:51,963 INFO [Listener at jenkins-hbase4.apache.org/43617] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-24 23:08:52,089 INFO [Listener at jenkins-hbase4.apache.org/43617] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-07-24 23:08:52,168 INFO [Listener at jenkins-hbase4.apache.org/43617] hbase.HBaseTestingUtility(1293): Minicluster is down