2023-09-15 23:01:05,880 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestExportSnapshot timeout: 13 mins 2023-09-15 23:01:06,104 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c5e9ebbf-ce0f-c6b3-3dce-6299f7b47f51 2023-09-15 23:01:06,104 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobExportSnapshot timeout: 13 mins 2023-09-15 23:01:06,104 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobSecureExportSnapshot timeout: 13 mins 2023-09-15 23:01:06,143 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-09-15 23:01:06,416 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=3, rsPorts=, rsClass=null, numDataNodes=3, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-09-15 23:01:06,417 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c5e9ebbf-ce0f-c6b3-3dce-6299f7b47f51/cluster_730e0029-aea3-8c57-14c7-897a98b383cd, deleteOnExit=true 2023-09-15 23:01:06,417 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-09-15 23:01:06,418 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c5e9ebbf-ce0f-c6b3-3dce-6299f7b47f51/test.cache.data in system properties and HBase conf 2023-09-15 23:01:06,419 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c5e9ebbf-ce0f-c6b3-3dce-6299f7b47f51/hadoop.tmp.dir in system properties and HBase conf 2023-09-15 23:01:06,419 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c5e9ebbf-ce0f-c6b3-3dce-6299f7b47f51/hadoop.log.dir in system properties and HBase conf 2023-09-15 23:01:06,420 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c5e9ebbf-ce0f-c6b3-3dce-6299f7b47f51/mapreduce.cluster.local.dir in system properties and HBase conf 2023-09-15 23:01:06,420 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c5e9ebbf-ce0f-c6b3-3dce-6299f7b47f51/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-09-15 23:01:06,420 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-09-15 23:01:06,742 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-09-15 23:01:06,747 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c5e9ebbf-ce0f-c6b3-3dce-6299f7b47f51/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-09-15 23:01:06,747 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c5e9ebbf-ce0f-c6b3-3dce-6299f7b47f51/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-09-15 23:01:06,748 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c5e9ebbf-ce0f-c6b3-3dce-6299f7b47f51/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-09-15 23:01:06,748 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c5e9ebbf-ce0f-c6b3-3dce-6299f7b47f51/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-09-15 23:01:06,748 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c5e9ebbf-ce0f-c6b3-3dce-6299f7b47f51/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-09-15 23:01:06,749 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c5e9ebbf-ce0f-c6b3-3dce-6299f7b47f51/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-09-15 23:01:06,749 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c5e9ebbf-ce0f-c6b3-3dce-6299f7b47f51/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-09-15 23:01:06,749 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c5e9ebbf-ce0f-c6b3-3dce-6299f7b47f51/dfs.journalnode.edits.dir in system properties and HBase conf 2023-09-15 23:01:06,750 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c5e9ebbf-ce0f-c6b3-3dce-6299f7b47f51/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-09-15 23:01:06,750 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c5e9ebbf-ce0f-c6b3-3dce-6299f7b47f51/nfs.dump.dir in system properties and HBase conf 2023-09-15 23:01:06,751 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c5e9ebbf-ce0f-c6b3-3dce-6299f7b47f51/java.io.tmpdir in system properties and HBase conf 2023-09-15 23:01:06,751 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c5e9ebbf-ce0f-c6b3-3dce-6299f7b47f51/dfs.journalnode.edits.dir in system properties and HBase conf 2023-09-15 23:01:06,751 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c5e9ebbf-ce0f-c6b3-3dce-6299f7b47f51/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-09-15 23:01:06,751 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c5e9ebbf-ce0f-c6b3-3dce-6299f7b47f51/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-09-15 23:01:07,265 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-09-15 23:01:07,270 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-09-15 23:01:07,580 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-09-15 23:01:07,759 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-09-15 23:01:07,773 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-15 23:01:07,812 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-09-15 23:01:07,846 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c5e9ebbf-ce0f-c6b3-3dce-6299f7b47f51/java.io.tmpdir/Jetty_localhost_35425_hdfs____.1nqydd/webapp 2023-09-15 23:01:07,988 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:35425 2023-09-15 23:01:08,030 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-09-15 23:01:08,030 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-09-15 23:01:08,492 WARN [Listener at localhost/44545] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-09-15 23:01:08,560 WARN [Listener at localhost/44545] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-09-15 23:01:08,580 WARN [Listener at localhost/44545] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-15 23:01:08,587 INFO [Listener at localhost/44545] log.Slf4jLog(67): jetty-6.1.26 2023-09-15 23:01:08,593 INFO [Listener at localhost/44545] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c5e9ebbf-ce0f-c6b3-3dce-6299f7b47f51/java.io.tmpdir/Jetty_localhost_35779_datanode____kv9rtq/webapp 2023-09-15 23:01:08,700 INFO [Listener at localhost/44545] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:35779 2023-09-15 23:01:09,152 WARN [Listener at localhost/45071] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-09-15 23:01:09,164 WARN [Listener at localhost/45071] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-09-15 23:01:09,169 WARN [Listener at localhost/45071] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-15 23:01:09,171 INFO [Listener at localhost/45071] log.Slf4jLog(67): jetty-6.1.26 2023-09-15 23:01:09,179 INFO [Listener at localhost/45071] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c5e9ebbf-ce0f-c6b3-3dce-6299f7b47f51/java.io.tmpdir/Jetty_localhost_35759_datanode____.xfuj34/webapp 2023-09-15 23:01:09,278 INFO [Listener at localhost/45071] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:35759 2023-09-15 23:01:09,289 WARN [Listener at localhost/36367] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-09-15 23:01:09,304 WARN [Listener at localhost/36367] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-09-15 23:01:09,309 WARN [Listener at localhost/36367] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-15 23:01:09,311 INFO [Listener at localhost/36367] log.Slf4jLog(67): jetty-6.1.26 2023-09-15 23:01:09,320 INFO [Listener at localhost/36367] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c5e9ebbf-ce0f-c6b3-3dce-6299f7b47f51/java.io.tmpdir/Jetty_localhost_42821_datanode____w2ny5c/webapp 2023-09-15 23:01:09,445 INFO [Listener at localhost/36367] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:42821 2023-09-15 23:01:09,458 WARN [Listener at localhost/41597] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-09-15 23:01:09,731 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xc0ea32fad1a96dae: Processing first storage report for DS-b8b785bc-4a72-493d-ba9a-7f551630fcaa from datanode 3096ce5d-6737-4bb9-97d0-468fc9af91c7 2023-09-15 23:01:09,733 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xc0ea32fad1a96dae: from storage DS-b8b785bc-4a72-493d-ba9a-7f551630fcaa node DatanodeRegistration(127.0.0.1:41247, datanodeUuid=3096ce5d-6737-4bb9-97d0-468fc9af91c7, infoPort=44073, infoSecurePort=0, ipcPort=36367, storageInfo=lv=-57;cid=testClusterID;nsid=20107514;c=1694818867351), blocks: 0, hasStaleStorage: true, processing time: 2 msecs, invalidatedBlocks: 0 2023-09-15 23:01:09,733 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x97a8c0e4734f5405: Processing first storage report for DS-59a00e00-5ed8-46e6-bf93-d4465a55257f from datanode bc7c6f42-1888-4c37-b025-d0ceb970c9c9 2023-09-15 23:01:09,733 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x97a8c0e4734f5405: from storage DS-59a00e00-5ed8-46e6-bf93-d4465a55257f node DatanodeRegistration(127.0.0.1:46751, datanodeUuid=bc7c6f42-1888-4c37-b025-d0ceb970c9c9, infoPort=37663, infoSecurePort=0, ipcPort=45071, storageInfo=lv=-57;cid=testClusterID;nsid=20107514;c=1694818867351), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-09-15 23:01:09,733 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x111695f832d5e58c: Processing first storage report for DS-fb8ee2b5-f1f5-428c-a261-5558f7dd02c6 from datanode 53f92d5c-5dc8-458f-b486-7f45b0a59549 2023-09-15 23:01:09,734 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x111695f832d5e58c: from storage DS-fb8ee2b5-f1f5-428c-a261-5558f7dd02c6 node DatanodeRegistration(127.0.0.1:36781, datanodeUuid=53f92d5c-5dc8-458f-b486-7f45b0a59549, infoPort=34939, infoSecurePort=0, ipcPort=41597, storageInfo=lv=-57;cid=testClusterID;nsid=20107514;c=1694818867351), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-09-15 23:01:09,734 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xc0ea32fad1a96dae: Processing first storage report for DS-6b77c0af-8108-4cb1-9d17-876edea337ca from datanode 3096ce5d-6737-4bb9-97d0-468fc9af91c7 2023-09-15 23:01:09,734 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xc0ea32fad1a96dae: from storage DS-6b77c0af-8108-4cb1-9d17-876edea337ca node DatanodeRegistration(127.0.0.1:41247, datanodeUuid=3096ce5d-6737-4bb9-97d0-468fc9af91c7, infoPort=44073, infoSecurePort=0, ipcPort=36367, storageInfo=lv=-57;cid=testClusterID;nsid=20107514;c=1694818867351), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-09-15 23:01:09,734 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x97a8c0e4734f5405: Processing first storage report for DS-b6bbe6d2-507c-4d56-84a2-e9f93a10b1de from datanode bc7c6f42-1888-4c37-b025-d0ceb970c9c9 2023-09-15 23:01:09,734 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x97a8c0e4734f5405: from storage DS-b6bbe6d2-507c-4d56-84a2-e9f93a10b1de node DatanodeRegistration(127.0.0.1:46751, datanodeUuid=bc7c6f42-1888-4c37-b025-d0ceb970c9c9, infoPort=37663, infoSecurePort=0, ipcPort=45071, storageInfo=lv=-57;cid=testClusterID;nsid=20107514;c=1694818867351), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-09-15 23:01:09,734 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x111695f832d5e58c: Processing first storage report for DS-2b86d278-686e-42c1-8a46-84b76d5ed1c8 from datanode 53f92d5c-5dc8-458f-b486-7f45b0a59549 2023-09-15 23:01:09,734 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x111695f832d5e58c: from storage DS-2b86d278-686e-42c1-8a46-84b76d5ed1c8 node DatanodeRegistration(127.0.0.1:36781, datanodeUuid=53f92d5c-5dc8-458f-b486-7f45b0a59549, infoPort=34939, infoSecurePort=0, ipcPort=41597, storageInfo=lv=-57;cid=testClusterID;nsid=20107514;c=1694818867351), blocks: 0, hasStaleStorage: false, processing time: 1 msecs, invalidatedBlocks: 0 2023-09-15 23:01:09,953 DEBUG [Listener at localhost/41597] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c5e9ebbf-ce0f-c6b3-3dce-6299f7b47f51 2023-09-15 23:01:10,039 INFO [Listener at localhost/41597] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c5e9ebbf-ce0f-c6b3-3dce-6299f7b47f51/cluster_730e0029-aea3-8c57-14c7-897a98b383cd/zookeeper_0, clientPort=51149, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c5e9ebbf-ce0f-c6b3-3dce-6299f7b47f51/cluster_730e0029-aea3-8c57-14c7-897a98b383cd/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c5e9ebbf-ce0f-c6b3-3dce-6299f7b47f51/cluster_730e0029-aea3-8c57-14c7-897a98b383cd/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-09-15 23:01:10,059 INFO [Listener at localhost/41597] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=51149 2023-09-15 23:01:10,069 INFO [Listener at localhost/41597] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-15 23:01:10,071 INFO [Listener at localhost/41597] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-15 23:01:10,772 INFO [Listener at localhost/41597] util.FSUtils(471): Created version file at hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64 with version=8 2023-09-15 23:01:10,772 INFO [Listener at localhost/41597] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/hbase-staging 2023-09-15 23:01:11,180 INFO [Listener at localhost/41597] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-09-15 23:01:11,643 INFO [Listener at localhost/41597] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-09-15 23:01:11,675 INFO [Listener at localhost/41597] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-15 23:01:11,676 INFO [Listener at localhost/41597] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-09-15 23:01:11,676 INFO [Listener at localhost/41597] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-09-15 23:01:11,676 INFO [Listener at localhost/41597] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-15 23:01:11,676 INFO [Listener at localhost/41597] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-09-15 23:01:11,817 INFO [Listener at localhost/41597] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-09-15 23:01:11,889 DEBUG [Listener at localhost/41597] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-09-15 23:01:11,979 INFO [Listener at localhost/41597] ipc.NettyRpcServer(120): Bind to /172.31.14.131:44427 2023-09-15 23:01:11,992 INFO [Listener at localhost/41597] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-15 23:01:11,994 INFO [Listener at localhost/41597] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-15 23:01:12,017 INFO [Listener at localhost/41597] zookeeper.RecoverableZooKeeper(93): Process identifier=master:44427 connecting to ZooKeeper ensemble=127.0.0.1:51149 2023-09-15 23:01:12,072 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:444270x0, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-09-15 23:01:12,075 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:44427-0x100b1d2daa90000 connected 2023-09-15 23:01:12,111 DEBUG [Listener at localhost/41597] zookeeper.ZKUtil(164): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-09-15 23:01:12,112 DEBUG [Listener at localhost/41597] zookeeper.ZKUtil(164): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-15 23:01:12,125 DEBUG [Listener at localhost/41597] zookeeper.ZKUtil(164): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-09-15 23:01:12,133 DEBUG [Listener at localhost/41597] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=44427 2023-09-15 23:01:12,133 DEBUG [Listener at localhost/41597] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=44427 2023-09-15 23:01:12,134 DEBUG [Listener at localhost/41597] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=44427 2023-09-15 23:01:12,135 DEBUG [Listener at localhost/41597] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=44427 2023-09-15 23:01:12,135 DEBUG [Listener at localhost/41597] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=44427 2023-09-15 23:01:12,141 INFO [Listener at localhost/41597] master.HMaster(444): hbase.rootdir=hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64, hbase.cluster.distributed=false 2023-09-15 23:01:12,204 INFO [Listener at localhost/41597] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-09-15 23:01:12,205 INFO [Listener at localhost/41597] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-15 23:01:12,205 INFO [Listener at localhost/41597] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-09-15 23:01:12,205 INFO [Listener at localhost/41597] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-09-15 23:01:12,205 INFO [Listener at localhost/41597] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-15 23:01:12,205 INFO [Listener at localhost/41597] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-09-15 23:01:12,210 INFO [Listener at localhost/41597] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-09-15 23:01:12,213 INFO [Listener at localhost/41597] ipc.NettyRpcServer(120): Bind to /172.31.14.131:33655 2023-09-15 23:01:12,216 INFO [Listener at localhost/41597] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-09-15 23:01:12,222 INFO [Listener at localhost/41597] mob.MobFileCache(124): MobFileCache disabled 2023-09-15 23:01:12,223 INFO [Listener at localhost/41597] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-15 23:01:12,225 INFO [Listener at localhost/41597] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-15 23:01:12,228 INFO [Listener at localhost/41597] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:33655 connecting to ZooKeeper ensemble=127.0.0.1:51149 2023-09-15 23:01:12,232 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:336550x0, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-09-15 23:01:12,233 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:33655-0x100b1d2daa90001 connected 2023-09-15 23:01:12,233 DEBUG [Listener at localhost/41597] zookeeper.ZKUtil(164): regionserver:33655-0x100b1d2daa90001, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-09-15 23:01:12,235 DEBUG [Listener at localhost/41597] zookeeper.ZKUtil(164): regionserver:33655-0x100b1d2daa90001, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-15 23:01:12,236 DEBUG [Listener at localhost/41597] zookeeper.ZKUtil(164): regionserver:33655-0x100b1d2daa90001, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-09-15 23:01:12,236 DEBUG [Listener at localhost/41597] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=33655 2023-09-15 23:01:12,236 DEBUG [Listener at localhost/41597] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=33655 2023-09-15 23:01:12,241 DEBUG [Listener at localhost/41597] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=33655 2023-09-15 23:01:12,241 DEBUG [Listener at localhost/41597] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=33655 2023-09-15 23:01:12,242 DEBUG [Listener at localhost/41597] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=33655 2023-09-15 23:01:12,254 INFO [Listener at localhost/41597] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-09-15 23:01:12,254 INFO [Listener at localhost/41597] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-15 23:01:12,254 INFO [Listener at localhost/41597] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-09-15 23:01:12,255 INFO [Listener at localhost/41597] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-09-15 23:01:12,255 INFO [Listener at localhost/41597] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-15 23:01:12,255 INFO [Listener at localhost/41597] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-09-15 23:01:12,255 INFO [Listener at localhost/41597] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-09-15 23:01:12,258 INFO [Listener at localhost/41597] ipc.NettyRpcServer(120): Bind to /172.31.14.131:34705 2023-09-15 23:01:12,258 INFO [Listener at localhost/41597] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-09-15 23:01:12,259 INFO [Listener at localhost/41597] mob.MobFileCache(124): MobFileCache disabled 2023-09-15 23:01:12,259 INFO [Listener at localhost/41597] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-15 23:01:12,261 INFO [Listener at localhost/41597] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-15 23:01:12,263 INFO [Listener at localhost/41597] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:34705 connecting to ZooKeeper ensemble=127.0.0.1:51149 2023-09-15 23:01:12,268 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:347050x0, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-09-15 23:01:12,269 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:34705-0x100b1d2daa90002 connected 2023-09-15 23:01:12,269 DEBUG [Listener at localhost/41597] zookeeper.ZKUtil(164): regionserver:34705-0x100b1d2daa90002, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-09-15 23:01:12,270 DEBUG [Listener at localhost/41597] zookeeper.ZKUtil(164): regionserver:34705-0x100b1d2daa90002, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-15 23:01:12,271 DEBUG [Listener at localhost/41597] zookeeper.ZKUtil(164): regionserver:34705-0x100b1d2daa90002, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-09-15 23:01:12,273 DEBUG [Listener at localhost/41597] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=34705 2023-09-15 23:01:12,273 DEBUG [Listener at localhost/41597] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=34705 2023-09-15 23:01:12,276 DEBUG [Listener at localhost/41597] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=34705 2023-09-15 23:01:12,276 DEBUG [Listener at localhost/41597] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=34705 2023-09-15 23:01:12,277 DEBUG [Listener at localhost/41597] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=34705 2023-09-15 23:01:12,289 INFO [Listener at localhost/41597] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-09-15 23:01:12,289 INFO [Listener at localhost/41597] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-15 23:01:12,289 INFO [Listener at localhost/41597] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-09-15 23:01:12,289 INFO [Listener at localhost/41597] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-09-15 23:01:12,290 INFO [Listener at localhost/41597] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-15 23:01:12,290 INFO [Listener at localhost/41597] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-09-15 23:01:12,290 INFO [Listener at localhost/41597] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-09-15 23:01:12,292 INFO [Listener at localhost/41597] ipc.NettyRpcServer(120): Bind to /172.31.14.131:41413 2023-09-15 23:01:12,292 INFO [Listener at localhost/41597] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-09-15 23:01:12,293 INFO [Listener at localhost/41597] mob.MobFileCache(124): MobFileCache disabled 2023-09-15 23:01:12,294 INFO [Listener at localhost/41597] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-15 23:01:12,297 INFO [Listener at localhost/41597] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-15 23:01:12,299 INFO [Listener at localhost/41597] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:41413 connecting to ZooKeeper ensemble=127.0.0.1:51149 2023-09-15 23:01:12,304 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:414130x0, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-09-15 23:01:12,305 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:41413-0x100b1d2daa90003 connected 2023-09-15 23:01:12,305 DEBUG [Listener at localhost/41597] zookeeper.ZKUtil(164): regionserver:41413-0x100b1d2daa90003, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-09-15 23:01:12,306 DEBUG [Listener at localhost/41597] zookeeper.ZKUtil(164): regionserver:41413-0x100b1d2daa90003, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-15 23:01:12,307 DEBUG [Listener at localhost/41597] zookeeper.ZKUtil(164): regionserver:41413-0x100b1d2daa90003, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-09-15 23:01:12,313 DEBUG [Listener at localhost/41597] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=41413 2023-09-15 23:01:12,313 DEBUG [Listener at localhost/41597] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=41413 2023-09-15 23:01:12,313 DEBUG [Listener at localhost/41597] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=41413 2023-09-15 23:01:12,314 DEBUG [Listener at localhost/41597] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=41413 2023-09-15 23:01:12,314 DEBUG [Listener at localhost/41597] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=41413 2023-09-15 23:01:12,316 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,44427,1694818870945 2023-09-15 23:01:12,325 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-09-15 23:01:12,327 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,44427,1694818870945 2023-09-15 23:01:12,346 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:33655-0x100b1d2daa90001, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-09-15 23:01:12,346 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:41413-0x100b1d2daa90003, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-09-15 23:01:12,346 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:34705-0x100b1d2daa90002, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-09-15 23:01:12,346 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-09-15 23:01:12,347 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-15 23:01:12,348 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-09-15 23:01:12,350 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,44427,1694818870945 from backup master directory 2023-09-15 23:01:12,350 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-09-15 23:01:12,354 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,44427,1694818870945 2023-09-15 23:01:12,354 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-09-15 23:01:12,355 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-09-15 23:01:12,355 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,44427,1694818870945 2023-09-15 23:01:12,358 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-09-15 23:01:12,360 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-09-15 23:01:12,452 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/hbase.id with ID: e3b908a2-05ce-4077-8544-d0fdc2b88f49 2023-09-15 23:01:12,499 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-15 23:01:12,513 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-15 23:01:12,563 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x4133dbe6 to 127.0.0.1:51149 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-15 23:01:12,602 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@e874c77, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-15 23:01:12,634 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-09-15 23:01:12,636 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-09-15 23:01:12,656 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-09-15 23:01:12,656 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-09-15 23:01:12,658 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-09-15 23:01:12,662 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-09-15 23:01:12,664 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-09-15 23:01:12,700 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/MasterData/data/master/store-tmp 2023-09-15 23:01:12,736 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-15 23:01:12,737 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-09-15 23:01:12,737 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-15 23:01:12,737 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-15 23:01:12,737 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-09-15 23:01:12,737 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-15 23:01:12,737 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-15 23:01:12,737 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-09-15 23:01:12,739 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/MasterData/WALs/jenkins-hbase4.apache.org,44427,1694818870945 2023-09-15 23:01:12,762 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C44427%2C1694818870945, suffix=, logDir=hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/MasterData/WALs/jenkins-hbase4.apache.org,44427,1694818870945, archiveDir=hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/MasterData/oldWALs, maxLogs=10 2023-09-15 23:01:12,818 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41247,DS-b8b785bc-4a72-493d-ba9a-7f551630fcaa,DISK] 2023-09-15 23:01:12,818 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46751,DS-59a00e00-5ed8-46e6-bf93-d4465a55257f,DISK] 2023-09-15 23:01:12,818 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36781,DS-fb8ee2b5-f1f5-428c-a261-5558f7dd02c6,DISK] 2023-09-15 23:01:12,828 DEBUG [RS-EventLoopGroup-5-1] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-09-15 23:01:12,897 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/MasterData/WALs/jenkins-hbase4.apache.org,44427,1694818870945/jenkins-hbase4.apache.org%2C44427%2C1694818870945.1694818872773 2023-09-15 23:01:12,898 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:41247,DS-b8b785bc-4a72-493d-ba9a-7f551630fcaa,DISK], DatanodeInfoWithStorage[127.0.0.1:46751,DS-59a00e00-5ed8-46e6-bf93-d4465a55257f,DISK], DatanodeInfoWithStorage[127.0.0.1:36781,DS-fb8ee2b5-f1f5-428c-a261-5558f7dd02c6,DISK]] 2023-09-15 23:01:12,898 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-09-15 23:01:12,899 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-15 23:01:12,902 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-09-15 23:01:12,903 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-09-15 23:01:12,965 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-09-15 23:01:12,973 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-09-15 23:01:13,001 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-09-15 23:01:13,014 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-15 23:01:13,021 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-09-15 23:01:13,022 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-09-15 23:01:13,036 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-09-15 23:01:13,040 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-15 23:01:13,041 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64875595, jitterRate=-0.03327830135822296}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-15 23:01:13,041 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-09-15 23:01:13,042 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-09-15 23:01:13,065 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-09-15 23:01:13,065 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(561): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-09-15 23:01:13,068 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-09-15 23:01:13,069 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(581): Recovered RegionProcedureStore lease in 1 msec 2023-09-15 23:01:13,106 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(595): Loaded RegionProcedureStore in 36 msec 2023-09-15 23:01:13,106 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-09-15 23:01:13,137 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-09-15 23:01:13,142 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-09-15 23:01:13,174 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-09-15 23:01:13,180 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-09-15 23:01:13,182 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-09-15 23:01:13,188 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-09-15 23:01:13,192 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-09-15 23:01:13,196 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-15 23:01:13,198 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-09-15 23:01:13,198 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-09-15 23:01:13,212 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-09-15 23:01:13,217 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:33655-0x100b1d2daa90001, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-09-15 23:01:13,217 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:34705-0x100b1d2daa90002, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-09-15 23:01:13,217 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-09-15 23:01:13,217 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:41413-0x100b1d2daa90003, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-09-15 23:01:13,217 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-15 23:01:13,218 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,44427,1694818870945, sessionid=0x100b1d2daa90000, setting cluster-up flag (Was=false) 2023-09-15 23:01:13,241 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-15 23:01:13,248 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-09-15 23:01:13,250 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,44427,1694818870945 2023-09-15 23:01:13,257 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-15 23:01:13,263 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-09-15 23:01:13,264 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,44427,1694818870945 2023-09-15 23:01:13,267 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.hbase-snapshot/.tmp 2023-09-15 23:01:13,318 INFO [RS:1;jenkins-hbase4:34705] regionserver.HRegionServer(951): ClusterId : e3b908a2-05ce-4077-8544-d0fdc2b88f49 2023-09-15 23:01:13,318 INFO [RS:0;jenkins-hbase4:33655] regionserver.HRegionServer(951): ClusterId : e3b908a2-05ce-4077-8544-d0fdc2b88f49 2023-09-15 23:01:13,318 INFO [RS:2;jenkins-hbase4:41413] regionserver.HRegionServer(951): ClusterId : e3b908a2-05ce-4077-8544-d0fdc2b88f49 2023-09-15 23:01:13,325 DEBUG [RS:2;jenkins-hbase4:41413] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-09-15 23:01:13,325 DEBUG [RS:0;jenkins-hbase4:33655] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-09-15 23:01:13,325 DEBUG [RS:1;jenkins-hbase4:34705] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-09-15 23:01:13,334 DEBUG [RS:0;jenkins-hbase4:33655] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-09-15 23:01:13,334 DEBUG [RS:2;jenkins-hbase4:41413] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-09-15 23:01:13,334 DEBUG [RS:1;jenkins-hbase4:34705] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-09-15 23:01:13,334 DEBUG [RS:2;jenkins-hbase4:41413] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-09-15 23:01:13,334 DEBUG [RS:0;jenkins-hbase4:33655] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-09-15 23:01:13,335 DEBUG [RS:1;jenkins-hbase4:34705] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-09-15 23:01:13,340 DEBUG [RS:1;jenkins-hbase4:34705] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-09-15 23:01:13,340 DEBUG [RS:2;jenkins-hbase4:41413] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-09-15 23:01:13,340 DEBUG [RS:0;jenkins-hbase4:33655] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-09-15 23:01:13,344 DEBUG [RS:2;jenkins-hbase4:41413] zookeeper.ReadOnlyZKClient(139): Connect 0x226a0771 to 127.0.0.1:51149 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-15 23:01:13,345 DEBUG [RS:1;jenkins-hbase4:34705] zookeeper.ReadOnlyZKClient(139): Connect 0x29a2d220 to 127.0.0.1:51149 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-15 23:01:13,346 DEBUG [RS:0;jenkins-hbase4:33655] zookeeper.ReadOnlyZKClient(139): Connect 0x3340701e to 127.0.0.1:51149 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-15 23:01:13,358 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2930): Registered master coprocessor service: service=AccessControlService 2023-09-15 23:01:13,361 DEBUG [RS:1;jenkins-hbase4:34705] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@27653964, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-15 23:01:13,361 DEBUG [RS:2;jenkins-hbase4:41413] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2cadfd4c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-15 23:01:13,361 DEBUG [RS:1;jenkins-hbase4:34705] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@235ab950, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-09-15 23:01:13,362 DEBUG [RS:2;jenkins-hbase4:41413] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@28926c01, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-09-15 23:01:13,393 DEBUG [RS:0;jenkins-hbase4:33655] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3d879806, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-15 23:01:13,394 DEBUG [RS:0;jenkins-hbase4:33655] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@39b81b6e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-09-15 23:01:13,394 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-15 23:01:13,395 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver loaded, priority=536870912. 2023-09-15 23:01:13,413 DEBUG [RS:2;jenkins-hbase4:41413] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:2;jenkins-hbase4:41413 2023-09-15 23:01:13,413 DEBUG [RS:1;jenkins-hbase4:34705] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:34705 2023-09-15 23:01:13,417 DEBUG [RS:0;jenkins-hbase4:33655] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:33655 2023-09-15 23:01:13,419 INFO [RS:1;jenkins-hbase4:34705] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-09-15 23:01:13,419 INFO [RS:0;jenkins-hbase4:33655] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-09-15 23:01:13,419 INFO [RS:2;jenkins-hbase4:41413] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-09-15 23:01:13,420 INFO [RS:2;jenkins-hbase4:41413] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-09-15 23:01:13,419 INFO [RS:0;jenkins-hbase4:33655] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-09-15 23:01:13,419 INFO [RS:1;jenkins-hbase4:34705] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-09-15 23:01:13,420 DEBUG [RS:2;jenkins-hbase4:41413] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-09-15 23:01:13,420 DEBUG [RS:1;jenkins-hbase4:34705] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-09-15 23:01:13,420 DEBUG [RS:0;jenkins-hbase4:33655] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-09-15 23:01:13,421 INFO [RS:1;jenkins-hbase4:34705] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-15 23:01:13,421 INFO [RS:2;jenkins-hbase4:41413] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-15 23:01:13,421 DEBUG [RS:1;jenkins-hbase4:34705] regionserver.HRegionServer(1022): About to register with Master. 2023-09-15 23:01:13,421 INFO [RS:0;jenkins-hbase4:33655] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-15 23:01:13,421 DEBUG [RS:2;jenkins-hbase4:41413] regionserver.HRegionServer(1022): About to register with Master. 2023-09-15 23:01:13,421 DEBUG [RS:0;jenkins-hbase4:33655] regionserver.HRegionServer(1022): About to register with Master. 2023-09-15 23:01:13,424 INFO [RS:2;jenkins-hbase4:41413] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,44427,1694818870945 with isa=jenkins-hbase4.apache.org/172.31.14.131:41413, startcode=1694818872288 2023-09-15 23:01:13,424 INFO [RS:1;jenkins-hbase4:34705] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,44427,1694818870945 with isa=jenkins-hbase4.apache.org/172.31.14.131:34705, startcode=1694818872254 2023-09-15 23:01:13,424 INFO [RS:0;jenkins-hbase4:33655] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,44427,1694818870945 with isa=jenkins-hbase4.apache.org/172.31.14.131:33655, startcode=1694818872204 2023-09-15 23:01:13,444 DEBUG [RS:2;jenkins-hbase4:41413] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-09-15 23:01:13,444 DEBUG [RS:0;jenkins-hbase4:33655] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-09-15 23:01:13,444 DEBUG [RS:1;jenkins-hbase4:34705] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-09-15 23:01:13,489 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-09-15 23:01:13,499 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-09-15 23:01:13,499 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-09-15 23:01:13,499 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-09-15 23:01:13,499 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-09-15 23:01:13,499 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-09-15 23:01:13,499 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-15 23:01:13,500 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-09-15 23:01:13,500 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-15 23:01:13,501 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44217, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-09-15 23:01:13,501 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35087, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-09-15 23:01:13,502 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1694818903502 2023-09-15 23:01:13,501 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49235, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-09-15 23:01:13,504 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-09-15 23:01:13,511 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-09-15 23:01:13,512 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-09-15 23:01:13,513 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44427] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-09-15 23:01:13,516 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-09-15 23:01:13,517 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-09-15 23:01:13,524 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44427] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-09-15 23:01:13,527 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44427] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-09-15 23:01:13,527 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-09-15 23:01:13,528 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-09-15 23:01:13,528 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-09-15 23:01:13,529 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-09-15 23:01:13,529 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-09-15 23:01:13,531 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-09-15 23:01:13,534 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-09-15 23:01:13,535 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-09-15 23:01:13,538 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-09-15 23:01:13,539 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-09-15 23:01:13,541 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1694818873541,5,FailOnTimeoutGroup] 2023-09-15 23:01:13,542 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1694818873542,5,FailOnTimeoutGroup] 2023-09-15 23:01:13,542 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-09-15 23:01:13,542 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-09-15 23:01:13,544 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-09-15 23:01:13,544 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-09-15 23:01:13,553 DEBUG [RS:2;jenkins-hbase4:41413] regionserver.HRegionServer(2830): Master is not running yet 2023-09-15 23:01:13,553 DEBUG [RS:1;jenkins-hbase4:34705] regionserver.HRegionServer(2830): Master is not running yet 2023-09-15 23:01:13,554 WARN [RS:2;jenkins-hbase4:41413] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-09-15 23:01:13,554 WARN [RS:1;jenkins-hbase4:34705] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-09-15 23:01:13,553 DEBUG [RS:0;jenkins-hbase4:33655] regionserver.HRegionServer(2830): Master is not running yet 2023-09-15 23:01:13,554 WARN [RS:0;jenkins-hbase4:33655] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-09-15 23:01:13,568 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-09-15 23:01:13,569 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-09-15 23:01:13,569 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64 2023-09-15 23:01:13,589 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-15 23:01:13,591 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-09-15 23:01:13,594 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/hbase/meta/1588230740/info 2023-09-15 23:01:13,595 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-09-15 23:01:13,596 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-15 23:01:13,596 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-09-15 23:01:13,599 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/hbase/meta/1588230740/rep_barrier 2023-09-15 23:01:13,599 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-09-15 23:01:13,600 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-15 23:01:13,600 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-09-15 23:01:13,603 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/hbase/meta/1588230740/table 2023-09-15 23:01:13,603 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-09-15 23:01:13,604 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-15 23:01:13,605 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/hbase/meta/1588230740 2023-09-15 23:01:13,606 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/hbase/meta/1588230740 2023-09-15 23:01:13,610 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-09-15 23:01:13,612 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-09-15 23:01:13,616 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-15 23:01:13,617 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74964445, jitterRate=0.11705727875232697}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-09-15 23:01:13,617 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-09-15 23:01:13,617 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-09-15 23:01:13,617 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-09-15 23:01:13,617 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-09-15 23:01:13,617 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-09-15 23:01:13,617 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-09-15 23:01:13,619 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-09-15 23:01:13,619 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-09-15 23:01:13,624 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-09-15 23:01:13,624 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-09-15 23:01:13,633 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-09-15 23:01:13,646 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-09-15 23:01:13,650 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-09-15 23:01:13,655 INFO [RS:0;jenkins-hbase4:33655] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,44427,1694818870945 with isa=jenkins-hbase4.apache.org/172.31.14.131:33655, startcode=1694818872204 2023-09-15 23:01:13,655 INFO [RS:1;jenkins-hbase4:34705] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,44427,1694818870945 with isa=jenkins-hbase4.apache.org/172.31.14.131:34705, startcode=1694818872254 2023-09-15 23:01:13,656 INFO [RS:2;jenkins-hbase4:41413] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,44427,1694818870945 with isa=jenkins-hbase4.apache.org/172.31.14.131:41413, startcode=1694818872288 2023-09-15 23:01:13,661 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44427] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,33655,1694818872204 2023-09-15 23:01:13,667 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44427] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:01:13,668 DEBUG [RS:0;jenkins-hbase4:33655] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64 2023-09-15 23:01:13,668 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44427] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:01:13,668 DEBUG [RS:0;jenkins-hbase4:33655] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:44545 2023-09-15 23:01:13,668 DEBUG [RS:0;jenkins-hbase4:33655] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-09-15 23:01:13,669 DEBUG [RS:1;jenkins-hbase4:34705] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64 2023-09-15 23:01:13,669 DEBUG [RS:1;jenkins-hbase4:34705] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:44545 2023-09-15 23:01:13,669 DEBUG [RS:1;jenkins-hbase4:34705] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-09-15 23:01:13,670 DEBUG [RS:2;jenkins-hbase4:41413] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64 2023-09-15 23:01:13,670 DEBUG [RS:2;jenkins-hbase4:41413] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:44545 2023-09-15 23:01:13,670 DEBUG [RS:2;jenkins-hbase4:41413] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-09-15 23:01:13,675 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-15 23:01:13,680 DEBUG [RS:1;jenkins-hbase4:34705] zookeeper.ZKUtil(162): regionserver:34705-0x100b1d2daa90002, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:01:13,680 WARN [RS:1;jenkins-hbase4:34705] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-09-15 23:01:13,680 INFO [RS:1;jenkins-hbase4:34705] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-09-15 23:01:13,680 DEBUG [RS:2;jenkins-hbase4:41413] zookeeper.ZKUtil(162): regionserver:41413-0x100b1d2daa90003, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:01:13,680 DEBUG [RS:0;jenkins-hbase4:33655] zookeeper.ZKUtil(162): regionserver:33655-0x100b1d2daa90001, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,33655,1694818872204 2023-09-15 23:01:13,681 DEBUG [RS:1;jenkins-hbase4:34705] regionserver.HRegionServer(1948): logDir=hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/WALs/jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:01:13,681 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,41413,1694818872288] 2023-09-15 23:01:13,681 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,33655,1694818872204] 2023-09-15 23:01:13,681 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,34705,1694818872254] 2023-09-15 23:01:13,681 WARN [RS:0;jenkins-hbase4:33655] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-09-15 23:01:13,680 WARN [RS:2;jenkins-hbase4:41413] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-09-15 23:01:13,681 INFO [RS:0;jenkins-hbase4:33655] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-09-15 23:01:13,682 INFO [RS:2;jenkins-hbase4:41413] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-09-15 23:01:13,682 DEBUG [RS:0;jenkins-hbase4:33655] regionserver.HRegionServer(1948): logDir=hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/WALs/jenkins-hbase4.apache.org,33655,1694818872204 2023-09-15 23:01:13,682 DEBUG [RS:2;jenkins-hbase4:41413] regionserver.HRegionServer(1948): logDir=hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/WALs/jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:01:13,697 DEBUG [RS:2;jenkins-hbase4:41413] zookeeper.ZKUtil(162): regionserver:41413-0x100b1d2daa90003, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:01:13,697 DEBUG [RS:0;jenkins-hbase4:33655] zookeeper.ZKUtil(162): regionserver:33655-0x100b1d2daa90001, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:01:13,697 DEBUG [RS:1;jenkins-hbase4:34705] zookeeper.ZKUtil(162): regionserver:34705-0x100b1d2daa90002, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:01:13,697 DEBUG [RS:2;jenkins-hbase4:41413] zookeeper.ZKUtil(162): regionserver:41413-0x100b1d2daa90003, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:01:13,697 DEBUG [RS:0;jenkins-hbase4:33655] zookeeper.ZKUtil(162): regionserver:33655-0x100b1d2daa90001, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:01:13,697 DEBUG [RS:1;jenkins-hbase4:34705] zookeeper.ZKUtil(162): regionserver:34705-0x100b1d2daa90002, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:01:13,698 DEBUG [RS:2;jenkins-hbase4:41413] zookeeper.ZKUtil(162): regionserver:41413-0x100b1d2daa90003, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,33655,1694818872204 2023-09-15 23:01:13,698 DEBUG [RS:0;jenkins-hbase4:33655] zookeeper.ZKUtil(162): regionserver:33655-0x100b1d2daa90001, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,33655,1694818872204 2023-09-15 23:01:13,698 DEBUG [RS:1;jenkins-hbase4:34705] zookeeper.ZKUtil(162): regionserver:34705-0x100b1d2daa90002, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,33655,1694818872204 2023-09-15 23:01:13,711 DEBUG [RS:1;jenkins-hbase4:34705] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-09-15 23:01:13,711 DEBUG [RS:2;jenkins-hbase4:41413] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-09-15 23:01:13,711 DEBUG [RS:0;jenkins-hbase4:33655] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-09-15 23:01:13,724 INFO [RS:2;jenkins-hbase4:41413] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-09-15 23:01:13,724 INFO [RS:0;jenkins-hbase4:33655] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-09-15 23:01:13,724 INFO [RS:1;jenkins-hbase4:34705] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-09-15 23:01:13,751 INFO [RS:2;jenkins-hbase4:41413] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-09-15 23:01:13,751 INFO [RS:0;jenkins-hbase4:33655] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-09-15 23:01:13,751 INFO [RS:1;jenkins-hbase4:34705] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-09-15 23:01:13,756 INFO [RS:2;jenkins-hbase4:41413] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-09-15 23:01:13,756 INFO [RS:2;jenkins-hbase4:41413] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-09-15 23:01:13,757 INFO [RS:0;jenkins-hbase4:33655] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-09-15 23:01:13,757 INFO [RS:1;jenkins-hbase4:34705] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-09-15 23:01:13,758 INFO [RS:2;jenkins-hbase4:41413] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-09-15 23:01:13,758 INFO [RS:0;jenkins-hbase4:33655] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-09-15 23:01:13,758 INFO [RS:1;jenkins-hbase4:34705] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-09-15 23:01:13,759 INFO [RS:0;jenkins-hbase4:33655] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-09-15 23:01:13,759 INFO [RS:1;jenkins-hbase4:34705] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-09-15 23:01:13,768 INFO [RS:0;jenkins-hbase4:33655] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-09-15 23:01:13,768 INFO [RS:1;jenkins-hbase4:34705] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-09-15 23:01:13,768 INFO [RS:2;jenkins-hbase4:41413] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-09-15 23:01:13,768 DEBUG [RS:0;jenkins-hbase4:33655] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-15 23:01:13,769 DEBUG [RS:1;jenkins-hbase4:34705] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-15 23:01:13,770 DEBUG [RS:0;jenkins-hbase4:33655] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-15 23:01:13,769 DEBUG [RS:2;jenkins-hbase4:41413] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-15 23:01:13,770 DEBUG [RS:0;jenkins-hbase4:33655] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-15 23:01:13,770 DEBUG [RS:2;jenkins-hbase4:41413] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-15 23:01:13,770 DEBUG [RS:0;jenkins-hbase4:33655] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-15 23:01:13,770 DEBUG [RS:2;jenkins-hbase4:41413] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-15 23:01:13,770 DEBUG [RS:0;jenkins-hbase4:33655] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-15 23:01:13,770 DEBUG [RS:2;jenkins-hbase4:41413] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-15 23:01:13,770 DEBUG [RS:0;jenkins-hbase4:33655] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-09-15 23:01:13,770 DEBUG [RS:2;jenkins-hbase4:41413] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-15 23:01:13,770 DEBUG [RS:0;jenkins-hbase4:33655] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-15 23:01:13,770 DEBUG [RS:2;jenkins-hbase4:41413] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-09-15 23:01:13,770 DEBUG [RS:1;jenkins-hbase4:34705] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-15 23:01:13,770 DEBUG [RS:2;jenkins-hbase4:41413] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-15 23:01:13,770 DEBUG [RS:0;jenkins-hbase4:33655] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-15 23:01:13,771 DEBUG [RS:2;jenkins-hbase4:41413] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-15 23:01:13,770 DEBUG [RS:1;jenkins-hbase4:34705] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-15 23:01:13,771 DEBUG [RS:2;jenkins-hbase4:41413] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-15 23:01:13,771 DEBUG [RS:0;jenkins-hbase4:33655] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-15 23:01:13,771 DEBUG [RS:1;jenkins-hbase4:34705] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-15 23:01:13,771 DEBUG [RS:0;jenkins-hbase4:33655] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-15 23:01:13,771 DEBUG [RS:1;jenkins-hbase4:34705] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-15 23:01:13,771 DEBUG [RS:2;jenkins-hbase4:41413] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-15 23:01:13,771 DEBUG [RS:1;jenkins-hbase4:34705] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-09-15 23:01:13,771 DEBUG [RS:1;jenkins-hbase4:34705] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-15 23:01:13,774 DEBUG [RS:1;jenkins-hbase4:34705] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-15 23:01:13,774 DEBUG [RS:1;jenkins-hbase4:34705] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-15 23:01:13,774 DEBUG [RS:1;jenkins-hbase4:34705] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-15 23:01:13,774 INFO [RS:0;jenkins-hbase4:33655] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-09-15 23:01:13,774 INFO [RS:0;jenkins-hbase4:33655] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-09-15 23:01:13,774 INFO [RS:0;jenkins-hbase4:33655] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-09-15 23:01:13,774 INFO [RS:2;jenkins-hbase4:41413] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-09-15 23:01:13,774 INFO [RS:2;jenkins-hbase4:41413] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-09-15 23:01:13,774 INFO [RS:2;jenkins-hbase4:41413] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-09-15 23:01:13,781 INFO [RS:1;jenkins-hbase4:34705] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-09-15 23:01:13,781 INFO [RS:1;jenkins-hbase4:34705] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-09-15 23:01:13,781 INFO [RS:1;jenkins-hbase4:34705] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-09-15 23:01:13,793 INFO [RS:2;jenkins-hbase4:41413] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-09-15 23:01:13,793 INFO [RS:0;jenkins-hbase4:33655] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-09-15 23:01:13,796 INFO [RS:0;jenkins-hbase4:33655] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,33655,1694818872204-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-09-15 23:01:13,796 INFO [RS:2;jenkins-hbase4:41413] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41413,1694818872288-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-09-15 23:01:13,798 INFO [RS:1;jenkins-hbase4:34705] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-09-15 23:01:13,799 INFO [RS:1;jenkins-hbase4:34705] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,34705,1694818872254-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-09-15 23:01:13,801 DEBUG [jenkins-hbase4:44427] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=3, allServersCount=3 2023-09-15 23:01:13,807 DEBUG [jenkins-hbase4:44427] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-15 23:01:13,815 DEBUG [jenkins-hbase4:44427] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-15 23:01:13,815 DEBUG [jenkins-hbase4:44427] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-15 23:01:13,815 DEBUG [jenkins-hbase4:44427] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-15 23:01:13,815 DEBUG [jenkins-hbase4:44427] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-15 23:01:13,819 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,41413,1694818872288, state=OPENING 2023-09-15 23:01:13,825 INFO [RS:1;jenkins-hbase4:34705] regionserver.Replication(203): jenkins-hbase4.apache.org,34705,1694818872254 started 2023-09-15 23:01:13,825 INFO [RS:1;jenkins-hbase4:34705] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,34705,1694818872254, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:34705, sessionid=0x100b1d2daa90002 2023-09-15 23:01:13,829 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-09-15 23:01:13,830 INFO [RS:2;jenkins-hbase4:41413] regionserver.Replication(203): jenkins-hbase4.apache.org,41413,1694818872288 started 2023-09-15 23:01:13,830 INFO [RS:2;jenkins-hbase4:41413] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,41413,1694818872288, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:41413, sessionid=0x100b1d2daa90003 2023-09-15 23:01:13,830 INFO [RS:0;jenkins-hbase4:33655] regionserver.Replication(203): jenkins-hbase4.apache.org,33655,1694818872204 started 2023-09-15 23:01:13,830 DEBUG [RS:1;jenkins-hbase4:34705] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-09-15 23:01:13,830 DEBUG [RS:2;jenkins-hbase4:41413] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-09-15 23:01:13,831 DEBUG [RS:1;jenkins-hbase4:34705] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:01:13,830 INFO [RS:0;jenkins-hbase4:33655] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,33655,1694818872204, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:33655, sessionid=0x100b1d2daa90001 2023-09-15 23:01:13,832 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-15 23:01:13,832 DEBUG [RS:0;jenkins-hbase4:33655] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-09-15 23:01:13,832 DEBUG [RS:1;jenkins-hbase4:34705] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,34705,1694818872254' 2023-09-15 23:01:13,832 DEBUG [RS:1;jenkins-hbase4:34705] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-09-15 23:01:13,831 DEBUG [RS:2;jenkins-hbase4:41413] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:01:13,832 DEBUG [RS:0;jenkins-hbase4:33655] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,33655,1694818872204 2023-09-15 23:01:13,832 DEBUG [RS:2;jenkins-hbase4:41413] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,41413,1694818872288' 2023-09-15 23:01:13,833 DEBUG [RS:2;jenkins-hbase4:41413] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-09-15 23:01:13,832 DEBUG [RS:0;jenkins-hbase4:33655] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,33655,1694818872204' 2023-09-15 23:01:13,833 DEBUG [RS:0;jenkins-hbase4:33655] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-09-15 23:01:13,833 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-09-15 23:01:13,833 DEBUG [RS:1;jenkins-hbase4:34705] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-09-15 23:01:13,834 DEBUG [RS:2;jenkins-hbase4:41413] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-09-15 23:01:13,834 DEBUG [RS:0;jenkins-hbase4:33655] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-09-15 23:01:13,834 DEBUG [RS:1;jenkins-hbase4:34705] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-09-15 23:01:13,834 DEBUG [RS:1;jenkins-hbase4:34705] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-09-15 23:01:13,835 DEBUG [RS:1;jenkins-hbase4:34705] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:01:13,835 DEBUG [RS:1;jenkins-hbase4:34705] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,34705,1694818872254' 2023-09-15 23:01:13,835 DEBUG [RS:1;jenkins-hbase4:34705] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 23:01:13,838 DEBUG [RS:0;jenkins-hbase4:33655] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-09-15 23:01:13,838 DEBUG [RS:1;jenkins-hbase4:34705] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 23:01:13,838 DEBUG [RS:2;jenkins-hbase4:41413] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-09-15 23:01:13,838 DEBUG [RS:0;jenkins-hbase4:33655] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-09-15 23:01:13,838 DEBUG [RS:2;jenkins-hbase4:41413] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-09-15 23:01:13,838 DEBUG [RS:0;jenkins-hbase4:33655] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,33655,1694818872204 2023-09-15 23:01:13,839 DEBUG [RS:2;jenkins-hbase4:41413] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:01:13,839 DEBUG [RS:1;jenkins-hbase4:34705] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-09-15 23:01:13,839 DEBUG [RS:0;jenkins-hbase4:33655] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,33655,1694818872204' 2023-09-15 23:01:13,839 DEBUG [RS:0;jenkins-hbase4:33655] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 23:01:13,839 INFO [RS:1;jenkins-hbase4:34705] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-09-15 23:01:13,839 DEBUG [RS:2;jenkins-hbase4:41413] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,41413,1694818872288' 2023-09-15 23:01:13,840 DEBUG [RS:2;jenkins-hbase4:41413] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 23:01:13,839 INFO [RS:1;jenkins-hbase4:34705] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-09-15 23:01:13,840 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,41413,1694818872288}] 2023-09-15 23:01:13,840 DEBUG [RS:0;jenkins-hbase4:33655] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 23:01:13,840 DEBUG [RS:2;jenkins-hbase4:41413] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 23:01:13,841 DEBUG [RS:0;jenkins-hbase4:33655] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-09-15 23:01:13,841 INFO [RS:0;jenkins-hbase4:33655] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-09-15 23:01:13,841 DEBUG [RS:2;jenkins-hbase4:41413] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-09-15 23:01:13,841 INFO [RS:0;jenkins-hbase4:33655] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-09-15 23:01:13,843 INFO [RS:2;jenkins-hbase4:41413] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-09-15 23:01:13,843 INFO [RS:2;jenkins-hbase4:41413] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-09-15 23:01:13,952 INFO [RS:2;jenkins-hbase4:41413] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C41413%2C1694818872288, suffix=, logDir=hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/WALs/jenkins-hbase4.apache.org,41413,1694818872288, archiveDir=hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/oldWALs, maxLogs=32 2023-09-15 23:01:13,952 INFO [RS:0;jenkins-hbase4:33655] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C33655%2C1694818872204, suffix=, logDir=hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/WALs/jenkins-hbase4.apache.org,33655,1694818872204, archiveDir=hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/oldWALs, maxLogs=32 2023-09-15 23:01:13,953 INFO [RS:1;jenkins-hbase4:34705] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C34705%2C1694818872254, suffix=, logDir=hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/WALs/jenkins-hbase4.apache.org,34705,1694818872254, archiveDir=hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/oldWALs, maxLogs=32 2023-09-15 23:01:13,981 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36781,DS-fb8ee2b5-f1f5-428c-a261-5558f7dd02c6,DISK] 2023-09-15 23:01:13,981 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41247,DS-b8b785bc-4a72-493d-ba9a-7f551630fcaa,DISK] 2023-09-15 23:01:13,981 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46751,DS-59a00e00-5ed8-46e6-bf93-d4465a55257f,DISK] 2023-09-15 23:01:13,982 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46751,DS-59a00e00-5ed8-46e6-bf93-d4465a55257f,DISK] 2023-09-15 23:01:13,982 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36781,DS-fb8ee2b5-f1f5-428c-a261-5558f7dd02c6,DISK] 2023-09-15 23:01:13,983 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41247,DS-b8b785bc-4a72-493d-ba9a-7f551630fcaa,DISK] 2023-09-15 23:01:13,996 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46751,DS-59a00e00-5ed8-46e6-bf93-d4465a55257f,DISK] 2023-09-15 23:01:13,996 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41247,DS-b8b785bc-4a72-493d-ba9a-7f551630fcaa,DISK] 2023-09-15 23:01:13,996 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36781,DS-fb8ee2b5-f1f5-428c-a261-5558f7dd02c6,DISK] 2023-09-15 23:01:14,002 INFO [RS:2;jenkins-hbase4:41413] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/WALs/jenkins-hbase4.apache.org,41413,1694818872288/jenkins-hbase4.apache.org%2C41413%2C1694818872288.1694818873958 2023-09-15 23:01:14,002 INFO [RS:0;jenkins-hbase4:33655] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/WALs/jenkins-hbase4.apache.org,33655,1694818872204/jenkins-hbase4.apache.org%2C33655%2C1694818872204.1694818873958 2023-09-15 23:01:14,006 DEBUG [RS:2;jenkins-hbase4:41413] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:36781,DS-fb8ee2b5-f1f5-428c-a261-5558f7dd02c6,DISK], DatanodeInfoWithStorage[127.0.0.1:46751,DS-59a00e00-5ed8-46e6-bf93-d4465a55257f,DISK], DatanodeInfoWithStorage[127.0.0.1:41247,DS-b8b785bc-4a72-493d-ba9a-7f551630fcaa,DISK]] 2023-09-15 23:01:14,007 DEBUG [RS:0;jenkins-hbase4:33655] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:46751,DS-59a00e00-5ed8-46e6-bf93-d4465a55257f,DISK], DatanodeInfoWithStorage[127.0.0.1:36781,DS-fb8ee2b5-f1f5-428c-a261-5558f7dd02c6,DISK], DatanodeInfoWithStorage[127.0.0.1:41247,DS-b8b785bc-4a72-493d-ba9a-7f551630fcaa,DISK]] 2023-09-15 23:01:14,007 INFO [RS:1;jenkins-hbase4:34705] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/WALs/jenkins-hbase4.apache.org,34705,1694818872254/jenkins-hbase4.apache.org%2C34705%2C1694818872254.1694818873958 2023-09-15 23:01:14,008 DEBUG [RS:1;jenkins-hbase4:34705] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:41247,DS-b8b785bc-4a72-493d-ba9a-7f551630fcaa,DISK], DatanodeInfoWithStorage[127.0.0.1:36781,DS-fb8ee2b5-f1f5-428c-a261-5558f7dd02c6,DISK], DatanodeInfoWithStorage[127.0.0.1:46751,DS-59a00e00-5ed8-46e6-bf93-d4465a55257f,DISK]] 2023-09-15 23:01:14,038 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:01:14,041 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-15 23:01:14,044 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52640, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-15 23:01:14,062 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-09-15 23:01:14,062 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-09-15 23:01:14,066 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C41413%2C1694818872288.meta, suffix=.meta, logDir=hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/WALs/jenkins-hbase4.apache.org,41413,1694818872288, archiveDir=hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/oldWALs, maxLogs=32 2023-09-15 23:01:14,090 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41247,DS-b8b785bc-4a72-493d-ba9a-7f551630fcaa,DISK] 2023-09-15 23:01:14,090 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46751,DS-59a00e00-5ed8-46e6-bf93-d4465a55257f,DISK] 2023-09-15 23:01:14,090 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36781,DS-fb8ee2b5-f1f5-428c-a261-5558f7dd02c6,DISK] 2023-09-15 23:01:14,102 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/WALs/jenkins-hbase4.apache.org,41413,1694818872288/jenkins-hbase4.apache.org%2C41413%2C1694818872288.meta.1694818874067.meta 2023-09-15 23:01:14,103 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:41247,DS-b8b785bc-4a72-493d-ba9a-7f551630fcaa,DISK], DatanodeInfoWithStorage[127.0.0.1:46751,DS-59a00e00-5ed8-46e6-bf93-d4465a55257f,DISK], DatanodeInfoWithStorage[127.0.0.1:36781,DS-fb8ee2b5-f1f5-428c-a261-5558f7dd02c6,DISK]] 2023-09-15 23:01:14,103 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-09-15 23:01:14,105 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=AccessControlService 2023-09-15 23:01:14,106 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-15 23:01:14,107 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-09-15 23:01:14,109 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-09-15 23:01:14,111 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-09-15 23:01:14,125 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-09-15 23:01:14,125 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-15 23:01:14,125 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-09-15 23:01:14,125 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-09-15 23:01:14,129 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-09-15 23:01:14,131 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/hbase/meta/1588230740/info 2023-09-15 23:01:14,131 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/hbase/meta/1588230740/info 2023-09-15 23:01:14,132 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-09-15 23:01:14,133 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-15 23:01:14,133 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-09-15 23:01:14,135 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/hbase/meta/1588230740/rep_barrier 2023-09-15 23:01:14,135 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/hbase/meta/1588230740/rep_barrier 2023-09-15 23:01:14,137 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-09-15 23:01:14,140 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-15 23:01:14,140 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-09-15 23:01:14,142 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/hbase/meta/1588230740/table 2023-09-15 23:01:14,142 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/hbase/meta/1588230740/table 2023-09-15 23:01:14,142 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-09-15 23:01:14,143 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-15 23:01:14,145 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/hbase/meta/1588230740 2023-09-15 23:01:14,149 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/hbase/meta/1588230740 2023-09-15 23:01:14,153 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-09-15 23:01:14,156 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-09-15 23:01:14,157 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61147124, jitterRate=-0.08883684873580933}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-09-15 23:01:14,161 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-09-15 23:01:14,177 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1694818874026 2023-09-15 23:01:14,200 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-09-15 23:01:14,201 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-09-15 23:01:14,201 INFO [PEWorker-4] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,41413,1694818872288, state=OPEN 2023-09-15 23:01:14,204 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-09-15 23:01:14,204 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-09-15 23:01:14,209 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=3, resume processing ppid=2 2023-09-15 23:01:14,209 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,41413,1694818872288 in 364 msec 2023-09-15 23:01:14,214 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=2, resume processing ppid=1 2023-09-15 23:01:14,214 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 577 msec 2023-09-15 23:01:14,220 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 815 msec 2023-09-15 23:01:14,220 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1694818874220, completionTime=-1 2023-09-15 23:01:14,221 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=3; waited=0ms, expected min=3 server(s), max=3 server(s), master is running 2023-09-15 23:01:14,221 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-09-15 23:01:14,291 DEBUG [hconnection-0x78d29e78-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-15 23:01:14,294 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52648, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-15 23:01:14,323 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=3 2023-09-15 23:01:14,323 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1694818934323 2023-09-15 23:01:14,323 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1694818994323 2023-09-15 23:01:14,323 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 102 msec 2023-09-15 23:01:14,353 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,44427,1694818870945-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-09-15 23:01:14,353 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,44427,1694818870945-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-09-15 23:01:14,353 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,44427,1694818870945-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-09-15 23:01:14,355 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:44427, period=300000, unit=MILLISECONDS is enabled. 2023-09-15 23:01:14,356 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-09-15 23:01:14,364 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-09-15 23:01:14,373 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-09-15 23:01:14,375 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-09-15 23:01:14,385 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-09-15 23:01:14,387 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-09-15 23:01:14,391 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-15 23:01:14,413 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.tmp/data/hbase/namespace/c1bbd79b4a7b2345bd057dfc3a1a2a94 2023-09-15 23:01:14,415 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.tmp/data/hbase/namespace/c1bbd79b4a7b2345bd057dfc3a1a2a94 empty. 2023-09-15 23:01:14,416 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.tmp/data/hbase/namespace/c1bbd79b4a7b2345bd057dfc3a1a2a94 2023-09-15 23:01:14,416 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-09-15 23:01:14,496 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-09-15 23:01:14,498 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => c1bbd79b4a7b2345bd057dfc3a1a2a94, NAME => 'hbase:namespace,,1694818874374.c1bbd79b4a7b2345bd057dfc3a1a2a94.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.tmp 2023-09-15 23:01:14,524 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1694818874374.c1bbd79b4a7b2345bd057dfc3a1a2a94.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-15 23:01:14,524 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing c1bbd79b4a7b2345bd057dfc3a1a2a94, disabling compactions & flushes 2023-09-15 23:01:14,524 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1694818874374.c1bbd79b4a7b2345bd057dfc3a1a2a94. 2023-09-15 23:01:14,524 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1694818874374.c1bbd79b4a7b2345bd057dfc3a1a2a94. 2023-09-15 23:01:14,524 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1694818874374.c1bbd79b4a7b2345bd057dfc3a1a2a94. after waiting 0 ms 2023-09-15 23:01:14,524 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1694818874374.c1bbd79b4a7b2345bd057dfc3a1a2a94. 2023-09-15 23:01:14,524 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1694818874374.c1bbd79b4a7b2345bd057dfc3a1a2a94. 2023-09-15 23:01:14,524 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for c1bbd79b4a7b2345bd057dfc3a1a2a94: 2023-09-15 23:01:14,529 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-09-15 23:01:14,549 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1694818874374.c1bbd79b4a7b2345bd057dfc3a1a2a94.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1694818874533"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694818874533"}]},"ts":"1694818874533"} 2023-09-15 23:01:14,581 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-09-15 23:01:14,584 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-15 23:01:14,591 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694818874584"}]},"ts":"1694818874584"} 2023-09-15 23:01:14,595 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-09-15 23:01:14,599 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-15 23:01:14,600 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-15 23:01:14,600 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-15 23:01:14,600 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-15 23:01:14,600 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-15 23:01:14,602 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=c1bbd79b4a7b2345bd057dfc3a1a2a94, ASSIGN}] 2023-09-15 23:01:14,605 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=c1bbd79b4a7b2345bd057dfc3a1a2a94, ASSIGN 2023-09-15 23:01:14,607 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=c1bbd79b4a7b2345bd057dfc3a1a2a94, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34705,1694818872254; forceNewPlan=false, retain=false 2023-09-15 23:01:14,759 INFO [jenkins-hbase4:44427] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-09-15 23:01:14,760 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=c1bbd79b4a7b2345bd057dfc3a1a2a94, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:01:14,761 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1694818874374.c1bbd79b4a7b2345bd057dfc3a1a2a94.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1694818874760"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694818874760"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694818874760"}]},"ts":"1694818874760"} 2023-09-15 23:01:14,767 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure c1bbd79b4a7b2345bd057dfc3a1a2a94, server=jenkins-hbase4.apache.org,34705,1694818872254}] 2023-09-15 23:01:14,922 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:01:14,922 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-15 23:01:14,925 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38742, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-15 23:01:14,931 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1694818874374.c1bbd79b4a7b2345bd057dfc3a1a2a94. 2023-09-15 23:01:14,932 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => c1bbd79b4a7b2345bd057dfc3a1a2a94, NAME => 'hbase:namespace,,1694818874374.c1bbd79b4a7b2345bd057dfc3a1a2a94.', STARTKEY => '', ENDKEY => ''} 2023-09-15 23:01:14,932 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:namespace,,1694818874374.c1bbd79b4a7b2345bd057dfc3a1a2a94. service=AccessControlService 2023-09-15 23:01:14,933 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-15 23:01:14,933 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace c1bbd79b4a7b2345bd057dfc3a1a2a94 2023-09-15 23:01:14,933 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1694818874374.c1bbd79b4a7b2345bd057dfc3a1a2a94.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-15 23:01:14,933 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for c1bbd79b4a7b2345bd057dfc3a1a2a94 2023-09-15 23:01:14,933 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for c1bbd79b4a7b2345bd057dfc3a1a2a94 2023-09-15 23:01:14,936 INFO [StoreOpener-c1bbd79b4a7b2345bd057dfc3a1a2a94-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region c1bbd79b4a7b2345bd057dfc3a1a2a94 2023-09-15 23:01:14,938 DEBUG [StoreOpener-c1bbd79b4a7b2345bd057dfc3a1a2a94-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/hbase/namespace/c1bbd79b4a7b2345bd057dfc3a1a2a94/info 2023-09-15 23:01:14,938 DEBUG [StoreOpener-c1bbd79b4a7b2345bd057dfc3a1a2a94-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/hbase/namespace/c1bbd79b4a7b2345bd057dfc3a1a2a94/info 2023-09-15 23:01:14,939 INFO [StoreOpener-c1bbd79b4a7b2345bd057dfc3a1a2a94-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c1bbd79b4a7b2345bd057dfc3a1a2a94 columnFamilyName info 2023-09-15 23:01:14,940 INFO [StoreOpener-c1bbd79b4a7b2345bd057dfc3a1a2a94-1] regionserver.HStore(310): Store=c1bbd79b4a7b2345bd057dfc3a1a2a94/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-15 23:01:14,941 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/hbase/namespace/c1bbd79b4a7b2345bd057dfc3a1a2a94 2023-09-15 23:01:14,942 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/hbase/namespace/c1bbd79b4a7b2345bd057dfc3a1a2a94 2023-09-15 23:01:14,946 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for c1bbd79b4a7b2345bd057dfc3a1a2a94 2023-09-15 23:01:14,950 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/hbase/namespace/c1bbd79b4a7b2345bd057dfc3a1a2a94/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-15 23:01:14,950 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened c1bbd79b4a7b2345bd057dfc3a1a2a94; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63781865, jitterRate=-0.04957614839076996}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-15 23:01:14,950 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for c1bbd79b4a7b2345bd057dfc3a1a2a94: 2023-09-15 23:01:14,953 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1694818874374.c1bbd79b4a7b2345bd057dfc3a1a2a94., pid=6, masterSystemTime=1694818874921 2023-09-15 23:01:14,957 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1694818874374.c1bbd79b4a7b2345bd057dfc3a1a2a94. 2023-09-15 23:01:14,957 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1694818874374.c1bbd79b4a7b2345bd057dfc3a1a2a94. 2023-09-15 23:01:14,959 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=c1bbd79b4a7b2345bd057dfc3a1a2a94, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:01:14,959 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1694818874374.c1bbd79b4a7b2345bd057dfc3a1a2a94.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1694818874958"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1694818874958"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1694818874958"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1694818874958"}]},"ts":"1694818874958"} 2023-09-15 23:01:14,966 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=6, resume processing ppid=5 2023-09-15 23:01:14,966 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure c1bbd79b4a7b2345bd057dfc3a1a2a94, server=jenkins-hbase4.apache.org,34705,1694818872254 in 196 msec 2023-09-15 23:01:14,970 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=5, resume processing ppid=4 2023-09-15 23:01:14,971 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=c1bbd79b4a7b2345bd057dfc3a1a2a94, ASSIGN in 364 msec 2023-09-15 23:01:14,972 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-15 23:01:14,972 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694818874972"}]},"ts":"1694818874972"} 2023-09-15 23:01:14,975 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-09-15 23:01:14,979 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-09-15 23:01:14,982 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 603 msec 2023-09-15 23:01:14,991 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-09-15 23:01:14,992 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-09-15 23:01:14,992 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-15 23:01:15,013 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-15 23:01:15,016 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38756, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-15 23:01:15,028 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-09-15 23:01:15,041 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-09-15 23:01:15,047 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 25 msec 2023-09-15 23:01:15,051 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-09-15 23:01:15,066 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-09-15 23:01:15,071 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 19 msec 2023-09-15 23:01:15,086 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-09-15 23:01:15,090 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-09-15 23:01:15,090 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 2.735sec 2023-09-15 23:01:15,093 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-09-15 23:01:15,095 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-09-15 23:01:15,095 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-09-15 23:01:15,096 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,44427,1694818870945-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-09-15 23:01:15,097 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,44427,1694818870945-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-09-15 23:01:15,116 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster$4(2112): Client=null/null create 'hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-09-15 23:01:15,118 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:acl 2023-09-15 23:01:15,120 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_PRE_OPERATION 2023-09-15 23:01:15,122 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-15 23:01:15,124 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.tmp/data/hbase/acl/d38939590183e4a5cb1ff6cb57c77dc8 2023-09-15 23:01:15,125 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(700): Client=null/null procedure request for creating table: namespace: "hbase" qualifier: "acl" procId is: 9 2023-09-15 23:01:15,125 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.tmp/data/hbase/acl/d38939590183e4a5cb1ff6cb57c77dc8 empty. 2023-09-15 23:01:15,125 DEBUG [Listener at localhost/41597] zookeeper.ReadOnlyZKClient(139): Connect 0x5ef1d215 to 127.0.0.1:51149 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-15 23:01:15,128 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.tmp/data/hbase/acl/d38939590183e4a5cb1ff6cb57c77dc8 2023-09-15 23:01:15,129 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived hbase:acl regions 2023-09-15 23:01:15,132 DEBUG [Listener at localhost/41597] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@51038fe2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-15 23:01:15,134 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-09-15 23:01:15,156 DEBUG [hconnection-0x3d72c724-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-15 23:01:15,158 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.tmp/data/hbase/acl/.tabledesc/.tableinfo.0000000001 2023-09-15 23:01:15,160 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(7675): creating {ENCODED => d38939590183e4a5cb1ff6cb57c77dc8, NAME => 'hbase:acl,,1694818875113.d38939590183e4a5cb1ff6cb57c77dc8.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.tmp 2023-09-15 23:01:15,172 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52662, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-15 23:01:15,177 INFO [Listener at localhost/41597] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,44427,1694818870945 2023-09-15 23:01:15,177 INFO [Listener at localhost/41597] hbase.HBaseTestingUtility(2699): Starting mini mapreduce cluster... 2023-09-15 23:01:15,179 INFO [Listener at localhost/41597] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c5e9ebbf-ce0f-c6b3-3dce-6299f7b47f51/test.cache.data in system properties and HBase conf 2023-09-15 23:01:15,179 INFO [Listener at localhost/41597] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c5e9ebbf-ce0f-c6b3-3dce-6299f7b47f51/hadoop.tmp.dir in system properties and HBase conf 2023-09-15 23:01:15,180 INFO [Listener at localhost/41597] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c5e9ebbf-ce0f-c6b3-3dce-6299f7b47f51/hadoop.log.dir in system properties and HBase conf 2023-09-15 23:01:15,180 INFO [Listener at localhost/41597] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c5e9ebbf-ce0f-c6b3-3dce-6299f7b47f51/mapreduce.cluster.local.dir in system properties and HBase conf 2023-09-15 23:01:15,180 INFO [Listener at localhost/41597] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c5e9ebbf-ce0f-c6b3-3dce-6299f7b47f51/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-09-15 23:01:15,180 INFO [Listener at localhost/41597] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-09-15 23:01:15,180 INFO [Listener at localhost/41597] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c5e9ebbf-ce0f-c6b3-3dce-6299f7b47f51/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-09-15 23:01:15,180 INFO [Listener at localhost/41597] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c5e9ebbf-ce0f-c6b3-3dce-6299f7b47f51/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-09-15 23:01:15,180 INFO [Listener at localhost/41597] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c5e9ebbf-ce0f-c6b3-3dce-6299f7b47f51/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-09-15 23:01:15,181 INFO [Listener at localhost/41597] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c5e9ebbf-ce0f-c6b3-3dce-6299f7b47f51/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-09-15 23:01:15,181 INFO [Listener at localhost/41597] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c5e9ebbf-ce0f-c6b3-3dce-6299f7b47f51/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-09-15 23:01:15,181 INFO [Listener at localhost/41597] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c5e9ebbf-ce0f-c6b3-3dce-6299f7b47f51/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-09-15 23:01:15,181 INFO [Listener at localhost/41597] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c5e9ebbf-ce0f-c6b3-3dce-6299f7b47f51/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-09-15 23:01:15,181 INFO [Listener at localhost/41597] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c5e9ebbf-ce0f-c6b3-3dce-6299f7b47f51/dfs.journalnode.edits.dir in system properties and HBase conf 2023-09-15 23:01:15,181 INFO [Listener at localhost/41597] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c5e9ebbf-ce0f-c6b3-3dce-6299f7b47f51/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-09-15 23:01:15,181 INFO [Listener at localhost/41597] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c5e9ebbf-ce0f-c6b3-3dce-6299f7b47f51/nfs.dump.dir in system properties and HBase conf 2023-09-15 23:01:15,182 INFO [Listener at localhost/41597] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c5e9ebbf-ce0f-c6b3-3dce-6299f7b47f51/java.io.tmpdir in system properties and HBase conf 2023-09-15 23:01:15,182 INFO [Listener at localhost/41597] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c5e9ebbf-ce0f-c6b3-3dce-6299f7b47f51/dfs.journalnode.edits.dir in system properties and HBase conf 2023-09-15 23:01:15,182 INFO [Listener at localhost/41597] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c5e9ebbf-ce0f-c6b3-3dce-6299f7b47f51/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-09-15 23:01:15,182 INFO [Listener at localhost/41597] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c5e9ebbf-ce0f-c6b3-3dce-6299f7b47f51/fs.s3a.committer.staging.tmp.path in system properties and HBase conf 2023-09-15 23:01:15,187 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(866): Instantiated hbase:acl,,1694818875113.d38939590183e4a5cb1ff6cb57c77dc8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-15 23:01:15,187 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1604): Closing d38939590183e4a5cb1ff6cb57c77dc8, disabling compactions & flushes 2023-09-15 23:01:15,187 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1626): Closing region hbase:acl,,1694818875113.d38939590183e4a5cb1ff6cb57c77dc8. 2023-09-15 23:01:15,187 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1694818875113.d38939590183e4a5cb1ff6cb57c77dc8. 2023-09-15 23:01:15,187 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1694818875113.d38939590183e4a5cb1ff6cb57c77dc8. after waiting 0 ms 2023-09-15 23:01:15,188 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1694818875113.d38939590183e4a5cb1ff6cb57c77dc8. 2023-09-15 23:01:15,188 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1838): Closed hbase:acl,,1694818875113.d38939590183e4a5cb1ff6cb57c77dc8. 2023-09-15 23:01:15,188 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1558): Region close journal for d38939590183e4a5cb1ff6cb57c77dc8: 2023-09-15 23:01:15,192 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ADD_TO_META 2023-09-15 23:01:15,194 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:acl,,1694818875113.d38939590183e4a5cb1ff6cb57c77dc8.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1694818875194"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694818875194"}]},"ts":"1694818875194"} 2023-09-15 23:01:15,197 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-09-15 23:01:15,199 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-15 23:01:15,199 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694818875199"}]},"ts":"1694818875199"} 2023-09-15 23:01:15,201 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLING in hbase:meta 2023-09-15 23:01:15,207 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-15 23:01:15,208 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-15 23:01:15,208 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-15 23:01:15,208 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-15 23:01:15,208 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-15 23:01:15,208 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=d38939590183e4a5cb1ff6cb57c77dc8, ASSIGN}] 2023-09-15 23:01:15,211 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=d38939590183e4a5cb1ff6cb57c77dc8, ASSIGN 2023-09-15 23:01:15,212 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:acl, region=d38939590183e4a5cb1ff6cb57c77dc8, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41413,1694818872288; forceNewPlan=false, retain=false 2023-09-15 23:01:15,239 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-09-15 23:01:15,362 INFO [jenkins-hbase4:44427] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-09-15 23:01:15,364 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=d38939590183e4a5cb1ff6cb57c77dc8, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:01:15,364 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:acl,,1694818875113.d38939590183e4a5cb1ff6cb57c77dc8.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1694818875364"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694818875364"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694818875364"}]},"ts":"1694818875364"} 2023-09-15 23:01:15,367 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure d38939590183e4a5cb1ff6cb57c77dc8, server=jenkins-hbase4.apache.org,41413,1694818872288}] 2023-09-15 23:01:15,439 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-09-15 23:01:15,527 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:acl,,1694818875113.d38939590183e4a5cb1ff6cb57c77dc8. 2023-09-15 23:01:15,527 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => d38939590183e4a5cb1ff6cb57c77dc8, NAME => 'hbase:acl,,1694818875113.d38939590183e4a5cb1ff6cb57c77dc8.', STARTKEY => '', ENDKEY => ''} 2023-09-15 23:01:15,528 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:acl,,1694818875113.d38939590183e4a5cb1ff6cb57c77dc8. service=AccessControlService 2023-09-15 23:01:15,528 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-15 23:01:15,528 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table acl d38939590183e4a5cb1ff6cb57c77dc8 2023-09-15 23:01:15,528 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:acl,,1694818875113.d38939590183e4a5cb1ff6cb57c77dc8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-15 23:01:15,528 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for d38939590183e4a5cb1ff6cb57c77dc8 2023-09-15 23:01:15,528 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for d38939590183e4a5cb1ff6cb57c77dc8 2023-09-15 23:01:15,530 INFO [StoreOpener-d38939590183e4a5cb1ff6cb57c77dc8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family l of region d38939590183e4a5cb1ff6cb57c77dc8 2023-09-15 23:01:15,533 DEBUG [StoreOpener-d38939590183e4a5cb1ff6cb57c77dc8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/hbase/acl/d38939590183e4a5cb1ff6cb57c77dc8/l 2023-09-15 23:01:15,533 DEBUG [StoreOpener-d38939590183e4a5cb1ff6cb57c77dc8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/hbase/acl/d38939590183e4a5cb1ff6cb57c77dc8/l 2023-09-15 23:01:15,534 INFO [StoreOpener-d38939590183e4a5cb1ff6cb57c77dc8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d38939590183e4a5cb1ff6cb57c77dc8 columnFamilyName l 2023-09-15 23:01:15,535 INFO [StoreOpener-d38939590183e4a5cb1ff6cb57c77dc8-1] regionserver.HStore(310): Store=d38939590183e4a5cb1ff6cb57c77dc8/l, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-15 23:01:15,537 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/hbase/acl/d38939590183e4a5cb1ff6cb57c77dc8 2023-09-15 23:01:15,539 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/hbase/acl/d38939590183e4a5cb1ff6cb57c77dc8 2023-09-15 23:01:15,544 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for d38939590183e4a5cb1ff6cb57c77dc8 2023-09-15 23:01:15,547 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/hbase/acl/d38939590183e4a5cb1ff6cb57c77dc8/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-15 23:01:15,548 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened d38939590183e4a5cb1ff6cb57c77dc8; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65998035, jitterRate=-0.016552641987800598}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-15 23:01:15,549 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for d38939590183e4a5cb1ff6cb57c77dc8: 2023-09-15 23:01:15,553 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:acl,,1694818875113.d38939590183e4a5cb1ff6cb57c77dc8., pid=11, masterSystemTime=1694818875520 2023-09-15 23:01:15,556 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:acl,,1694818875113.d38939590183e4a5cb1ff6cb57c77dc8. 2023-09-15 23:01:15,556 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:acl,,1694818875113.d38939590183e4a5cb1ff6cb57c77dc8. 2023-09-15 23:01:15,557 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=d38939590183e4a5cb1ff6cb57c77dc8, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:01:15,557 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:acl,,1694818875113.d38939590183e4a5cb1ff6cb57c77dc8.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1694818875556"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1694818875556"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1694818875556"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1694818875556"}]},"ts":"1694818875556"} 2023-09-15 23:01:15,564 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=11, resume processing ppid=10 2023-09-15 23:01:15,564 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure d38939590183e4a5cb1ff6cb57c77dc8, server=jenkins-hbase4.apache.org,41413,1694818872288 in 193 msec 2023-09-15 23:01:15,567 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=10, resume processing ppid=9 2023-09-15 23:01:15,568 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=hbase:acl, region=d38939590183e4a5cb1ff6cb57c77dc8, ASSIGN in 356 msec 2023-09-15 23:01:15,569 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-15 23:01:15,569 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694818875569"}]},"ts":"1694818875569"} 2023-09-15 23:01:15,572 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLED in hbase:meta 2023-09-15 23:01:15,576 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_POST_OPERATION 2023-09-15 23:01:15,579 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=9, state=SUCCESS; CreateTableProcedure table=hbase:acl in 459 msec 2023-09-15 23:01:15,739 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-09-15 23:01:15,740 INFO [master/jenkins-hbase4:0:becomeActiveMaster] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: hbase:acl, procId: 9 completed 2023-09-15 23:01:15,748 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-09-15 23:01:16,321 WARN [Thread-382] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-15 23:01:16,684 INFO [Thread-382] log.Slf4jLog(67): jetty-6.1.26 2023-09-15 23:01:16,691 INFO [Thread-382] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/jobhistory to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c5e9ebbf-ce0f-c6b3-3dce-6299f7b47f51/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_35849_jobhistory____.k7f24/webapp 2023-09-15 23:01:16,873 INFO [Thread-382] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices as a root resource class 2023-09-15 23:01:16,874 INFO [Thread-382] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver as a provider class 2023-09-15 23:01:16,874 INFO [Thread-382] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-09-15 23:01:16,878 INFO [Thread-382] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-09-15 23:01:16,968 INFO [Thread-382] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-15 23:01:17,305 INFO [Thread-382] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-15 23:01:17,683 INFO [Thread-382] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices to GuiceManagedComponentProvider with the scope "PerRequest" 2023-09-15 23:01:17,723 INFO [Thread-382] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:35849 2023-09-15 23:01:17,807 WARN [Listener at jenkins-hbase4.apache.org/46261] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-15 23:01:18,101 WARN [Listener at jenkins-hbase4.apache.org/46261] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-09-15 23:01:18,101 INFO [Listener at jenkins-hbase4.apache.org/46261] log.Slf4jLog(67): jetty-6.1.26 2023-09-15 23:01:18,108 INFO [Listener at jenkins-hbase4.apache.org/46261] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/cluster to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c5e9ebbf-ce0f-c6b3-3dce-6299f7b47f51/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_41667_cluster____.1j314m/webapp 2023-09-15 23:01:18,176 INFO [Listener at jenkins-hbase4.apache.org/46261] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver as a provider class 2023-09-15 23:01:18,177 INFO [Listener at jenkins-hbase4.apache.org/46261] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices as a root resource class 2023-09-15 23:01:18,177 INFO [Listener at jenkins-hbase4.apache.org/46261] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-09-15 23:01:18,177 INFO [Listener at jenkins-hbase4.apache.org/46261] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-09-15 23:01:18,185 INFO [Listener at jenkins-hbase4.apache.org/46261] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-15 23:01:18,377 INFO [Listener at jenkins-hbase4.apache.org/46261] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-15 23:01:18,505 INFO [Listener at jenkins-hbase4.apache.org/46261] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-15 23:01:18,519 INFO [Listener at jenkins-hbase4.apache.org/46261] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:41667 2023-09-15 23:01:18,981 WARN [Listener at jenkins-hbase4.apache.org/41841] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-15 23:01:19,007 WARN [Listener at jenkins-hbase4.apache.org/41841] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-09-15 23:01:19,007 INFO [Listener at jenkins-hbase4.apache.org/41841] log.Slf4jLog(67): jetty-6.1.26 2023-09-15 23:01:19,015 INFO [Listener at jenkins-hbase4.apache.org/41841] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c5e9ebbf-ce0f-c6b3-3dce-6299f7b47f51/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_44085_node____lzk2jv/webapp 2023-09-15 23:01:19,067 INFO [Listener at jenkins-hbase4.apache.org/41841] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-09-15 23:01:19,067 INFO [Listener at jenkins-hbase4.apache.org/41841] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-09-15 23:01:19,067 INFO [Listener at jenkins-hbase4.apache.org/41841] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-09-15 23:01:19,067 INFO [Listener at jenkins-hbase4.apache.org/41841] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-09-15 23:01:19,076 INFO [Listener at jenkins-hbase4.apache.org/41841] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-15 23:01:19,101 INFO [Listener at jenkins-hbase4.apache.org/41841] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-15 23:01:19,216 INFO [Listener at jenkins-hbase4.apache.org/41841] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-15 23:01:19,227 INFO [Listener at jenkins-hbase4.apache.org/41841] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:44085 2023-09-15 23:01:19,390 WARN [Listener at jenkins-hbase4.apache.org/46629] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-15 23:01:19,395 WARN [Listener at jenkins-hbase4.apache.org/46629] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-09-15 23:01:19,396 INFO [Listener at jenkins-hbase4.apache.org/46629] log.Slf4jLog(67): jetty-6.1.26 2023-09-15 23:01:19,402 INFO [Listener at jenkins-hbase4.apache.org/46629] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c5e9ebbf-ce0f-c6b3-3dce-6299f7b47f51/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_37323_node____ndfx1q/webapp 2023-09-15 23:01:19,453 INFO [Listener at jenkins-hbase4.apache.org/46629] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-09-15 23:01:19,453 INFO [Listener at jenkins-hbase4.apache.org/46629] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-09-15 23:01:19,453 INFO [Listener at jenkins-hbase4.apache.org/46629] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-09-15 23:01:19,453 INFO [Listener at jenkins-hbase4.apache.org/46629] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-09-15 23:01:19,461 INFO [Listener at jenkins-hbase4.apache.org/46629] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-15 23:01:19,480 INFO [Listener at jenkins-hbase4.apache.org/46629] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-15 23:01:19,537 INFO [Listener at jenkins-hbase4.apache.org/46629] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-15 23:01:19,542 INFO [Listener at jenkins-hbase4.apache.org/46629] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:37323 2023-09-15 23:01:19,571 INFO [Listener at jenkins-hbase4.apache.org/46629] hbase.HBaseTestingUtility(2726): Mini mapreduce cluster started 2023-09-15 23:01:19,573 INFO [Listener at jenkins-hbase4.apache.org/46629] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2023-09-15 23:01:19,632 INFO [Listener at jenkins-hbase4.apache.org/46629] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=706, OpenFileDescriptor=897, MaxFileDescriptor=60000, SystemLoadAverage=97, ProcessCount=164, AvailableMemoryMB=6265 2023-09-15 23:01:19,632 WARN [Listener at jenkins-hbase4.apache.org/46629] hbase.ResourceChecker(130): Thread=706 is superior to 500 2023-09-15 23:01:19,646 DEBUG [Listener at jenkins-hbase4.apache.org/46629] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-09-15 23:01:19,651 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56738, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-09-15 23:01:19,658 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-15 23:01:19,661 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] procedure2.ProcedureExecutor(1028): Stored pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportWithTargetName 2023-09-15 23:01:19,663 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_PRE_OPERATION 2023-09-15 23:01:19,664 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportWithTargetName" procId is: 12 2023-09-15 23:01:19,666 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-15 23:01:19,666 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-09-15 23:01:19,671 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.tmp/data/default/testtb-testExportWithTargetName/0544517e48855f0dc36cfaea5a8afb6b 2023-09-15 23:01:19,671 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.tmp/data/default/testtb-testExportWithTargetName/f01176c7d7d0a3756be00c34936673af 2023-09-15 23:01:19,673 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.tmp/data/default/testtb-testExportWithTargetName/f01176c7d7d0a3756be00c34936673af empty. 2023-09-15 23:01:19,674 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.tmp/data/default/testtb-testExportWithTargetName/0544517e48855f0dc36cfaea5a8afb6b empty. 2023-09-15 23:01:19,674 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.tmp/data/default/testtb-testExportWithTargetName/f01176c7d7d0a3756be00c34936673af 2023-09-15 23:01:19,676 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.tmp/data/default/testtb-testExportWithTargetName/0544517e48855f0dc36cfaea5a8afb6b 2023-09-15 23:01:19,676 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-09-15 23:01:19,686 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-15 23:01:19,726 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.tmp/data/default/testtb-testExportWithTargetName/.tabledesc/.tableinfo.0000000001 2023-09-15 23:01:19,727 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(7675): creating {ENCODED => 0544517e48855f0dc36cfaea5a8afb6b, NAME => 'testtb-testExportWithTargetName,,1694818879658.0544517e48855f0dc36cfaea5a8afb6b.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.tmp 2023-09-15 23:01:19,728 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(7675): creating {ENCODED => f01176c7d7d0a3756be00c34936673af, NAME => 'testtb-testExportWithTargetName,1,1694818879658.f01176c7d7d0a3756be00c34936673af.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.tmp 2023-09-15 23:01:19,773 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-09-15 23:01:19,774 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1694818879658.0544517e48855f0dc36cfaea5a8afb6b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-15 23:01:19,775 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1604): Closing 0544517e48855f0dc36cfaea5a8afb6b, disabling compactions & flushes 2023-09-15 23:01:19,778 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1694818879658.0544517e48855f0dc36cfaea5a8afb6b. 2023-09-15 23:01:19,778 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1694818879658.0544517e48855f0dc36cfaea5a8afb6b. 2023-09-15 23:01:19,778 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1694818879658.0544517e48855f0dc36cfaea5a8afb6b. after waiting 0 ms 2023-09-15 23:01:19,778 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1694818879658.0544517e48855f0dc36cfaea5a8afb6b. 2023-09-15 23:01:19,778 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1694818879658.0544517e48855f0dc36cfaea5a8afb6b. 2023-09-15 23:01:19,778 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1558): Region close journal for 0544517e48855f0dc36cfaea5a8afb6b: 2023-09-15 23:01:19,779 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1694818879658.f01176c7d7d0a3756be00c34936673af.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-15 23:01:19,779 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1604): Closing f01176c7d7d0a3756be00c34936673af, disabling compactions & flushes 2023-09-15 23:01:19,779 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1694818879658.f01176c7d7d0a3756be00c34936673af. 2023-09-15 23:01:19,779 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1694818879658.f01176c7d7d0a3756be00c34936673af. 2023-09-15 23:01:19,779 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1694818879658.f01176c7d7d0a3756be00c34936673af. after waiting 0 ms 2023-09-15 23:01:19,779 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1694818879658.f01176c7d7d0a3756be00c34936673af. 2023-09-15 23:01:19,779 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1694818879658.f01176c7d7d0a3756be00c34936673af. 2023-09-15 23:01:19,779 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1558): Region close journal for f01176c7d7d0a3756be00c34936673af: 2023-09-15 23:01:19,785 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ADD_TO_META 2023-09-15 23:01:19,792 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1694818879658.0544517e48855f0dc36cfaea5a8afb6b.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1694818879789"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694818879789"}]},"ts":"1694818879789"} 2023-09-15 23:01:19,792 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1694818879658.f01176c7d7d0a3756be00c34936673af.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1694818879789"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694818879789"}]},"ts":"1694818879789"} 2023-09-15 23:01:19,853 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-15 23:01:19,854 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-15 23:01:19,855 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694818879855"}]},"ts":"1694818879855"} 2023-09-15 23:01:19,857 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLING in hbase:meta 2023-09-15 23:01:19,862 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-15 23:01:19,864 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-15 23:01:19,864 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-15 23:01:19,864 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-15 23:01:19,864 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-15 23:01:19,864 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=0544517e48855f0dc36cfaea5a8afb6b, ASSIGN}, {pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=f01176c7d7d0a3756be00c34936673af, ASSIGN}] 2023-09-15 23:01:19,867 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=f01176c7d7d0a3756be00c34936673af, ASSIGN 2023-09-15 23:01:19,867 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=0544517e48855f0dc36cfaea5a8afb6b, ASSIGN 2023-09-15 23:01:19,869 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=f01176c7d7d0a3756be00c34936673af, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41413,1694818872288; forceNewPlan=false, retain=false 2023-09-15 23:01:19,870 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=0544517e48855f0dc36cfaea5a8afb6b, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34705,1694818872254; forceNewPlan=false, retain=false 2023-09-15 23:01:19,878 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-09-15 23:01:19,880 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-09-15 23:01:19,881 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:acl' 2023-09-15 23:01:19,977 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-09-15 23:01:20,019 INFO [jenkins-hbase4:44427] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-15 23:01:20,021 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=0544517e48855f0dc36cfaea5a8afb6b, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:01:20,021 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=f01176c7d7d0a3756be00c34936673af, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:01:20,022 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1694818879658.0544517e48855f0dc36cfaea5a8afb6b.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1694818880021"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694818880021"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694818880021"}]},"ts":"1694818880021"} 2023-09-15 23:01:20,022 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1694818879658.f01176c7d7d0a3756be00c34936673af.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1694818880021"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694818880021"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694818880021"}]},"ts":"1694818880021"} 2023-09-15 23:01:20,025 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=15, ppid=13, state=RUNNABLE; OpenRegionProcedure 0544517e48855f0dc36cfaea5a8afb6b, server=jenkins-hbase4.apache.org,34705,1694818872254}] 2023-09-15 23:01:20,026 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=16, ppid=14, state=RUNNABLE; OpenRegionProcedure f01176c7d7d0a3756be00c34936673af, server=jenkins-hbase4.apache.org,41413,1694818872288}] 2023-09-15 23:01:20,184 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,,1694818879658.0544517e48855f0dc36cfaea5a8afb6b. 2023-09-15 23:01:20,185 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 0544517e48855f0dc36cfaea5a8afb6b, NAME => 'testtb-testExportWithTargetName,,1694818879658.0544517e48855f0dc36cfaea5a8afb6b.', STARTKEY => '', ENDKEY => '1'} 2023-09-15 23:01:20,185 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,,1694818879658.0544517e48855f0dc36cfaea5a8afb6b. service=AccessControlService 2023-09-15 23:01:20,185 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-15 23:01:20,185 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName 0544517e48855f0dc36cfaea5a8afb6b 2023-09-15 23:01:20,185 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1694818879658.0544517e48855f0dc36cfaea5a8afb6b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-15 23:01:20,185 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 0544517e48855f0dc36cfaea5a8afb6b 2023-09-15 23:01:20,185 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 0544517e48855f0dc36cfaea5a8afb6b 2023-09-15 23:01:20,185 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,1,1694818879658.f01176c7d7d0a3756be00c34936673af. 2023-09-15 23:01:20,186 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => f01176c7d7d0a3756be00c34936673af, NAME => 'testtb-testExportWithTargetName,1,1694818879658.f01176c7d7d0a3756be00c34936673af.', STARTKEY => '1', ENDKEY => ''} 2023-09-15 23:01:20,186 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,1,1694818879658.f01176c7d7d0a3756be00c34936673af. service=AccessControlService 2023-09-15 23:01:20,186 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-15 23:01:20,186 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName f01176c7d7d0a3756be00c34936673af 2023-09-15 23:01:20,187 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1694818879658.f01176c7d7d0a3756be00c34936673af.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-15 23:01:20,187 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for f01176c7d7d0a3756be00c34936673af 2023-09-15 23:01:20,187 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for f01176c7d7d0a3756be00c34936673af 2023-09-15 23:01:20,191 INFO [StoreOpener-0544517e48855f0dc36cfaea5a8afb6b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 0544517e48855f0dc36cfaea5a8afb6b 2023-09-15 23:01:20,193 INFO [StoreOpener-f01176c7d7d0a3756be00c34936673af-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region f01176c7d7d0a3756be00c34936673af 2023-09-15 23:01:20,194 DEBUG [StoreOpener-0544517e48855f0dc36cfaea5a8afb6b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/default/testtb-testExportWithTargetName/0544517e48855f0dc36cfaea5a8afb6b/cf 2023-09-15 23:01:20,194 DEBUG [StoreOpener-0544517e48855f0dc36cfaea5a8afb6b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/default/testtb-testExportWithTargetName/0544517e48855f0dc36cfaea5a8afb6b/cf 2023-09-15 23:01:20,195 DEBUG [StoreOpener-f01176c7d7d0a3756be00c34936673af-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/default/testtb-testExportWithTargetName/f01176c7d7d0a3756be00c34936673af/cf 2023-09-15 23:01:20,195 DEBUG [StoreOpener-f01176c7d7d0a3756be00c34936673af-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/default/testtb-testExportWithTargetName/f01176c7d7d0a3756be00c34936673af/cf 2023-09-15 23:01:20,198 INFO [StoreOpener-f01176c7d7d0a3756be00c34936673af-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f01176c7d7d0a3756be00c34936673af columnFamilyName cf 2023-09-15 23:01:20,198 INFO [StoreOpener-0544517e48855f0dc36cfaea5a8afb6b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0544517e48855f0dc36cfaea5a8afb6b columnFamilyName cf 2023-09-15 23:01:20,201 INFO [StoreOpener-0544517e48855f0dc36cfaea5a8afb6b-1] regionserver.HStore(310): Store=0544517e48855f0dc36cfaea5a8afb6b/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-15 23:01:20,201 INFO [StoreOpener-f01176c7d7d0a3756be00c34936673af-1] regionserver.HStore(310): Store=f01176c7d7d0a3756be00c34936673af/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-15 23:01:20,204 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/default/testtb-testExportWithTargetName/0544517e48855f0dc36cfaea5a8afb6b 2023-09-15 23:01:20,204 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/default/testtb-testExportWithTargetName/f01176c7d7d0a3756be00c34936673af 2023-09-15 23:01:20,205 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/default/testtb-testExportWithTargetName/0544517e48855f0dc36cfaea5a8afb6b 2023-09-15 23:01:20,205 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/default/testtb-testExportWithTargetName/f01176c7d7d0a3756be00c34936673af 2023-09-15 23:01:20,209 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 0544517e48855f0dc36cfaea5a8afb6b 2023-09-15 23:01:20,212 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for f01176c7d7d0a3756be00c34936673af 2023-09-15 23:01:20,222 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/default/testtb-testExportWithTargetName/0544517e48855f0dc36cfaea5a8afb6b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-15 23:01:20,222 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/default/testtb-testExportWithTargetName/f01176c7d7d0a3756be00c34936673af/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-15 23:01:20,223 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 0544517e48855f0dc36cfaea5a8afb6b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74504000, jitterRate=0.11019611358642578}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-15 23:01:20,223 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened f01176c7d7d0a3756be00c34936673af; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74330486, jitterRate=0.1076105535030365}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-15 23:01:20,223 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 0544517e48855f0dc36cfaea5a8afb6b: 2023-09-15 23:01:20,223 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for f01176c7d7d0a3756be00c34936673af: 2023-09-15 23:01:20,224 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,1,1694818879658.f01176c7d7d0a3756be00c34936673af., pid=16, masterSystemTime=1694818880180 2023-09-15 23:01:20,225 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,,1694818879658.0544517e48855f0dc36cfaea5a8afb6b., pid=15, masterSystemTime=1694818880177 2023-09-15 23:01:20,227 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,1,1694818879658.f01176c7d7d0a3756be00c34936673af. 2023-09-15 23:01:20,227 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,1,1694818879658.f01176c7d7d0a3756be00c34936673af. 2023-09-15 23:01:20,228 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=f01176c7d7d0a3756be00c34936673af, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:01:20,229 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,1,1694818879658.f01176c7d7d0a3756be00c34936673af.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1694818880228"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1694818880228"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1694818880228"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1694818880228"}]},"ts":"1694818880228"} 2023-09-15 23:01:20,229 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,,1694818879658.0544517e48855f0dc36cfaea5a8afb6b. 2023-09-15 23:01:20,229 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,,1694818879658.0544517e48855f0dc36cfaea5a8afb6b. 2023-09-15 23:01:20,230 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=0544517e48855f0dc36cfaea5a8afb6b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:01:20,231 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,,1694818879658.0544517e48855f0dc36cfaea5a8afb6b.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1694818880230"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1694818880230"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1694818880230"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1694818880230"}]},"ts":"1694818880230"} 2023-09-15 23:01:20,236 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=16, resume processing ppid=14 2023-09-15 23:01:20,236 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=16, ppid=14, state=SUCCESS; OpenRegionProcedure f01176c7d7d0a3756be00c34936673af, server=jenkins-hbase4.apache.org,41413,1694818872288 in 207 msec 2023-09-15 23:01:20,238 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=15, resume processing ppid=13 2023-09-15 23:01:20,240 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=15, ppid=13, state=SUCCESS; OpenRegionProcedure 0544517e48855f0dc36cfaea5a8afb6b, server=jenkins-hbase4.apache.org,34705,1694818872254 in 210 msec 2023-09-15 23:01:20,240 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=14, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=f01176c7d7d0a3756be00c34936673af, ASSIGN in 372 msec 2023-09-15 23:01:20,243 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=13, resume processing ppid=12 2023-09-15 23:01:20,243 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=13, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=0544517e48855f0dc36cfaea5a8afb6b, ASSIGN in 374 msec 2023-09-15 23:01:20,244 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-15 23:01:20,244 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694818880244"}]},"ts":"1694818880244"} 2023-09-15 23:01:20,246 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLED in hbase:meta 2023-09-15 23:01:20,249 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_POST_OPERATION 2023-09-15 23:01:20,254 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportWithTargetName jenkins: RWXCA 2023-09-15 23:01:20,271 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41413] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-09-15 23:01:20,279 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-09-15 23:01:20,304 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:33655-0x100b1d2daa90001, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-09-15 23:01:20,304 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:34705-0x100b1d2daa90002, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-09-15 23:01:20,304 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-09-15 23:01:20,304 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:41413-0x100b1d2daa90003, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-09-15 23:01:20,304 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-15 23:01:20,311 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-09-15 23:01:20,311 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-09-15 23:01:20,311 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-09-15 23:01:20,311 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-09-15 23:01:20,314 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=12, state=SUCCESS; CreateTableProcedure table=testtb-testExportWithTargetName in 652 msec 2023-09-15 23:01:20,780 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-09-15 23:01:20,781 INFO [Listener at jenkins-hbase4.apache.org/46629] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportWithTargetName, procId: 12 completed 2023-09-15 23:01:20,785 DEBUG [Listener at jenkins-hbase4.apache.org/46629] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-09-15 23:01:20,786 DEBUG [Listener at jenkins-hbase4.apache.org/46629] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1694818879658.0544517e48855f0dc36cfaea5a8afb6b. 2023-09-15 23:01:20,788 INFO [Listener at jenkins-hbase4.apache.org/46629] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-15 23:01:20,817 DEBUG [hconnection-0x3d72c724-shared-pool-4] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-15 23:01:20,820 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41906, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-15 23:01:20,841 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-15 23:01:20,841 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1694818880841 (current time:1694818880841). 2023-09-15 23:01:20,841 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-15 23:01:20,843 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] zookeeper.ReadOnlyZKClient(139): Connect 0x0514784f to 127.0.0.1:51149 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-15 23:01:20,849 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@10c63fdf, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-15 23:01:20,853 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-15 23:01:20,854 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51812, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-15 23:01:20,855 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0514784f to 127.0.0.1:51149 2023-09-15 23:01:20,855 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-15 23:01:20,858 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] zookeeper.ReadOnlyZKClient(139): Connect 0x1133855d to 127.0.0.1:51149 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-15 23:01:20,864 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4fbd9157, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-15 23:01:20,866 DEBUG [hconnection-0xce20c7c-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-15 23:01:20,868 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51814, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-15 23:01:20,874 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1133855d to 127.0.0.1:51149 2023-09-15 23:01:20,875 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-15 23:01:20,875 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-09-15 23:01:20,897 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-15 23:01:20,898 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-15 23:01:20,924 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] procedure2.ProcedureExecutor(1028): Stored pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-15 23:01:20,925 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-15 23:01:20,926 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=17, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1694819480926 2023-09-15 23:01:20,926 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-15 23:01:20,927 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-09-15 23:01:20,929 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=17, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-15 23:01:20,930 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-15 23:01:20,932 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=17, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 13 msec 2023-09-15 23:01:20,933 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-15 23:01:20,934 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1694819480934 2023-09-15 23:01:20,934 DEBUG [Listener at jenkins-hbase4.apache.org/46629] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-15 23:01:20,934 DEBUG [Listener at jenkins-hbase4.apache.org/46629] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-15 23:01:20,956 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportWithTargetName 2023-09-15 23:01:20,956 INFO [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportWithTargetName' 2023-09-15 23:01:20,956 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-15 23:01:20,957 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' 2023-09-15 23:01:20,957 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-09-15 23:01:20,957 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-15 23:01:20,958 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-15 23:01:20,964 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:34705-0x100b1d2daa90002, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 23:01:20,964 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:41413-0x100b1d2daa90003, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 23:01:20,964 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:01:20,964 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:33655-0x100b1d2daa90001, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 23:01:20,964 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 23:01:20,964 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 23:01:20,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 23:01:20,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 23:01:20,964 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 23:01:20,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 23:01:20,965 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:01:20,965 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:01:20,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-15 23:01:20,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-15 23:01:20,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-15 23:01:20,965 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:01:20,965 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-15 23:01:20,965 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34705-0x100b1d2daa90002, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-15 23:01:20,965 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41413-0x100b1d2daa90003, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-15 23:01:20,966 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33655-0x100b1d2daa90001, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-15 23:01:20,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-09-15 23:01:20,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-09-15 23:01:20,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-15 23:01:20,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-09-15 23:01:20,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-15 23:01:20,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-15 23:01:20,967 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-15 23:01:20,967 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-15 23:01:20,967 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-15 23:01:20,970 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-09-15 23:01:20,970 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-09-15 23:01:20,970 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-09-15 23:01:20,973 DEBUG [member: 'jenkins-hbase4.apache.org,33655,1694818872204' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-15 23:01:20,973 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-15 23:01:20,973 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-15 23:01:20,973 DEBUG [member: 'jenkins-hbase4.apache.org,33655,1694818872204' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-15 23:01:20,973 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-15 23:01:20,974 DEBUG [member: 'jenkins-hbase4.apache.org,33655,1694818872204' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-15 23:01:20,975 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-15 23:01:20,975 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-09-15 23:01:20,973 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-15 23:01:20,975 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41413,1694818872288' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-09-15 23:01:20,975 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-15 23:01:20,975 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-09-15 23:01:20,975 DEBUG [member: 'jenkins-hbase4.apache.org,33655,1694818872204' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-09-15 23:01:20,975 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34705,1694818872254' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-09-15 23:01:20,976 DEBUG [member: 'jenkins-hbase4.apache.org,33655,1694818872204' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33655,1694818872204' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-09-15 23:01:20,978 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:01:20,978 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-15 23:01:20,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:01:20,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-15 23:01:20,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-15 23:01:20,979 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:01:20,979 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41413-0x100b1d2daa90003, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-15 23:01:20,979 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-15 23:01:20,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-15 23:01:20,979 DEBUG [member: 'jenkins-hbase4.apache.org,33655,1694818872204' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-15 23:01:20,979 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-15 23:01:20,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-15 23:01:20,979 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34705-0x100b1d2daa90002, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-15 23:01:20,979 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-15 23:01:20,979 DEBUG [member: 'jenkins-hbase4.apache.org,33655,1694818872204' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33655-0x100b1d2daa90001, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-15 23:01:20,979 DEBUG [member: 'jenkins-hbase4.apache.org,33655,1694818872204' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-15 23:01:20,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-15 23:01:20,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:01:20,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:01:20,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33655,1694818872204 2023-09-15 23:01:20,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-15 23:01:20,981 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41413,1694818872288' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-09-15 23:01:20,981 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1d4fe9d9[Count = 1] remaining members to acquire global barrier 2023-09-15 23:01:20,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:01:20,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-15 23:01:20,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-15 23:01:20,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-15 23:01:20,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-15 23:01:20,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-15 23:01:20,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:01:20,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:01:20,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33655,1694818872204 2023-09-15 23:01:20,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-15 23:01:20,985 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34705,1694818872254' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-09-15 23:01:20,985 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1d4fe9d9[Count = 0] remaining members to acquire global barrier 2023-09-15 23:01:20,985 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-09-15 23:01:20,985 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-15 23:01:20,987 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:34705-0x100b1d2daa90002, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-15 23:01:20,987 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:33655-0x100b1d2daa90001, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-15 23:01:20,987 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-15 23:01:20,987 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-15 23:01:20,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-15 23:01:20,987 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:41413-0x100b1d2daa90003, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-15 23:01:20,987 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-15 23:01:20,987 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-15 23:01:20,987 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:01:20,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-15 23:01:20,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-15 23:01:20,987 DEBUG [member: 'jenkins-hbase4.apache.org,33655,1694818872204' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-15 23:01:20,987 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-15 23:01:20,987 DEBUG [member: 'jenkins-hbase4.apache.org,33655,1694818872204' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-09-15 23:01:20,988 DEBUG [member: 'jenkins-hbase4.apache.org,33655,1694818872204' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,33655,1694818872204' in zk 2023-09-15 23:01:20,988 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:01:20,988 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-15 23:01:20,988 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-15 23:01:20,988 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-15 23:01:20,988 DEBUG [rs(jenkins-hbase4.apache.org,34705,1694818872254)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1694818879658.0544517e48855f0dc36cfaea5a8afb6b. 2023-09-15 23:01:20,988 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-15 23:01:20,988 DEBUG [rs(jenkins-hbase4.apache.org,41413,1694818872288)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1694818879658.f01176c7d7d0a3756be00c34936673af. 2023-09-15 23:01:20,988 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-15 23:01:20,989 DEBUG [rs(jenkins-hbase4.apache.org,34705,1694818872254)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1694818879658.0544517e48855f0dc36cfaea5a8afb6b. started... 2023-09-15 23:01:20,989 DEBUG [rs(jenkins-hbase4.apache.org,41413,1694818872288)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1694818879658.f01176c7d7d0a3756be00c34936673af. started... 2023-09-15 23:01:20,991 DEBUG [member: 'jenkins-hbase4.apache.org,33655,1694818872204' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-09-15 23:01:20,991 DEBUG [member: 'jenkins-hbase4.apache.org,33655,1694818872204' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-15 23:01:20,991 DEBUG [member: 'jenkins-hbase4.apache.org,33655,1694818872204' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-09-15 23:01:20,993 DEBUG [rs(jenkins-hbase4.apache.org,34705,1694818872254)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 0544517e48855f0dc36cfaea5a8afb6b: 2023-09-15 23:01:20,993 DEBUG [rs(jenkins-hbase4.apache.org,41413,1694818872288)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for f01176c7d7d0a3756be00c34936673af: 2023-09-15 23:01:20,994 DEBUG [rs(jenkins-hbase4.apache.org,34705,1694818872254)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1694818879658.0544517e48855f0dc36cfaea5a8afb6b.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-09-15 23:01:20,994 DEBUG [rs(jenkins-hbase4.apache.org,41413,1694818872288)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1694818879658.f01176c7d7d0a3756be00c34936673af.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-09-15 23:01:20,999 DEBUG [rs(jenkins-hbase4.apache.org,34705,1694818872254)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-15 23:01:20,999 DEBUG [rs(jenkins-hbase4.apache.org,41413,1694818872288)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-15 23:01:21,003 DEBUG [rs(jenkins-hbase4.apache.org,34705,1694818872254)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-15 23:01:21,003 DEBUG [rs(jenkins-hbase4.apache.org,41413,1694818872288)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-15 23:01:21,035 DEBUG [Listener at jenkins-hbase4.apache.org/46629] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-15 23:01:21,038 DEBUG [rs(jenkins-hbase4.apache.org,41413,1694818872288)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1694818879658.f01176c7d7d0a3756be00c34936673af. completed. 2023-09-15 23:01:21,038 DEBUG [rs(jenkins-hbase4.apache.org,41413,1694818872288)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1694818879658.f01176c7d7d0a3756be00c34936673af. 2023-09-15 23:01:21,039 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-15 23:01:21,039 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-15 23:01:21,039 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-15 23:01:21,039 DEBUG [rs(jenkins-hbase4.apache.org,34705,1694818872254)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1694818879658.0544517e48855f0dc36cfaea5a8afb6b. completed. 2023-09-15 23:01:21,039 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:01:21,039 DEBUG [rs(jenkins-hbase4.apache.org,34705,1694818872254)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1694818879658.0544517e48855f0dc36cfaea5a8afb6b. 2023-09-15 23:01:21,039 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-09-15 23:01:21,039 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,41413,1694818872288' in zk 2023-09-15 23:01:21,039 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-15 23:01:21,039 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-15 23:01:21,039 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:01:21,039 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-09-15 23:01:21,040 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,34705,1694818872254' in zk 2023-09-15 23:01:21,041 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-09-15 23:01:21,041 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-09-15 23:01:21,041 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:01:21,041 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-15 23:01:21,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:01:21,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-15 23:01:21,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-15 23:01:21,041 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-09-15 23:01:21,042 DEBUG [Listener at jenkins-hbase4.apache.org/46629] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-15 23:01:21,043 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:01:21,043 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-09-15 23:01:21,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-15 23:01:21,043 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-15 23:01:21,043 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-09-15 23:01:21,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-15 23:01:21,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-15 23:01:21,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:01:21,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:01:21,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33655,1694818872204 2023-09-15 23:01:21,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-15 23:01:21,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-15 23:01:21,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:01:21,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:01:21,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33655,1694818872204 2023-09-15 23:01:21,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,41413,1694818872288': 2023-09-15 23:01:21,048 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41413,1694818872288' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-09-15 23:01:21,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:01:21,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-15 23:01:21,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-15 23:01:21,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-15 23:01:21,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-15 23:01:21,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-15 23:01:21,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:01:21,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:01:21,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33655,1694818872204 2023-09-15 23:01:21,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-15 23:01:21,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-15 23:01:21,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:01:21,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:01:21,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33655,1694818872204 2023-09-15 23:01:21,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,34705,1694818872254': 2023-09-15 23:01:21,052 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34705,1694818872254' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-09-15 23:01:21,052 INFO [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportWithTargetName' execution completed 2023-09-15 23:01:21,053 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-15 23:01:21,053 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-15 23:01:21,053 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportWithTargetName 2023-09-15 23:01:21,053 INFO [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-15 23:01:21,055 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:33655-0x100b1d2daa90001, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-15 23:01:21,055 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-15 23:01:21,055 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:34705-0x100b1d2daa90002, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-15 23:01:21,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-15 23:01:21,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-15 23:01:21,056 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:33655-0x100b1d2daa90001, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 23:01:21,056 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:41413-0x100b1d2daa90003, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-15 23:01:21,056 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-15 23:01:21,056 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:34705-0x100b1d2daa90002, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 23:01:21,055 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-15 23:01:21,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-15 23:01:21,056 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-15 23:01:21,056 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:41413-0x100b1d2daa90003, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 23:01:21,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-15 23:01:21,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-15 23:01:21,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-15 23:01:21,056 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 23:01:21,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 23:01:21,057 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:01:21,057 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 23:01:21,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 23:01:21,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-15 23:01:21,057 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 23:01:21,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 23:01:21,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-15 23:01:21,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-15 23:01:21,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-15 23:01:21,057 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:01:21,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-15 23:01:21,060 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33655,1694818872204 2023-09-15 23:01:21,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-15 23:01:21,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-15 23:01:21,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:01:21,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:01:21,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33655,1694818872204 2023-09-15 23:01:21,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-15 23:01:21,062 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:01:21,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-15 23:01:21,062 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:01:21,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:01:21,062 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33655,1694818872204 2023-09-15 23:01:21,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:01:21,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33655,1694818872204 2023-09-15 23:01:21,075 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:33655-0x100b1d2daa90001, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 23:01:21,075 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:41413-0x100b1d2daa90003, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 23:01:21,075 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 23:01:21,076 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:41413-0x100b1d2daa90003, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 23:01:21,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 23:01:21,076 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 23:01:21,076 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33655,1694818872204 2023-09-15 23:01:21,076 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-15 23:01:21,076 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-15 23:01:21,075 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:34705-0x100b1d2daa90002, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 23:01:21,076 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportWithTargetName 2023-09-15 23:01:21,076 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:01:21,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 23:01:21,076 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:33655-0x100b1d2daa90001, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 23:01:21,077 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:01:21,077 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 23:01:21,077 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-09-15 23:01:21,077 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 23:01:21,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 23:01:21,077 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-09-15 23:01:21,077 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:34705-0x100b1d2daa90002, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 23:01:21,077 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-15 23:01:21,077 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 23:01:21,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 23:01:21,078 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 23:01:21,077 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-15 23:01:21,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 23:01:21,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 23:01:21,078 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33655,1694818872204 2023-09-15 23:01:21,078 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-15 23:01:21,078 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:01:21,078 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:01:21,078 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-15 23:01:21,078 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-15 23:01:21,079 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-15 23:01:21,098 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportWithTargetName 2023-09-15 23:01:21,100 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-09-15 23:01:21,150 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName to hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.hbase-snapshot/emptySnaptb0-testExportWithTargetName 2023-09-15 23:01:21,151 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-09-15 23:01:21,151 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-09-15 23:01:21,152 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-09-15 23:01:21,152 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1694818880927Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1694818881098 (+171 ms)Consolidate snapshot: emptySnaptb0-testExportWithTargetName at 1694818881098Loading Region manifests for emptySnaptb0-testExportWithTargetName at 1694818881098Writing data manifest for emptySnaptb0-testExportWithTargetName at 1694818881115 (+17 ms)Verifying snapshot: emptySnaptb0-testExportWithTargetName at 1694818881138 (+23 ms)Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1694818881151 (+13 ms) 2023-09-15 23:01:21,154 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-15 23:01:21,156 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 226 msec 2023-09-15 23:01:21,176 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-09-15 23:01:21,180 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionServerObservers 2023-09-15 23:01:21,180 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-09-15 23:01:21,180 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase MasterObservers 2023-09-15 23:01:21,181 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-09-15 23:01:21,181 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver Metrics about HBase MasterObservers 2023-09-15 23:01:21,181 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-09-15 23:01:21,181 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionObservers 2023-09-15 23:01:21,181 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-09-15 23:01:21,181 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-09-15 23:01:21,243 DEBUG [Listener at jenkins-hbase4.apache.org/46629] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-15 23:01:21,245 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-15 23:01:21,245 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-15 23:01:21,258 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34705] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,,1694818879658.0544517e48855f0dc36cfaea5a8afb6b. with WAL disabled. Data may be lost in the event of a crash. 2023-09-15 23:01:21,260 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41413] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,1,1694818879658.f01176c7d7d0a3756be00c34936673af. with WAL disabled. Data may be lost in the event of a crash. 2023-09-15 23:01:21,265 DEBUG [Listener at jenkins-hbase4.apache.org/46629] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-09-15 23:01:21,265 DEBUG [Listener at jenkins-hbase4.apache.org/46629] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1694818879658.0544517e48855f0dc36cfaea5a8afb6b. 2023-09-15 23:01:21,265 INFO [Listener at jenkins-hbase4.apache.org/46629] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-15 23:01:21,281 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-15 23:01:21,281 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1694818881281 (current time:1694818881281). 2023-09-15 23:01:21,281 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-15 23:01:21,282 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] zookeeper.ReadOnlyZKClient(139): Connect 0x588144e5 to 127.0.0.1:51149 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-15 23:01:21,288 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3344727a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-15 23:01:21,290 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-15 23:01:21,292 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51816, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-15 23:01:21,294 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x588144e5 to 127.0.0.1:51149 2023-09-15 23:01:21,294 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-15 23:01:21,295 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] zookeeper.ReadOnlyZKClient(139): Connect 0x6582a0fe to 127.0.0.1:51149 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-15 23:01:21,300 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@37f666c7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-15 23:01:21,302 DEBUG [hconnection-0x27b105e1-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-15 23:01:21,302 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51822, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-15 23:01:21,307 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6582a0fe to 127.0.0.1:51149 2023-09-15 23:01:21,307 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-15 23:01:21,307 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-09-15 23:01:21,308 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-15 23:01:21,309 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-15 23:01:21,312 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] procedure2.ProcedureExecutor(1028): Stored pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-15 23:01:21,313 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-15 23:01:21,314 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=19, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1694819481314 2023-09-15 23:01:21,314 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-09-15 23:01:21,314 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-15 23:01:21,316 DEBUG [Listener at jenkins-hbase4.apache.org/46629] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-15 23:01:21,316 DEBUG [Listener at jenkins-hbase4.apache.org/46629] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-15 23:01:21,316 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-15 23:01:21,317 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=19, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-15 23:01:21,319 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=19, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 6 msec 2023-09-15 23:01:21,320 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-15 23:01:21,320 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=20, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1694819481320 2023-09-15 23:01:21,338 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportWithTargetName 2023-09-15 23:01:21,338 INFO [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportWithTargetName' 2023-09-15 23:01:21,338 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-15 23:01:21,339 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportWithTargetName' starting 'acquire' 2023-09-15 23:01:21,339 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-09-15 23:01:21,340 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-15 23:01:21,340 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-15 23:01:21,341 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:34705-0x100b1d2daa90002, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 23:01:21,341 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:01:21,341 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 23:01:21,341 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:41413-0x100b1d2daa90003, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 23:01:21,341 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:33655-0x100b1d2daa90001, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 23:01:21,341 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 23:01:21,341 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 23:01:21,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 23:01:21,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 23:01:21,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 23:01:21,342 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:01:21,342 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:01:21,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-15 23:01:21,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-15 23:01:21,342 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:01:21,342 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-15 23:01:21,342 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34705-0x100b1d2daa90002, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-15 23:01:21,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-15 23:01:21,343 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33655-0x100b1d2daa90001, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-15 23:01:21,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-09-15 23:01:21,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-15 23:01:21,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-09-15 23:01:21,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-15 23:01:21,343 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-15 23:01:21,343 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41413-0x100b1d2daa90003, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-15 23:01:21,343 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-15 23:01:21,343 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-09-15 23:01:21,343 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-15 23:01:21,343 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-15 23:01:21,344 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-15 23:01:21,344 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-09-15 23:01:21,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-09-15 23:01:21,344 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-09-15 23:01:21,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-15 23:01:21,344 DEBUG [member: 'jenkins-hbase4.apache.org,33655,1694818872204' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-15 23:01:21,345 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34705,1694818872254' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-09-15 23:01:21,345 DEBUG [member: 'jenkins-hbase4.apache.org,33655,1694818872204' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-15 23:01:21,345 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-15 23:01:21,345 DEBUG [member: 'jenkins-hbase4.apache.org,33655,1694818872204' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-15 23:01:21,346 DEBUG [member: 'jenkins-hbase4.apache.org,33655,1694818872204' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-09-15 23:01:21,346 DEBUG [member: 'jenkins-hbase4.apache.org,33655,1694818872204' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33655,1694818872204' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-09-15 23:01:21,346 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-09-15 23:01:21,346 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-15 23:01:21,347 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-15 23:01:21,347 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-15 23:01:21,347 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-09-15 23:01:21,348 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41413,1694818872288' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-09-15 23:01:21,348 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:01:21,348 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-15 23:01:21,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:01:21,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-15 23:01:21,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-15 23:01:21,349 DEBUG [member: 'jenkins-hbase4.apache.org,33655,1694818872204' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-15 23:01:21,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-15 23:01:21,350 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34705-0x100b1d2daa90002, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-15 23:01:21,350 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-15 23:01:21,352 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:01:21,352 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-15 23:01:21,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-15 23:01:21,352 DEBUG [member: 'jenkins-hbase4.apache.org,33655,1694818872204' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33655-0x100b1d2daa90001, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-15 23:01:21,352 DEBUG [member: 'jenkins-hbase4.apache.org,33655,1694818872204' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-15 23:01:21,352 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41413-0x100b1d2daa90003, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-15 23:01:21,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-15 23:01:21,352 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-15 23:01:21,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:01:21,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:01:21,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33655,1694818872204 2023-09-15 23:01:21,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-15 23:01:21,354 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34705,1694818872254' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-09-15 23:01:21,354 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4ecf0c81[Count = 1] remaining members to acquire global barrier 2023-09-15 23:01:21,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:01:21,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-15 23:01:21,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-15 23:01:21,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-15 23:01:21,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-15 23:01:21,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-15 23:01:21,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:01:21,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:01:21,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33655,1694818872204 2023-09-15 23:01:21,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-15 23:01:21,357 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41413,1694818872288' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-09-15 23:01:21,357 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4ecf0c81[Count = 0] remaining members to acquire global barrier 2023-09-15 23:01:21,357 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-09-15 23:01:21,357 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-15 23:01:21,367 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:34705-0x100b1d2daa90002, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-15 23:01:21,367 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:33655-0x100b1d2daa90001, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-15 23:01:21,368 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-15 23:01:21,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-15 23:01:21,367 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:41413-0x100b1d2daa90003, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-15 23:01:21,368 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-15 23:01:21,368 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:01:21,368 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-15 23:01:21,368 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-15 23:01:21,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-15 23:01:21,368 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-15 23:01:21,368 DEBUG [rs(jenkins-hbase4.apache.org,34705,1694818872254)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1694818879658.0544517e48855f0dc36cfaea5a8afb6b. 2023-09-15 23:01:21,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-15 23:01:21,368 DEBUG [rs(jenkins-hbase4.apache.org,34705,1694818872254)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1694818879658.0544517e48855f0dc36cfaea5a8afb6b. started... 2023-09-15 23:01:21,368 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:01:21,368 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-15 23:01:21,368 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-15 23:01:21,368 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-15 23:01:21,368 DEBUG [member: 'jenkins-hbase4.apache.org,33655,1694818872204' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-15 23:01:21,368 INFO [rs(jenkins-hbase4.apache.org,34705,1694818872254)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 0544517e48855f0dc36cfaea5a8afb6b 1/1 column families, dataSize=199 B heapSize=688 B 2023-09-15 23:01:21,369 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-15 23:01:21,369 DEBUG [rs(jenkins-hbase4.apache.org,41413,1694818872288)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1694818879658.f01176c7d7d0a3756be00c34936673af. 2023-09-15 23:01:21,368 DEBUG [member: 'jenkins-hbase4.apache.org,33655,1694818872204' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-09-15 23:01:21,369 DEBUG [rs(jenkins-hbase4.apache.org,41413,1694818872288)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1694818879658.f01176c7d7d0a3756be00c34936673af. started... 2023-09-15 23:01:21,369 DEBUG [member: 'jenkins-hbase4.apache.org,33655,1694818872204' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,33655,1694818872204' in zk 2023-09-15 23:01:21,369 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-15 23:01:21,369 INFO [rs(jenkins-hbase4.apache.org,41413,1694818872288)-snapshot-pool-0] regionserver.HRegion(2745): Flushing f01176c7d7d0a3756be00c34936673af 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-09-15 23:01:21,372 DEBUG [member: 'jenkins-hbase4.apache.org,33655,1694818872204' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-09-15 23:01:21,372 DEBUG [member: 'jenkins-hbase4.apache.org,33655,1694818872204' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-15 23:01:21,372 DEBUG [member: 'jenkins-hbase4.apache.org,33655,1694818872204' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-09-15 23:01:21,416 DEBUG [Listener at jenkins-hbase4.apache.org/46629] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-15 23:01:21,417 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-15 23:01:21,417 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-09-15 23:01:21,418 DEBUG [Listener at jenkins-hbase4.apache.org/46629] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-15 23:01:21,509 INFO [rs(jenkins-hbase4.apache.org,41413,1694818872288)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230915c988a78751d744f7906694294954a88c to hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230915c988a78751d744f7906694294954a88c 2023-09-15 23:01:21,540 INFO [rs(jenkins-hbase4.apache.org,41413,1694818872288)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/default/testtb-testExportWithTargetName/f01176c7d7d0a3756be00c34936673af/.tmp/cf/37d09b3bf44d4ee98754e422be703d3c 2023-09-15 23:01:21,550 DEBUG [rs(jenkins-hbase4.apache.org,41413,1694818872288)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/default/testtb-testExportWithTargetName/f01176c7d7d0a3756be00c34936673af/.tmp/cf/37d09b3bf44d4ee98754e422be703d3c as hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/default/testtb-testExportWithTargetName/f01176c7d7d0a3756be00c34936673af/cf/37d09b3bf44d4ee98754e422be703d3c 2023-09-15 23:01:21,559 INFO [rs(jenkins-hbase4.apache.org,41413,1694818872288)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/default/testtb-testExportWithTargetName/f01176c7d7d0a3756be00c34936673af/cf/37d09b3bf44d4ee98754e422be703d3c, entries=47, sequenceid=6, filesize=12.8 K 2023-09-15 23:01:21,561 INFO [rs(jenkins-hbase4.apache.org,41413,1694818872288)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for f01176c7d7d0a3756be00c34936673af in 192ms, sequenceid=6, compaction requested=false 2023-09-15 23:01:21,562 DEBUG [rs(jenkins-hbase4.apache.org,41413,1694818872288)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-09-15 23:01:21,562 DEBUG [rs(jenkins-hbase4.apache.org,41413,1694818872288)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for f01176c7d7d0a3756be00c34936673af: 2023-09-15 23:01:21,563 DEBUG [rs(jenkins-hbase4.apache.org,41413,1694818872288)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1694818879658.f01176c7d7d0a3756be00c34936673af.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-09-15 23:01:21,563 DEBUG [rs(jenkins-hbase4.apache.org,41413,1694818872288)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-15 23:01:21,563 DEBUG [rs(jenkins-hbase4.apache.org,41413,1694818872288)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/default/testtb-testExportWithTargetName/f01176c7d7d0a3756be00c34936673af/cf/37d09b3bf44d4ee98754e422be703d3c] hfiles 2023-09-15 23:01:21,563 DEBUG [rs(jenkins-hbase4.apache.org,41413,1694818872288)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/default/testtb-testExportWithTargetName/f01176c7d7d0a3756be00c34936673af/cf/37d09b3bf44d4ee98754e422be703d3c for snapshot=snaptb0-testExportWithTargetName 2023-09-15 23:01:21,580 DEBUG [rs(jenkins-hbase4.apache.org,41413,1694818872288)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1694818879658.f01176c7d7d0a3756be00c34936673af. completed. 2023-09-15 23:01:21,580 DEBUG [rs(jenkins-hbase4.apache.org,41413,1694818872288)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1694818879658.f01176c7d7d0a3756be00c34936673af. 2023-09-15 23:01:21,580 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-15 23:01:21,581 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-15 23:01:21,581 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:01:21,581 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-09-15 23:01:21,581 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,41413,1694818872288' in zk 2023-09-15 23:01:21,584 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-09-15 23:01:21,584 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:01:21,584 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-15 23:01:21,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:01:21,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-15 23:01:21,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-15 23:01:21,584 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-09-15 23:01:21,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-15 23:01:21,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-15 23:01:21,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-15 23:01:21,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:01:21,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:01:21,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33655,1694818872204 2023-09-15 23:01:21,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-15 23:01:21,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-15 23:01:21,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:01:21,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33655,1694818872204 2023-09-15 23:01:21,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,41413,1694818872288': 2023-09-15 23:01:21,590 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41413,1694818872288' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-09-15 23:01:21,618 DEBUG [Listener at jenkins-hbase4.apache.org/46629] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-15 23:01:21,619 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-15 23:01:21,619 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-09-15 23:01:21,620 DEBUG [Listener at jenkins-hbase4.apache.org/46629] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-09-15 23:01:21,870 INFO [rs(jenkins-hbase4.apache.org,34705,1694818872254)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230915ec8f69d276104b7abc0f745e7d028266 to hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230915ec8f69d276104b7abc0f745e7d028266 2023-09-15 23:01:21,885 INFO [rs(jenkins-hbase4.apache.org,34705,1694818872254)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=199, hasBloomFilter=true, into tmp file hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/default/testtb-testExportWithTargetName/0544517e48855f0dc36cfaea5a8afb6b/.tmp/cf/4ba26226e778416887f9393bb1a877f1 2023-09-15 23:01:21,893 DEBUG [rs(jenkins-hbase4.apache.org,34705,1694818872254)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/default/testtb-testExportWithTargetName/0544517e48855f0dc36cfaea5a8afb6b/.tmp/cf/4ba26226e778416887f9393bb1a877f1 as hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/default/testtb-testExportWithTargetName/0544517e48855f0dc36cfaea5a8afb6b/cf/4ba26226e778416887f9393bb1a877f1 2023-09-15 23:01:21,901 INFO [rs(jenkins-hbase4.apache.org,34705,1694818872254)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/default/testtb-testExportWithTargetName/0544517e48855f0dc36cfaea5a8afb6b/cf/4ba26226e778416887f9393bb1a877f1, entries=3, sequenceid=6, filesize=5.4 K 2023-09-15 23:01:21,903 INFO [rs(jenkins-hbase4.apache.org,34705,1694818872254)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for 0544517e48855f0dc36cfaea5a8afb6b in 535ms, sequenceid=6, compaction requested=false 2023-09-15 23:01:21,904 DEBUG [rs(jenkins-hbase4.apache.org,34705,1694818872254)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 0544517e48855f0dc36cfaea5a8afb6b: 2023-09-15 23:01:21,904 DEBUG [rs(jenkins-hbase4.apache.org,34705,1694818872254)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1694818879658.0544517e48855f0dc36cfaea5a8afb6b.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-09-15 23:01:21,904 DEBUG [rs(jenkins-hbase4.apache.org,34705,1694818872254)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-15 23:01:21,904 DEBUG [rs(jenkins-hbase4.apache.org,34705,1694818872254)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/default/testtb-testExportWithTargetName/0544517e48855f0dc36cfaea5a8afb6b/cf/4ba26226e778416887f9393bb1a877f1] hfiles 2023-09-15 23:01:21,904 DEBUG [rs(jenkins-hbase4.apache.org,34705,1694818872254)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/default/testtb-testExportWithTargetName/0544517e48855f0dc36cfaea5a8afb6b/cf/4ba26226e778416887f9393bb1a877f1 for snapshot=snaptb0-testExportWithTargetName 2023-09-15 23:01:21,920 DEBUG [rs(jenkins-hbase4.apache.org,34705,1694818872254)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1694818879658.0544517e48855f0dc36cfaea5a8afb6b. completed. 2023-09-15 23:01:21,920 DEBUG [Listener at jenkins-hbase4.apache.org/46629] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-15 23:01:21,920 DEBUG [rs(jenkins-hbase4.apache.org,34705,1694818872254)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1694818879658.0544517e48855f0dc36cfaea5a8afb6b. 2023-09-15 23:01:21,921 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-15 23:01:21,921 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-15 23:01:21,921 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:01:21,921 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-09-15 23:01:21,921 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,34705,1694818872254' in zk 2023-09-15 23:01:21,922 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-15 23:01:21,922 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-09-15 23:01:21,923 DEBUG [Listener at jenkins-hbase4.apache.org/46629] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-09-15 23:01:21,923 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:01:21,923 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-09-15 23:01:21,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:01:21,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-15 23:01:21,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-15 23:01:21,923 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-15 23:01:21,923 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-09-15 23:01:21,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-15 23:01:21,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-15 23:01:21,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-15 23:01:21,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:01:21,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:01:21,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33655,1694818872204 2023-09-15 23:01:21,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-15 23:01:21,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-15 23:01:21,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:01:21,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:01:21,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33655,1694818872204 2023-09-15 23:01:21,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,34705,1694818872254': 2023-09-15 23:01:21,929 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34705,1694818872254' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-09-15 23:01:21,929 INFO [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportWithTargetName' execution completed 2023-09-15 23:01:21,929 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-15 23:01:21,929 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-15 23:01:21,929 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportWithTargetName 2023-09-15 23:01:21,929 INFO [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-15 23:01:21,931 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:34705-0x100b1d2daa90002, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-15 23:01:21,931 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:41413-0x100b1d2daa90003, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-15 23:01:21,931 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-15 23:01:21,931 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-15 23:01:21,931 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:41413-0x100b1d2daa90003, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 23:01:21,931 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:34705-0x100b1d2daa90002, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 23:01:21,931 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-15 23:01:21,931 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:33655-0x100b1d2daa90001, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-15 23:01:21,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-15 23:01:21,932 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-15 23:01:21,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-15 23:01:21,931 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:33655-0x100b1d2daa90001, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 23:01:21,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-15 23:01:21,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-15 23:01:21,932 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:01:21,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-15 23:01:21,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-15 23:01:21,932 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 23:01:21,932 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 23:01:21,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 23:01:21,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-15 23:01:21,932 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:01:21,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 23:01:21,932 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 23:01:21,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 23:01:21,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-15 23:01:21,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-15 23:01:21,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-15 23:01:21,933 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33655,1694818872204 2023-09-15 23:01:21,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-15 23:01:21,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-15 23:01:21,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-15 23:01:21,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:01:21,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:01:21,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33655,1694818872204 2023-09-15 23:01:21,939 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:01:21,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-15 23:01:21,939 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:01:21,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-15 23:01:21,939 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33655,1694818872204 2023-09-15 23:01:21,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:01:21,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:01:21,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33655,1694818872204 2023-09-15 23:01:21,951 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33655,1694818872204 2023-09-15 23:01:21,951 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-15 23:01:21,951 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:33655-0x100b1d2daa90001, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 23:01:21,951 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:01:21,951 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:41413-0x100b1d2daa90003, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 23:01:21,951 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:33655-0x100b1d2daa90001, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 23:01:21,951 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 23:01:21,951 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-15 23:01:21,951 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:01:21,951 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:34705-0x100b1d2daa90002, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 23:01:21,951 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 23:01:21,952 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 23:01:21,952 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:34705-0x100b1d2daa90002, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 23:01:21,952 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-15 23:01:21,951 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportWithTargetName 2023-09-15 23:01:21,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 23:01:21,951 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:41413-0x100b1d2daa90003, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 23:01:21,952 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-09-15 23:01:21,952 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33655,1694818872204 2023-09-15 23:01:21,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 23:01:21,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 23:01:21,953 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportWithTargetName 2023-09-15 23:01:21,953 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-15 23:01:21,953 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 23:01:21,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 23:01:21,953 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-15 23:01:21,953 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 23:01:21,954 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 23:01:21,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 23:01:21,954 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:01:21,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 23:01:21,954 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:01:21,954 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-15 23:01:21,954 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-15 23:01:21,955 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230915c988a78751d744f7906694294954a88c, hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230915ec8f69d276104b7abc0f745e7d028266] mob files 2023-09-15 23:01:21,955 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230915c988a78751d744f7906694294954a88c 2023-09-15 23:01:21,955 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230915ec8f69d276104b7abc0f745e7d028266 2023-09-15 23:01:21,969 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportWithTargetName 2023-09-15 23:01:21,970 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-09-15 23:01:22,008 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName to hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-09-15 23:01:22,009 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-09-15 23:01:22,009 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-09-15 23:01:22,010 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-09-15 23:01:22,010 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1694818881315Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1694818881969 (+654 ms)Consolidate snapshot: snaptb0-testExportWithTargetName at 1694818881969Loading Region manifests for snaptb0-testExportWithTargetName at 1694818881969Writing data manifest for snaptb0-testExportWithTargetName at 1694818881974 (+5 ms)Verifying snapshot: snaptb0-testExportWithTargetName at 1694818881997 (+23 ms)Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1694818882009 (+12 ms) 2023-09-15 23:01:22,012 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=20, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-15 23:01:22,015 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=20, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 698 msec 2023-09-15 23:01:22,423 DEBUG [Listener at jenkins-hbase4.apache.org/46629] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-15 23:01:22,425 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-15 23:01:22,425 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-15 23:01:22,426 INFO [Listener at jenkins-hbase4.apache.org/46629] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/export-test/export-1694818882426 2023-09-15 23:01:22,427 INFO [Listener at jenkins-hbase4.apache.org/46629] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:44545, tgtDir=hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/export-test/export-1694818882426, rawTgtDir=hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/export-test/export-1694818882426, srcFsUri=hdfs://localhost:44545, srcDir=hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64 2023-09-15 23:01:22,467 DEBUG [Listener at jenkins-hbase4.apache.org/46629] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:44545, inputRoot=hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64 2023-09-15 23:01:22,467 DEBUG [Listener at jenkins-hbase4.apache.org/46629] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1138341878_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/export-test/export-1694818882426, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/export-test/export-1694818882426/.hbase-snapshot/.tmp/testExportWithTargetName 2023-09-15 23:01:22,467 INFO [Listener at jenkins-hbase4.apache.org/46629] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:44545, inputRoot=hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64, snapshotDir=hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.hbase-snapshot/snaptb0-testExportWithTargetName. 2023-09-15 23:01:22,490 INFO [Listener at jenkins-hbase4.apache.org/46629] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.hbase-snapshot/snaptb0-testExportWithTargetName to hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/export-test/export-1694818882426/.hbase-snapshot/.tmp/testExportWithTargetName 2023-09-15 23:01:22,556 DEBUG [Listener at jenkins-hbase4.apache.org/46629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-15 23:01:22,556 DEBUG [Listener at jenkins-hbase4.apache.org/46629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-15 23:01:22,557 DEBUG [Listener at jenkins-hbase4.apache.org/46629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-15 23:01:22,557 DEBUG [Listener at jenkins-hbase4.apache.org/46629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-15 23:01:23,508 DEBUG [Listener at jenkins-hbase4.apache.org/46629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c5e9ebbf-ce0f-c6b3-3dce-6299f7b47f51/hadoop-5405839942980423278.jar 2023-09-15 23:01:23,509 DEBUG [Listener at jenkins-hbase4.apache.org/46629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-15 23:01:23,509 DEBUG [Listener at jenkins-hbase4.apache.org/46629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-15 23:01:23,578 DEBUG [Listener at jenkins-hbase4.apache.org/46629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c5e9ebbf-ce0f-c6b3-3dce-6299f7b47f51/hadoop-3249042652741411105.jar 2023-09-15 23:01:23,578 DEBUG [Listener at jenkins-hbase4.apache.org/46629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-15 23:01:23,579 DEBUG [Listener at jenkins-hbase4.apache.org/46629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-15 23:01:23,579 DEBUG [Listener at jenkins-hbase4.apache.org/46629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-15 23:01:23,580 DEBUG [Listener at jenkins-hbase4.apache.org/46629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-15 23:01:23,580 DEBUG [Listener at jenkins-hbase4.apache.org/46629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-15 23:01:23,580 DEBUG [Listener at jenkins-hbase4.apache.org/46629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-15 23:01:23,581 DEBUG [Listener at jenkins-hbase4.apache.org/46629] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-15 23:01:23,581 DEBUG [Listener at jenkins-hbase4.apache.org/46629] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-15 23:01:23,582 DEBUG [Listener at jenkins-hbase4.apache.org/46629] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-15 23:01:23,582 DEBUG [Listener at jenkins-hbase4.apache.org/46629] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-15 23:01:23,583 DEBUG [Listener at jenkins-hbase4.apache.org/46629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-15 23:01:23,583 DEBUG [Listener at jenkins-hbase4.apache.org/46629] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-15 23:01:23,584 DEBUG [Listener at jenkins-hbase4.apache.org/46629] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-15 23:01:23,584 DEBUG [Listener at jenkins-hbase4.apache.org/46629] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-15 23:01:23,584 DEBUG [Listener at jenkins-hbase4.apache.org/46629] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-15 23:01:23,585 DEBUG [Listener at jenkins-hbase4.apache.org/46629] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-15 23:01:23,589 DEBUG [Listener at jenkins-hbase4.apache.org/46629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-15 23:01:23,589 DEBUG [Listener at jenkins-hbase4.apache.org/46629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-15 23:01:23,589 DEBUG [Listener at jenkins-hbase4.apache.org/46629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-15 23:01:23,590 DEBUG [Listener at jenkins-hbase4.apache.org/46629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-15 23:01:23,590 DEBUG [Listener at jenkins-hbase4.apache.org/46629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-15 23:01:23,590 DEBUG [Listener at jenkins-hbase4.apache.org/46629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-15 23:01:23,591 DEBUG [Listener at jenkins-hbase4.apache.org/46629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-15 23:01:24,388 WARN [Listener at jenkins-hbase4.apache.org/46629] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-15 23:01:24,393 INFO [Listener at jenkins-hbase4.apache.org/46629] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportWithTargetName' hfile list 2023-09-15 23:01:24,402 DEBUG [Listener at jenkins-hbase4.apache.org/46629] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-09-15 23:01:24,871 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-15 23:01:24,873 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-15 23:01:25,512 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694818878578_0001_000001 (auth:SIMPLE) 2023-09-15 23:01:25,691 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-15 23:01:29,868 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694818878578_0001_000001 (auth:SIMPLE) 2023-09-15 23:01:32,151 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694818878578_0001_000001 (auth:SIMPLE) 2023-09-15 23:01:34,778 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694818878578_0001_000001 (auth:SIMPLE) 2023-09-15 23:01:36,244 INFO [Listener at jenkins-hbase4.apache.org/46629] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-15 23:01:36,247 INFO [Listener at jenkins-hbase4.apache.org/46629] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-15 23:01:36,259 INFO [Listener at jenkins-hbase4.apache.org/46629] snapshot.ExportSnapshot(1127): Export Completed: testExportWithTargetName 2023-09-15 23:01:36,259 INFO [Listener at jenkins-hbase4.apache.org/46629] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-15 23:01:36,260 INFO [Listener at jenkins-hbase4.apache.org/46629] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-15 23:01:36,260 DEBUG [Listener at jenkins-hbase4.apache.org/46629] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1896422628_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.hbase-snapshot/snaptb0-testExportWithTargetName at hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-09-15 23:01:36,261 DEBUG [Listener at jenkins-hbase4.apache.org/46629] snapshot.TestExportSnapshot(367): hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.hbase-snapshot/snaptb0-testExportWithTargetName/.snapshotinfo 2023-09-15 23:01:36,261 DEBUG [Listener at jenkins-hbase4.apache.org/46629] snapshot.TestExportSnapshot(367): hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.hbase-snapshot/snaptb0-testExportWithTargetName/data.manifest 2023-09-15 23:01:36,261 DEBUG [Listener at jenkins-hbase4.apache.org/46629] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1896422628_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/export-test/export-1694818882426/.hbase-snapshot/testExportWithTargetName at hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/export-test/export-1694818882426/.hbase-snapshot/testExportWithTargetName 2023-09-15 23:01:36,262 DEBUG [Listener at jenkins-hbase4.apache.org/46629] snapshot.TestExportSnapshot(367): hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/export-test/export-1694818882426/.hbase-snapshot/testExportWithTargetName/.snapshotinfo 2023-09-15 23:01:36,262 DEBUG [Listener at jenkins-hbase4.apache.org/46629] snapshot.TestExportSnapshot(367): hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/export-test/export-1694818882426/.hbase-snapshot/testExportWithTargetName/data.manifest 2023-09-15 23:01:36,272 INFO [Listener at jenkins-hbase4.apache.org/46629] client.HBaseAdmin$15(890): Started disable of testtb-testExportWithTargetName 2023-09-15 23:01:36,277 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportWithTargetName 2023-09-15 23:01:36,285 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] procedure2.ProcedureExecutor(1028): Stored pid=21, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportWithTargetName 2023-09-15 23:01:36,290 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694818896290"}]},"ts":"1694818896290"} 2023-09-15 23:01:36,291 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-09-15 23:01:36,292 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLING in hbase:meta 2023-09-15 23:01:36,294 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testExportWithTargetName to state=DISABLING 2023-09-15 23:01:36,296 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=0544517e48855f0dc36cfaea5a8afb6b, UNASSIGN}, {pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=f01176c7d7d0a3756be00c34936673af, UNASSIGN}] 2023-09-15 23:01:36,299 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=0544517e48855f0dc36cfaea5a8afb6b, UNASSIGN 2023-09-15 23:01:36,299 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=f01176c7d7d0a3756be00c34936673af, UNASSIGN 2023-09-15 23:01:36,300 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=f01176c7d7d0a3756be00c34936673af, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:01:36,300 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=0544517e48855f0dc36cfaea5a8afb6b, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:01:36,300 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1694818879658.f01176c7d7d0a3756be00c34936673af.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1694818896300"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694818896300"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694818896300"}]},"ts":"1694818896300"} 2023-09-15 23:01:36,300 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1694818879658.0544517e48855f0dc36cfaea5a8afb6b.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1694818896300"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694818896300"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694818896300"}]},"ts":"1694818896300"} 2023-09-15 23:01:36,303 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=24, ppid=22, state=RUNNABLE; CloseRegionProcedure 0544517e48855f0dc36cfaea5a8afb6b, server=jenkins-hbase4.apache.org,34705,1694818872254}] 2023-09-15 23:01:36,303 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=25, ppid=23, state=RUNNABLE; CloseRegionProcedure f01176c7d7d0a3756be00c34936673af, server=jenkins-hbase4.apache.org,41413,1694818872288}] 2023-09-15 23:01:36,392 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-09-15 23:01:36,465 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 0544517e48855f0dc36cfaea5a8afb6b 2023-09-15 23:01:36,465 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close f01176c7d7d0a3756be00c34936673af 2023-09-15 23:01:36,465 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 0544517e48855f0dc36cfaea5a8afb6b, disabling compactions & flushes 2023-09-15 23:01:36,465 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing f01176c7d7d0a3756be00c34936673af, disabling compactions & flushes 2023-09-15 23:01:36,465 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1694818879658.0544517e48855f0dc36cfaea5a8afb6b. 2023-09-15 23:01:36,465 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1694818879658.f01176c7d7d0a3756be00c34936673af. 2023-09-15 23:01:36,465 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1694818879658.0544517e48855f0dc36cfaea5a8afb6b. 2023-09-15 23:01:36,465 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1694818879658.f01176c7d7d0a3756be00c34936673af. 2023-09-15 23:01:36,465 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1694818879658.0544517e48855f0dc36cfaea5a8afb6b. after waiting 0 ms 2023-09-15 23:01:36,465 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1694818879658.f01176c7d7d0a3756be00c34936673af. after waiting 0 ms 2023-09-15 23:01:36,466 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1694818879658.0544517e48855f0dc36cfaea5a8afb6b. 2023-09-15 23:01:36,466 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1694818879658.f01176c7d7d0a3756be00c34936673af. 2023-09-15 23:01:36,480 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/default/testtb-testExportWithTargetName/f01176c7d7d0a3756be00c34936673af/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-15 23:01:36,480 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/default/testtb-testExportWithTargetName/0544517e48855f0dc36cfaea5a8afb6b/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-15 23:01:36,481 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-15 23:01:36,481 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-15 23:01:36,482 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1694818879658.f01176c7d7d0a3756be00c34936673af. 2023-09-15 23:01:36,482 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1694818879658.0544517e48855f0dc36cfaea5a8afb6b. 2023-09-15 23:01:36,482 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for f01176c7d7d0a3756be00c34936673af: 2023-09-15 23:01:36,482 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 0544517e48855f0dc36cfaea5a8afb6b: 2023-09-15 23:01:36,484 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed f01176c7d7d0a3756be00c34936673af 2023-09-15 23:01:36,488 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=f01176c7d7d0a3756be00c34936673af, regionState=CLOSED 2023-09-15 23:01:36,488 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1694818879658.f01176c7d7d0a3756be00c34936673af.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1694818896488"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694818896488"}]},"ts":"1694818896488"} 2023-09-15 23:01:36,488 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 0544517e48855f0dc36cfaea5a8afb6b 2023-09-15 23:01:36,489 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=0544517e48855f0dc36cfaea5a8afb6b, regionState=CLOSED 2023-09-15 23:01:36,489 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1694818879658.0544517e48855f0dc36cfaea5a8afb6b.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1694818896489"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694818896489"}]},"ts":"1694818896489"} 2023-09-15 23:01:36,495 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=25, resume processing ppid=23 2023-09-15 23:01:36,495 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=25, ppid=23, state=SUCCESS; CloseRegionProcedure f01176c7d7d0a3756be00c34936673af, server=jenkins-hbase4.apache.org,41413,1694818872288 in 189 msec 2023-09-15 23:01:36,497 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=24, resume processing ppid=22 2023-09-15 23:01:36,497 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=23, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=f01176c7d7d0a3756be00c34936673af, UNASSIGN in 199 msec 2023-09-15 23:01:36,497 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=24, ppid=22, state=SUCCESS; CloseRegionProcedure 0544517e48855f0dc36cfaea5a8afb6b, server=jenkins-hbase4.apache.org,34705,1694818872254 in 192 msec 2023-09-15 23:01:36,499 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=22, resume processing ppid=21 2023-09-15 23:01:36,499 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=22, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=0544517e48855f0dc36cfaea5a8afb6b, UNASSIGN in 201 msec 2023-09-15 23:01:36,500 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694818896500"}]},"ts":"1694818896500"} 2023-09-15 23:01:36,502 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLED in hbase:meta 2023-09-15 23:01:36,503 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testExportWithTargetName to state=DISABLED 2023-09-15 23:01:36,506 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=21, state=SUCCESS; DisableTableProcedure table=testtb-testExportWithTargetName in 224 msec 2023-09-15 23:01:36,593 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-09-15 23:01:36,594 INFO [Listener at jenkins-hbase4.apache.org/46629] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportWithTargetName, procId: 21 completed 2023-09-15 23:01:36,599 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportWithTargetName 2023-09-15 23:01:36,605 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] procedure2.ProcedureExecutor(1028): Stored pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-15 23:01:36,609 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-15 23:01:36,610 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportWithTargetName 2023-09-15 23:01:36,611 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=26, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-15 23:01:36,615 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41413] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportWithTargetName 2023-09-15 23:01:36,617 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.tmp/data/default/testtb-testExportWithTargetName/0544517e48855f0dc36cfaea5a8afb6b 2023-09-15 23:01:36,617 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.tmp/data/default/testtb-testExportWithTargetName/f01176c7d7d0a3756be00c34936673af 2023-09-15 23:01:36,618 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:33655-0x100b1d2daa90001, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-15 23:01:36,619 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:34705-0x100b1d2daa90002, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-15 23:01:36,619 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-15 23:01:36,618 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:41413-0x100b1d2daa90003, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-15 23:01:36,620 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:41413-0x100b1d2daa90003, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-15 23:01:36,620 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:33655-0x100b1d2daa90001, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-15 23:01:36,620 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-15 23:01:36,620 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-09-15 23:01:36,621 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-09-15 23:01:36,621 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-09-15 23:01:36,621 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-09-15 23:01:36,621 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-09-15 23:01:36,621 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-09-15 23:01:36,621 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:34705-0x100b1d2daa90002, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-15 23:01:36,621 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-09-15 23:01:36,621 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-09-15 23:01:36,622 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.tmp/data/default/testtb-testExportWithTargetName/0544517e48855f0dc36cfaea5a8afb6b/cf, FileablePath, hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.tmp/data/default/testtb-testExportWithTargetName/0544517e48855f0dc36cfaea5a8afb6b/recovered.edits] 2023-09-15 23:01:36,622 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.tmp/data/default/testtb-testExportWithTargetName/f01176c7d7d0a3756be00c34936673af/cf, FileablePath, hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.tmp/data/default/testtb-testExportWithTargetName/f01176c7d7d0a3756be00c34936673af/recovered.edits] 2023-09-15 23:01:36,624 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-09-15 23:01:36,631 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.tmp/data/default/testtb-testExportWithTargetName/0544517e48855f0dc36cfaea5a8afb6b/cf/4ba26226e778416887f9393bb1a877f1 to hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/archive/data/default/testtb-testExportWithTargetName/0544517e48855f0dc36cfaea5a8afb6b/cf/4ba26226e778416887f9393bb1a877f1 2023-09-15 23:01:36,631 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.tmp/data/default/testtb-testExportWithTargetName/f01176c7d7d0a3756be00c34936673af/cf/37d09b3bf44d4ee98754e422be703d3c to hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/archive/data/default/testtb-testExportWithTargetName/f01176c7d7d0a3756be00c34936673af/cf/37d09b3bf44d4ee98754e422be703d3c 2023-09-15 23:01:36,635 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.tmp/data/default/testtb-testExportWithTargetName/0544517e48855f0dc36cfaea5a8afb6b/recovered.edits/9.seqid to hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/archive/data/default/testtb-testExportWithTargetName/0544517e48855f0dc36cfaea5a8afb6b/recovered.edits/9.seqid 2023-09-15 23:01:36,635 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.tmp/data/default/testtb-testExportWithTargetName/f01176c7d7d0a3756be00c34936673af/recovered.edits/9.seqid to hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/archive/data/default/testtb-testExportWithTargetName/f01176c7d7d0a3756be00c34936673af/recovered.edits/9.seqid 2023-09-15 23:01:36,636 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.tmp/data/default/testtb-testExportWithTargetName/f01176c7d7d0a3756be00c34936673af 2023-09-15 23:01:36,636 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.tmp/data/default/testtb-testExportWithTargetName/0544517e48855f0dc36cfaea5a8afb6b 2023-09-15 23:01:36,636 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-09-15 23:01:36,637 DEBUG [PEWorker-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-09-15 23:01:36,638 DEBUG [PEWorker-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf] 2023-09-15 23:01:36,642 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230915c988a78751d744f7906694294954a88c to hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230915c988a78751d744f7906694294954a88c 2023-09-15 23:01:36,644 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230915ec8f69d276104b7abc0f745e7d028266 to hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230915ec8f69d276104b7abc0f745e7d028266 2023-09-15 23:01:36,644 DEBUG [PEWorker-2] backup.HFileArchiver(596): Deleted hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-09-15 23:01:36,648 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=26, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-15 23:01:36,670 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportWithTargetName from hbase:meta 2023-09-15 23:01:36,672 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportWithTargetName' descriptor. 2023-09-15 23:01:36,674 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=26, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-15 23:01:36,674 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportWithTargetName' from region states. 2023-09-15 23:01:36,674 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,,1694818879658.0544517e48855f0dc36cfaea5a8afb6b.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1694818896674"}]},"ts":"9223372036854775807"} 2023-09-15 23:01:36,674 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,1,1694818879658.f01176c7d7d0a3756be00c34936673af.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1694818896674"}]},"ts":"9223372036854775807"} 2023-09-15 23:01:36,677 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-15 23:01:36,677 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 0544517e48855f0dc36cfaea5a8afb6b, NAME => 'testtb-testExportWithTargetName,,1694818879658.0544517e48855f0dc36cfaea5a8afb6b.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => f01176c7d7d0a3756be00c34936673af, NAME => 'testtb-testExportWithTargetName,1,1694818879658.f01176c7d7d0a3756be00c34936673af.', STARTKEY => '1', ENDKEY => ''}] 2023-09-15 23:01:36,677 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportWithTargetName' as deleted. 2023-09-15 23:01:36,677 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1694818896677"}]},"ts":"9223372036854775807"} 2023-09-15 23:01:36,679 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportWithTargetName state from META 2023-09-15 23:01:36,681 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=26, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-15 23:01:36,683 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=26, state=SUCCESS; DeleteTableProcedure table=testtb-testExportWithTargetName in 81 msec 2023-09-15 23:01:36,725 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-09-15 23:01:36,727 INFO [Listener at jenkins-hbase4.apache.org/46629] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportWithTargetName, procId: 26 completed 2023-09-15 23:01:36,749 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportWithTargetName" 2023-09-15 23:01:36,752 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportWithTargetName 2023-09-15 23:01:36,755 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportWithTargetName" 2023-09-15 23:01:36,757 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportWithTargetName 2023-09-15 23:01:36,786 INFO [Listener at jenkins-hbase4.apache.org/46629] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=752 (was 706) Potentially hanging thread: HFileArchiver-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1896422628_17 at /127.0.0.1:33836 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Container metrics unregistration java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c5e9ebbf-ce0f-c6b3-3dce-6299f7b47f51/cluster_730e0029-aea3-8c57-14c7-897a98b383cd/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c5e9ebbf-ce0f-c6b3-3dce-6299f7b47f51/cluster_730e0029-aea3-8c57-14c7-897a98b383cd/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1281 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1896422628_17 at /127.0.0.1:36248 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1629749639) connection to jenkins-hbase4.apache.org/172.31.14.131:41841 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: IPC Client (1629749639) connection to jenkins-hbase4.apache.org/172.31.14.131:37785 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c5e9ebbf-ce0f-c6b3-3dce-6299f7b47f51/cluster_730e0029-aea3-8c57-14c7-897a98b383cd/dfs/data/data4/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-239243453_1 at /127.0.0.1:38978 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #0 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.read1(BufferedReader.java:212) java.io.BufferedReader.read(BufferedReader.java:286) org.apache.hadoop.util.Shell$ShellCommandExecutor.parseExecResult(Shell.java:1229) org.apache.hadoop.util.Shell.runCommand(Shell.java:984) org.apache.hadoop.util.Shell.run(Shell.java:884) org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:1216) org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:294) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.launchContainer(ContainerLaunch.java:442) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:293) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:97) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x78d29e78-shared-pool-11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1629749639) connection to jenkins-hbase4.apache.org/172.31.14.131:39163 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c5e9ebbf-ce0f-c6b3-3dce-6299f7b47f51/cluster_730e0029-aea3-8c57-14c7-897a98b383cd/dfs/data/data6/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x78d29e78-shared-pool-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c5e9ebbf-ce0f-c6b3-3dce-6299f7b47f51/cluster_730e0029-aea3-8c57-14c7-897a98b383cd/dfs/data/data3/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c5e9ebbf-ce0f-c6b3-3dce-6299f7b47f51/cluster_730e0029-aea3-8c57-14c7-897a98b383cd/dfs/data/data5/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x78d29e78-shared-pool-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MutableQuantiles-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x78d29e78-shared-pool-12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1896422628_17 at /127.0.0.1:51438 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,33655,1694818872204' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Timer for 'JobHistoryServer' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=923 (was 897) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=164 (was 97) - SystemLoadAverage LEAK? -, ProcessCount=167 (was 164) - ProcessCount LEAK? -, AvailableMemoryMB=5488 (was 6265) 2023-09-15 23:01:36,787 WARN [Listener at jenkins-hbase4.apache.org/46629] hbase.ResourceChecker(130): Thread=752 is superior to 500 2023-09-15 23:01:36,806 INFO [Listener at jenkins-hbase4.apache.org/46629] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=752, OpenFileDescriptor=923, MaxFileDescriptor=60000, SystemLoadAverage=164, ProcessCount=167, AvailableMemoryMB=5486 2023-09-15 23:01:36,806 WARN [Listener at jenkins-hbase4.apache.org/46629] hbase.ResourceChecker(130): Thread=752 is superior to 500 2023-09-15 23:01:36,808 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-15 23:01:36,811 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] procedure2.ProcedureExecutor(1028): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemState 2023-09-15 23:01:36,814 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-09-15 23:01:36,815 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemState" procId is: 27 2023-09-15 23:01:36,816 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-15 23:01:36,816 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-09-15 23:01:36,819 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.tmp/data/default/testtb-testExportFileSystemState/f783f80007700e62158bcd6f0e195070 2023-09-15 23:01:36,819 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.tmp/data/default/testtb-testExportFileSystemState/cabb8bcdcb03b29f02722bf423e330b2 2023-09-15 23:01:36,820 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.tmp/data/default/testtb-testExportFileSystemState/cabb8bcdcb03b29f02722bf423e330b2 empty. 2023-09-15 23:01:36,820 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.tmp/data/default/testtb-testExportFileSystemState/f783f80007700e62158bcd6f0e195070 empty. 2023-09-15 23:01:36,821 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.tmp/data/default/testtb-testExportFileSystemState/cabb8bcdcb03b29f02722bf423e330b2 2023-09-15 23:01:36,821 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.tmp/data/default/testtb-testExportFileSystemState/f783f80007700e62158bcd6f0e195070 2023-09-15 23:01:36,821 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-09-15 23:01:36,833 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.tmp/data/default/testtb-testExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-09-15 23:01:36,834 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => f783f80007700e62158bcd6f0e195070, NAME => 'testtb-testExportFileSystemState,,1694818896808.f783f80007700e62158bcd6f0e195070.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.tmp 2023-09-15 23:01:36,834 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => cabb8bcdcb03b29f02722bf423e330b2, NAME => 'testtb-testExportFileSystemState,1,1694818896808.cabb8bcdcb03b29f02722bf423e330b2.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.tmp 2023-09-15 23:01:36,854 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1694818896808.f783f80007700e62158bcd6f0e195070.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-15 23:01:36,855 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing f783f80007700e62158bcd6f0e195070, disabling compactions & flushes 2023-09-15 23:01:36,855 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1694818896808.f783f80007700e62158bcd6f0e195070. 2023-09-15 23:01:36,855 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1694818896808.f783f80007700e62158bcd6f0e195070. 2023-09-15 23:01:36,855 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1694818896808.f783f80007700e62158bcd6f0e195070. after waiting 0 ms 2023-09-15 23:01:36,855 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1694818896808.f783f80007700e62158bcd6f0e195070. 2023-09-15 23:01:36,855 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1694818896808.f783f80007700e62158bcd6f0e195070. 2023-09-15 23:01:36,855 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for f783f80007700e62158bcd6f0e195070: 2023-09-15 23:01:36,857 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1694818896808.cabb8bcdcb03b29f02722bf423e330b2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-15 23:01:36,858 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing cabb8bcdcb03b29f02722bf423e330b2, disabling compactions & flushes 2023-09-15 23:01:36,858 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1694818896808.cabb8bcdcb03b29f02722bf423e330b2. 2023-09-15 23:01:36,858 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1694818896808.cabb8bcdcb03b29f02722bf423e330b2. 2023-09-15 23:01:36,858 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1694818896808.cabb8bcdcb03b29f02722bf423e330b2. after waiting 0 ms 2023-09-15 23:01:36,858 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1694818896808.cabb8bcdcb03b29f02722bf423e330b2. 2023-09-15 23:01:36,858 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1694818896808.cabb8bcdcb03b29f02722bf423e330b2. 2023-09-15 23:01:36,858 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for cabb8bcdcb03b29f02722bf423e330b2: 2023-09-15 23:01:36,861 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-09-15 23:01:36,862 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1694818896808.f783f80007700e62158bcd6f0e195070.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1694818896862"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694818896862"}]},"ts":"1694818896862"} 2023-09-15 23:01:36,862 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1694818896808.cabb8bcdcb03b29f02722bf423e330b2.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1694818896862"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694818896862"}]},"ts":"1694818896862"} 2023-09-15 23:01:36,865 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-15 23:01:36,866 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-15 23:01:36,866 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694818896866"}]},"ts":"1694818896866"} 2023-09-15 23:01:36,868 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLING in hbase:meta 2023-09-15 23:01:36,873 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-15 23:01:36,874 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-15 23:01:36,874 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-15 23:01:36,874 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-15 23:01:36,874 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-15 23:01:36,874 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=f783f80007700e62158bcd6f0e195070, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=cabb8bcdcb03b29f02722bf423e330b2, ASSIGN}] 2023-09-15 23:01:36,878 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=f783f80007700e62158bcd6f0e195070, ASSIGN 2023-09-15 23:01:36,878 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=cabb8bcdcb03b29f02722bf423e330b2, ASSIGN 2023-09-15 23:01:36,879 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=f783f80007700e62158bcd6f0e195070, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34705,1694818872254; forceNewPlan=false, retain=false 2023-09-15 23:01:36,879 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=cabb8bcdcb03b29f02722bf423e330b2, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41413,1694818872288; forceNewPlan=false, retain=false 2023-09-15 23:01:36,918 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-09-15 23:01:37,029 INFO [jenkins-hbase4:44427] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-15 23:01:37,032 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=f783f80007700e62158bcd6f0e195070, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:01:37,032 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=cabb8bcdcb03b29f02722bf423e330b2, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:01:37,032 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1694818896808.cabb8bcdcb03b29f02722bf423e330b2.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1694818897032"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694818897032"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694818897032"}]},"ts":"1694818897032"} 2023-09-15 23:01:37,032 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1694818896808.f783f80007700e62158bcd6f0e195070.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1694818897032"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694818897032"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694818897032"}]},"ts":"1694818897032"} 2023-09-15 23:01:37,035 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=30, ppid=28, state=RUNNABLE; OpenRegionProcedure f783f80007700e62158bcd6f0e195070, server=jenkins-hbase4.apache.org,34705,1694818872254}] 2023-09-15 23:01:37,036 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=31, ppid=29, state=RUNNABLE; OpenRegionProcedure cabb8bcdcb03b29f02722bf423e330b2, server=jenkins-hbase4.apache.org,41413,1694818872288}] 2023-09-15 23:01:37,119 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-09-15 23:01:37,192 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,,1694818896808.f783f80007700e62158bcd6f0e195070. 2023-09-15 23:01:37,192 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => f783f80007700e62158bcd6f0e195070, NAME => 'testtb-testExportFileSystemState,,1694818896808.f783f80007700e62158bcd6f0e195070.', STARTKEY => '', ENDKEY => '1'} 2023-09-15 23:01:37,192 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,,1694818896808.f783f80007700e62158bcd6f0e195070. service=AccessControlService 2023-09-15 23:01:37,193 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-15 23:01:37,193 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState f783f80007700e62158bcd6f0e195070 2023-09-15 23:01:37,193 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1694818896808.f783f80007700e62158bcd6f0e195070.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-15 23:01:37,193 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for f783f80007700e62158bcd6f0e195070 2023-09-15 23:01:37,193 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for f783f80007700e62158bcd6f0e195070 2023-09-15 23:01:37,194 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,1,1694818896808.cabb8bcdcb03b29f02722bf423e330b2. 2023-09-15 23:01:37,194 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => cabb8bcdcb03b29f02722bf423e330b2, NAME => 'testtb-testExportFileSystemState,1,1694818896808.cabb8bcdcb03b29f02722bf423e330b2.', STARTKEY => '1', ENDKEY => ''} 2023-09-15 23:01:37,194 INFO [StoreOpener-f783f80007700e62158bcd6f0e195070-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region f783f80007700e62158bcd6f0e195070 2023-09-15 23:01:37,195 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,1,1694818896808.cabb8bcdcb03b29f02722bf423e330b2. service=AccessControlService 2023-09-15 23:01:37,195 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-15 23:01:37,195 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState cabb8bcdcb03b29f02722bf423e330b2 2023-09-15 23:01:37,196 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1694818896808.cabb8bcdcb03b29f02722bf423e330b2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-15 23:01:37,196 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for cabb8bcdcb03b29f02722bf423e330b2 2023-09-15 23:01:37,196 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for cabb8bcdcb03b29f02722bf423e330b2 2023-09-15 23:01:37,196 DEBUG [StoreOpener-f783f80007700e62158bcd6f0e195070-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/default/testtb-testExportFileSystemState/f783f80007700e62158bcd6f0e195070/cf 2023-09-15 23:01:37,196 DEBUG [StoreOpener-f783f80007700e62158bcd6f0e195070-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/default/testtb-testExportFileSystemState/f783f80007700e62158bcd6f0e195070/cf 2023-09-15 23:01:37,197 INFO [StoreOpener-f783f80007700e62158bcd6f0e195070-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f783f80007700e62158bcd6f0e195070 columnFamilyName cf 2023-09-15 23:01:37,197 INFO [StoreOpener-cabb8bcdcb03b29f02722bf423e330b2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region cabb8bcdcb03b29f02722bf423e330b2 2023-09-15 23:01:37,199 INFO [StoreOpener-f783f80007700e62158bcd6f0e195070-1] regionserver.HStore(310): Store=f783f80007700e62158bcd6f0e195070/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-15 23:01:37,200 DEBUG [StoreOpener-cabb8bcdcb03b29f02722bf423e330b2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/default/testtb-testExportFileSystemState/cabb8bcdcb03b29f02722bf423e330b2/cf 2023-09-15 23:01:37,200 DEBUG [StoreOpener-cabb8bcdcb03b29f02722bf423e330b2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/default/testtb-testExportFileSystemState/cabb8bcdcb03b29f02722bf423e330b2/cf 2023-09-15 23:01:37,201 INFO [StoreOpener-cabb8bcdcb03b29f02722bf423e330b2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cabb8bcdcb03b29f02722bf423e330b2 columnFamilyName cf 2023-09-15 23:01:37,201 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/default/testtb-testExportFileSystemState/f783f80007700e62158bcd6f0e195070 2023-09-15 23:01:37,202 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/default/testtb-testExportFileSystemState/f783f80007700e62158bcd6f0e195070 2023-09-15 23:01:37,202 INFO [StoreOpener-cabb8bcdcb03b29f02722bf423e330b2-1] regionserver.HStore(310): Store=cabb8bcdcb03b29f02722bf423e330b2/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-15 23:01:37,204 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/default/testtb-testExportFileSystemState/cabb8bcdcb03b29f02722bf423e330b2 2023-09-15 23:01:37,204 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/default/testtb-testExportFileSystemState/cabb8bcdcb03b29f02722bf423e330b2 2023-09-15 23:01:37,206 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for f783f80007700e62158bcd6f0e195070 2023-09-15 23:01:37,207 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for cabb8bcdcb03b29f02722bf423e330b2 2023-09-15 23:01:37,208 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/default/testtb-testExportFileSystemState/f783f80007700e62158bcd6f0e195070/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-15 23:01:37,208 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened f783f80007700e62158bcd6f0e195070; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62798864, jitterRate=-0.0642240047454834}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-15 23:01:37,208 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for f783f80007700e62158bcd6f0e195070: 2023-09-15 23:01:37,209 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,,1694818896808.f783f80007700e62158bcd6f0e195070., pid=30, masterSystemTime=1694818897188 2023-09-15 23:01:37,209 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/default/testtb-testExportFileSystemState/cabb8bcdcb03b29f02722bf423e330b2/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-15 23:01:37,210 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened cabb8bcdcb03b29f02722bf423e330b2; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=58971603, jitterRate=-0.12125463783740997}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-15 23:01:37,210 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for cabb8bcdcb03b29f02722bf423e330b2: 2023-09-15 23:01:37,212 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,,1694818896808.f783f80007700e62158bcd6f0e195070. 2023-09-15 23:01:37,212 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,,1694818896808.f783f80007700e62158bcd6f0e195070. 2023-09-15 23:01:37,212 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=f783f80007700e62158bcd6f0e195070, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:01:37,213 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,,1694818896808.f783f80007700e62158bcd6f0e195070.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1694818897212"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1694818897212"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1694818897212"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1694818897212"}]},"ts":"1694818897212"} 2023-09-15 23:01:37,215 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,1,1694818896808.cabb8bcdcb03b29f02722bf423e330b2., pid=31, masterSystemTime=1694818897191 2023-09-15 23:01:37,217 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,1,1694818896808.cabb8bcdcb03b29f02722bf423e330b2. 2023-09-15 23:01:37,218 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,1,1694818896808.cabb8bcdcb03b29f02722bf423e330b2. 2023-09-15 23:01:37,218 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=30, resume processing ppid=28 2023-09-15 23:01:37,220 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=30, ppid=28, state=SUCCESS; OpenRegionProcedure f783f80007700e62158bcd6f0e195070, server=jenkins-hbase4.apache.org,34705,1694818872254 in 180 msec 2023-09-15 23:01:37,220 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=cabb8bcdcb03b29f02722bf423e330b2, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:01:37,221 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,1,1694818896808.cabb8bcdcb03b29f02722bf423e330b2.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1694818897220"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1694818897220"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1694818897220"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1694818897220"}]},"ts":"1694818897220"} 2023-09-15 23:01:37,223 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=f783f80007700e62158bcd6f0e195070, ASSIGN in 346 msec 2023-09-15 23:01:37,227 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=31, resume processing ppid=29 2023-09-15 23:01:37,228 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=31, ppid=29, state=SUCCESS; OpenRegionProcedure cabb8bcdcb03b29f02722bf423e330b2, server=jenkins-hbase4.apache.org,41413,1694818872288 in 188 msec 2023-09-15 23:01:37,231 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=29, resume processing ppid=27 2023-09-15 23:01:37,232 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=cabb8bcdcb03b29f02722bf423e330b2, ASSIGN in 355 msec 2023-09-15 23:01:37,232 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-15 23:01:37,233 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694818897232"}]},"ts":"1694818897232"} 2023-09-15 23:01:37,235 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLED in hbase:meta 2023-09-15 23:01:37,238 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-09-15 23:01:37,238 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemState jenkins: RWXCA 2023-09-15 23:01:37,241 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41413] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-09-15 23:01:37,243 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:34705-0x100b1d2daa90002, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-15 23:01:37,243 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:41413-0x100b1d2daa90003, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-15 23:01:37,243 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:33655-0x100b1d2daa90001, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-15 23:01:37,243 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-15 23:01:37,245 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-15 23:01:37,245 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-15 23:01:37,245 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-15 23:01:37,245 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-15 23:01:37,247 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemState in 435 msec 2023-09-15 23:01:37,420 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-09-15 23:01:37,421 INFO [Listener at jenkins-hbase4.apache.org/46629] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemState, procId: 27 completed 2023-09-15 23:01:37,424 DEBUG [Listener at jenkins-hbase4.apache.org/46629] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-09-15 23:01:37,424 DEBUG [Listener at jenkins-hbase4.apache.org/46629] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1694818896808.f783f80007700e62158bcd6f0e195070. 2023-09-15 23:01:37,426 INFO [Listener at jenkins-hbase4.apache.org/46629] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-15 23:01:37,447 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-15 23:01:37,447 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1694818897447 (current time:1694818897447). 2023-09-15 23:01:37,447 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-15 23:01:37,449 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] zookeeper.ReadOnlyZKClient(139): Connect 0x0c19defe to 127.0.0.1:51149 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-15 23:01:37,457 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@52331f7c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-15 23:01:37,459 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-15 23:01:37,463 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42922, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-15 23:01:37,464 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0c19defe to 127.0.0.1:51149 2023-09-15 23:01:37,464 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-15 23:01:37,465 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] zookeeper.ReadOnlyZKClient(139): Connect 0x4d0dc895 to 127.0.0.1:51149 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-15 23:01:37,472 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@f2101e4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-15 23:01:37,474 DEBUG [hconnection-0x45a32783-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-15 23:01:37,477 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42936, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-15 23:01:37,486 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4d0dc895 to 127.0.0.1:51149 2023-09-15 23:01:37,486 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-15 23:01:37,486 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-09-15 23:01:37,487 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-15 23:01:37,487 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-15 23:01:37,490 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] procedure2.ProcedureExecutor(1028): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-15 23:01:37,491 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-15 23:01:37,492 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1694819497492 2023-09-15 23:01:37,492 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-09-15 23:01:37,492 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-15 23:01:37,494 DEBUG [Listener at jenkins-hbase4.apache.org/46629] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-15 23:01:37,494 DEBUG [Listener at jenkins-hbase4.apache.org/46629] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-15 23:01:37,495 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-15 23:01:37,496 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-15 23:01:37,497 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 7 msec 2023-09-15 23:01:37,498 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-15 23:01:37,499 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=33, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1694819497499 2023-09-15 23:01:37,517 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemState 2023-09-15 23:01:37,517 INFO [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemState' 2023-09-15 23:01:37,517 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-15 23:01:37,519 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' 2023-09-15 23:01:37,519 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-09-15 23:01:37,519 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-15 23:01:37,519 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-15 23:01:37,522 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:34705-0x100b1d2daa90002, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 23:01:37,522 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:01:37,522 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 23:01:37,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 23:01:37,522 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:41413-0x100b1d2daa90003, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 23:01:37,522 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:33655-0x100b1d2daa90001, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 23:01:37,522 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 23:01:37,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 23:01:37,522 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 23:01:37,523 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:01:37,523 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:01:37,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-15 23:01:37,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 23:01:37,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-15 23:01:37,523 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34705-0x100b1d2daa90002, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-15 23:01:37,523 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41413-0x100b1d2daa90003, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-15 23:01:37,523 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:01:37,523 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-15 23:01:37,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-15 23:01:37,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-09-15 23:01:37,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-09-15 23:01:37,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-15 23:01:37,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-15 23:01:37,524 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33655-0x100b1d2daa90001, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-15 23:01:37,524 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-15 23:01:37,524 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-15 23:01:37,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-09-15 23:01:37,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-15 23:01:37,524 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-15 23:01:37,529 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-09-15 23:01:37,529 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-09-15 23:01:37,529 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-09-15 23:01:37,529 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-15 23:01:37,529 DEBUG [member: 'jenkins-hbase4.apache.org,33655,1694818872204' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-15 23:01:37,529 DEBUG [member: 'jenkins-hbase4.apache.org,33655,1694818872204' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-15 23:01:37,529 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-15 23:01:37,530 DEBUG [member: 'jenkins-hbase4.apache.org,33655,1694818872204' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-15 23:01:37,530 DEBUG [member: 'jenkins-hbase4.apache.org,33655,1694818872204' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-09-15 23:01:37,529 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-15 23:01:37,530 DEBUG [member: 'jenkins-hbase4.apache.org,33655,1694818872204' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33655,1694818872204' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-09-15 23:01:37,530 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-15 23:01:37,532 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-15 23:01:37,533 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-15 23:01:37,533 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-09-15 23:01:37,533 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-09-15 23:01:37,533 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41413,1694818872288' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-09-15 23:01:37,533 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34705,1694818872254' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-09-15 23:01:37,535 DEBUG [member: 'jenkins-hbase4.apache.org,33655,1694818872204' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-15 23:01:37,541 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:01:37,541 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-15 23:01:37,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:01:37,541 DEBUG [member: 'jenkins-hbase4.apache.org,33655,1694818872204' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33655-0x100b1d2daa90001, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-15 23:01:37,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-15 23:01:37,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-15 23:01:37,541 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:01:37,541 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-15 23:01:37,541 DEBUG [member: 'jenkins-hbase4.apache.org,33655,1694818872204' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-15 23:01:37,541 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41413-0x100b1d2daa90003, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-15 23:01:37,541 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-15 23:01:37,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-15 23:01:37,542 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34705-0x100b1d2daa90002, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-15 23:01:37,542 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-15 23:01:37,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-15 23:01:37,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-15 23:01:37,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:01:37,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:01:37,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33655,1694818872204 2023-09-15 23:01:37,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-15 23:01:37,543 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41413,1694818872288' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-09-15 23:01:37,543 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4cac937a[Count = 1] remaining members to acquire global barrier 2023-09-15 23:01:37,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:01:37,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-15 23:01:37,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-15 23:01:37,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-15 23:01:37,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-15 23:01:37,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-15 23:01:37,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:01:37,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:01:37,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33655,1694818872204 2023-09-15 23:01:37,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-15 23:01:37,546 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34705,1694818872254' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-09-15 23:01:37,546 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4cac937a[Count = 0] remaining members to acquire global barrier 2023-09-15 23:01:37,546 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-09-15 23:01:37,546 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-15 23:01:37,547 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:33655-0x100b1d2daa90001, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-15 23:01:37,547 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:34705-0x100b1d2daa90002, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-15 23:01:37,547 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:41413-0x100b1d2daa90003, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-15 23:01:37,548 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-15 23:01:37,548 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-15 23:01:37,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-15 23:01:37,547 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-15 23:01:37,548 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-15 23:01:37,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-15 23:01:37,548 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:01:37,548 DEBUG [member: 'jenkins-hbase4.apache.org,33655,1694818872204' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-15 23:01:37,548 DEBUG [member: 'jenkins-hbase4.apache.org,33655,1694818872204' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-09-15 23:01:37,548 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-15 23:01:37,548 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-15 23:01:37,548 DEBUG [rs(jenkins-hbase4.apache.org,34705,1694818872254)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1694818896808.f783f80007700e62158bcd6f0e195070. 2023-09-15 23:01:37,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-15 23:01:37,548 DEBUG [rs(jenkins-hbase4.apache.org,34705,1694818872254)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1694818896808.f783f80007700e62158bcd6f0e195070. started... 2023-09-15 23:01:37,548 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-15 23:01:37,548 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:01:37,548 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-15 23:01:37,548 DEBUG [member: 'jenkins-hbase4.apache.org,33655,1694818872204' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,33655,1694818872204' in zk 2023-09-15 23:01:37,548 DEBUG [rs(jenkins-hbase4.apache.org,34705,1694818872254)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for f783f80007700e62158bcd6f0e195070: 2023-09-15 23:01:37,548 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-15 23:01:37,549 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-15 23:01:37,549 DEBUG [rs(jenkins-hbase4.apache.org,41413,1694818872288)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1694818896808.cabb8bcdcb03b29f02722bf423e330b2. 2023-09-15 23:01:37,549 DEBUG [rs(jenkins-hbase4.apache.org,41413,1694818872288)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1694818896808.cabb8bcdcb03b29f02722bf423e330b2. started... 2023-09-15 23:01:37,549 DEBUG [rs(jenkins-hbase4.apache.org,34705,1694818872254)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1694818896808.f783f80007700e62158bcd6f0e195070.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-09-15 23:01:37,549 DEBUG [rs(jenkins-hbase4.apache.org,34705,1694818872254)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-15 23:01:37,550 DEBUG [rs(jenkins-hbase4.apache.org,34705,1694818872254)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-15 23:01:37,550 DEBUG [rs(jenkins-hbase4.apache.org,41413,1694818872288)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for cabb8bcdcb03b29f02722bf423e330b2: 2023-09-15 23:01:37,550 DEBUG [rs(jenkins-hbase4.apache.org,41413,1694818872288)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1694818896808.cabb8bcdcb03b29f02722bf423e330b2.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-09-15 23:01:37,550 DEBUG [rs(jenkins-hbase4.apache.org,41413,1694818872288)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-15 23:01:37,550 DEBUG [rs(jenkins-hbase4.apache.org,41413,1694818872288)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-15 23:01:37,551 DEBUG [member: 'jenkins-hbase4.apache.org,33655,1694818872204' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-09-15 23:01:37,551 DEBUG [member: 'jenkins-hbase4.apache.org,33655,1694818872204' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-15 23:01:37,551 DEBUG [member: 'jenkins-hbase4.apache.org,33655,1694818872204' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-09-15 23:01:37,575 DEBUG [rs(jenkins-hbase4.apache.org,34705,1694818872254)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1694818896808.f783f80007700e62158bcd6f0e195070. completed. 2023-09-15 23:01:37,575 DEBUG [rs(jenkins-hbase4.apache.org,34705,1694818872254)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1694818896808.f783f80007700e62158bcd6f0e195070. 2023-09-15 23:01:37,575 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-15 23:01:37,576 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-15 23:01:37,576 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:01:37,576 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-09-15 23:01:37,576 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,34705,1694818872254' in zk 2023-09-15 23:01:37,577 DEBUG [rs(jenkins-hbase4.apache.org,41413,1694818872288)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1694818896808.cabb8bcdcb03b29f02722bf423e330b2. completed. 2023-09-15 23:01:37,578 DEBUG [rs(jenkins-hbase4.apache.org,41413,1694818872288)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1694818896808.cabb8bcdcb03b29f02722bf423e330b2. 2023-09-15 23:01:37,578 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-15 23:01:37,578 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-15 23:01:37,578 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:01:37,578 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-09-15 23:01:37,578 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,41413,1694818872288' in zk 2023-09-15 23:01:37,578 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-09-15 23:01:37,578 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-15 23:01:37,578 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:01:37,578 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-09-15 23:01:37,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:01:37,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-15 23:01:37,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-15 23:01:37,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-15 23:01:37,581 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:01:37,581 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-09-15 23:01:37,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-15 23:01:37,582 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-15 23:01:37,582 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-09-15 23:01:37,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-15 23:01:37,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:01:37,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:01:37,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33655,1694818872204 2023-09-15 23:01:37,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-15 23:01:37,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-15 23:01:37,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:01:37,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:01:37,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33655,1694818872204 2023-09-15 23:01:37,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,34705,1694818872254': 2023-09-15 23:01:37,586 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34705,1694818872254' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-09-15 23:01:37,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:01:37,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-15 23:01:37,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-15 23:01:37,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-15 23:01:37,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-15 23:01:37,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-15 23:01:37,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:01:37,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:01:37,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33655,1694818872204 2023-09-15 23:01:37,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-15 23:01:37,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-15 23:01:37,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:01:37,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:01:37,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33655,1694818872204 2023-09-15 23:01:37,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,41413,1694818872288': 2023-09-15 23:01:37,589 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41413,1694818872288' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-09-15 23:01:37,589 INFO [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemState' execution completed 2023-09-15 23:01:37,590 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-15 23:01:37,590 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-15 23:01:37,590 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemState 2023-09-15 23:01:37,590 INFO [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-15 23:01:37,592 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:41413-0x100b1d2daa90003, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-15 23:01:37,592 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:34705-0x100b1d2daa90002, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-15 23:01:37,592 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-15 23:01:37,592 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-15 23:01:37,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-15 23:01:37,592 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-15 23:01:37,592 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:33655-0x100b1d2daa90001, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-15 23:01:37,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-15 23:01:37,592 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-15 23:01:37,592 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:34705-0x100b1d2daa90002, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 23:01:37,592 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:41413-0x100b1d2daa90003, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 23:01:37,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-15 23:01:37,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-15 23:01:37,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-15 23:01:37,592 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:01:37,592 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:33655-0x100b1d2daa90001, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 23:01:37,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-15 23:01:37,592 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 23:01:37,593 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 23:01:37,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 23:01:37,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 23:01:37,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-15 23:01:37,593 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:01:37,593 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 23:01:37,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-15 23:01:37,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-15 23:01:37,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-15 23:01:37,593 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33655,1694818872204 2023-09-15 23:01:37,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 23:01:37,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-15 23:01:37,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-15 23:01:37,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-15 23:01:37,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:01:37,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:01:37,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33655,1694818872204 2023-09-15 23:01:37,596 DEBUG [Listener at jenkins-hbase4.apache.org/46629] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-15 23:01:37,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-15 23:01:37,596 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:01:37,597 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-15 23:01:37,597 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-09-15 23:01:37,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-15 23:01:37,597 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:01:37,597 DEBUG [Listener at jenkins-hbase4.apache.org/46629] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-15 23:01:37,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:01:37,598 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33655,1694818872204 2023-09-15 23:01:37,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:01:37,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33655,1694818872204 2023-09-15 23:01:37,602 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:34705-0x100b1d2daa90002, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 23:01:37,602 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 23:01:37,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 23:01:37,603 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33655,1694818872204 2023-09-15 23:01:37,603 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:34705-0x100b1d2daa90002, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 23:01:37,603 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:41413-0x100b1d2daa90003, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 23:01:37,603 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-15 23:01:37,603 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 23:01:37,603 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-15 23:01:37,603 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:33655-0x100b1d2daa90001, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 23:01:37,605 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:01:37,605 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 23:01:37,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 23:01:37,603 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemState 2023-09-15 23:01:37,603 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:41413-0x100b1d2daa90003, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 23:01:37,605 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-09-15 23:01:37,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 23:01:37,605 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-09-15 23:01:37,605 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:01:37,605 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-15 23:01:37,605 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 23:01:37,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 23:01:37,605 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:33655-0x100b1d2daa90001, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 23:01:37,605 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 23:01:37,605 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-15 23:01:37,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 23:01:37,606 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33655,1694818872204 2023-09-15 23:01:37,606 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-15 23:01:37,606 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:01:37,606 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:01:37,606 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 23:01:37,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 23:01:37,606 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-15 23:01:37,606 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-15 23:01:37,606 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-15 23:01:37,616 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemState 2023-09-15 23:01:37,617 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-09-15 23:01:37,641 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState to hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.hbase-snapshot/emptySnaptb0-testExportFileSystemState 2023-09-15 23:01:37,642 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-09-15 23:01:37,642 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-09-15 23:01:37,643 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-09-15 23:01:37,643 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1694818897492Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1694818897616 (+124 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemState at 1694818897616Loading Region manifests for emptySnaptb0-testExportFileSystemState at 1694818897616Writing data manifest for emptySnaptb0-testExportFileSystemState at 1694818897622 (+6 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemState at 1694818897634 (+12 ms)Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1694818897642 (+8 ms) 2023-09-15 23:01:37,645 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=33, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-15 23:01:37,648 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=33, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 152 msec 2023-09-15 23:01:37,797 DEBUG [Listener at jenkins-hbase4.apache.org/46629] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-15 23:01:37,800 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-15 23:01:37,800 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-15 23:01:37,805 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34705] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,,1694818896808.f783f80007700e62158bcd6f0e195070. with WAL disabled. Data may be lost in the event of a crash. 2023-09-15 23:01:37,806 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41413] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,1,1694818896808.cabb8bcdcb03b29f02722bf423e330b2. with WAL disabled. Data may be lost in the event of a crash. 2023-09-15 23:01:37,811 DEBUG [Listener at jenkins-hbase4.apache.org/46629] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-09-15 23:01:37,811 DEBUG [Listener at jenkins-hbase4.apache.org/46629] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1694818896808.f783f80007700e62158bcd6f0e195070. 2023-09-15 23:01:37,811 INFO [Listener at jenkins-hbase4.apache.org/46629] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-15 23:01:37,824 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-15 23:01:37,824 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1694818897824 (current time:1694818897824). 2023-09-15 23:01:37,824 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-15 23:01:37,825 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] zookeeper.ReadOnlyZKClient(139): Connect 0x603e455f to 127.0.0.1:51149 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-15 23:01:37,832 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@eef2e31, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-15 23:01:37,833 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-15 23:01:37,834 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42944, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-15 23:01:37,836 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x603e455f to 127.0.0.1:51149 2023-09-15 23:01:37,836 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-15 23:01:37,837 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] zookeeper.ReadOnlyZKClient(139): Connect 0x41cc21ed to 127.0.0.1:51149 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-15 23:01:37,843 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2423a2c8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-15 23:01:37,844 DEBUG [hconnection-0x3c309aa6-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-15 23:01:37,846 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42954, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-15 23:01:37,851 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x41cc21ed to 127.0.0.1:51149 2023-09-15 23:01:37,851 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-15 23:01:37,851 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-09-15 23:01:37,852 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-15 23:01:37,852 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-15 23:01:37,855 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] procedure2.ProcedureExecutor(1028): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-15 23:01:37,856 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-15 23:01:37,857 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1694819497857 2023-09-15 23:01:37,857 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-15 23:01:37,857 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-09-15 23:01:37,859 DEBUG [Listener at jenkins-hbase4.apache.org/46629] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-15 23:01:37,859 DEBUG [Listener at jenkins-hbase4.apache.org/46629] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-15 23:01:37,860 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-15 23:01:37,861 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-15 23:01:37,866 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 6 msec 2023-09-15 23:01:37,867 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-15 23:01:37,867 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=35, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1694819497867 2023-09-15 23:01:37,881 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemState' 2023-09-15 23:01:37,882 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemState 2023-09-15 23:01:37,882 INFO [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemState' 2023-09-15 23:01:37,882 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-15 23:01:37,884 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemState' starting 'acquire' 2023-09-15 23:01:37,884 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-09-15 23:01:37,884 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-15 23:01:37,884 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-15 23:01:37,886 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:34705-0x100b1d2daa90002, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 23:01:37,886 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:01:37,886 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 23:01:37,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 23:01:37,886 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:41413-0x100b1d2daa90003, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 23:01:37,886 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:33655-0x100b1d2daa90001, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 23:01:37,886 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 23:01:37,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 23:01:37,886 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 23:01:37,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 23:01:37,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-15 23:01:37,887 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:01:37,887 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:01:37,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-15 23:01:37,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-15 23:01:37,887 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41413-0x100b1d2daa90003, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-15 23:01:37,888 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34705-0x100b1d2daa90002, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-15 23:01:37,888 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33655-0x100b1d2daa90001, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-15 23:01:37,888 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:01:37,888 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-15 23:01:37,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-09-15 23:01:37,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-15 23:01:37,888 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-15 23:01:37,888 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-09-15 23:01:37,888 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-15 23:01:37,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-09-15 23:01:37,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-15 23:01:37,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-09-15 23:01:37,889 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-15 23:01:37,888 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-15 23:01:37,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-15 23:01:37,889 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-15 23:01:37,893 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-09-15 23:01:37,894 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-15 23:01:37,894 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-15 23:01:37,894 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-15 23:01:37,894 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-09-15 23:01:37,896 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-15 23:01:37,896 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-09-15 23:01:37,894 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-09-15 23:01:37,896 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34705,1694818872254' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-09-15 23:01:37,896 DEBUG [member: 'jenkins-hbase4.apache.org,33655,1694818872204' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-15 23:01:37,896 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41413,1694818872288' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-09-15 23:01:37,896 DEBUG [member: 'jenkins-hbase4.apache.org,33655,1694818872204' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-15 23:01:37,897 DEBUG [member: 'jenkins-hbase4.apache.org,33655,1694818872204' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-15 23:01:37,897 DEBUG [member: 'jenkins-hbase4.apache.org,33655,1694818872204' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-09-15 23:01:37,897 DEBUG [member: 'jenkins-hbase4.apache.org,33655,1694818872204' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33655,1694818872204' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-09-15 23:01:37,900 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:01:37,900 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-15 23:01:37,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:01:37,900 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-15 23:01:37,901 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:01:37,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-15 23:01:37,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-15 23:01:37,901 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41413-0x100b1d2daa90003, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-15 23:01:37,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-15 23:01:37,901 DEBUG [member: 'jenkins-hbase4.apache.org,33655,1694818872204' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-15 23:01:37,901 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34705-0x100b1d2daa90002, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-15 23:01:37,902 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-15 23:01:37,901 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-15 23:01:37,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-15 23:01:37,902 DEBUG [member: 'jenkins-hbase4.apache.org,33655,1694818872204' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33655-0x100b1d2daa90001, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-15 23:01:37,902 DEBUG [member: 'jenkins-hbase4.apache.org,33655,1694818872204' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-15 23:01:37,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-15 23:01:37,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:01:37,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:01:37,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33655,1694818872204 2023-09-15 23:01:37,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-15 23:01:37,904 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41413,1694818872288' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-09-15 23:01:37,904 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2ecfba17[Count = 1] remaining members to acquire global barrier 2023-09-15 23:01:37,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:01:37,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-15 23:01:37,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-15 23:01:37,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-15 23:01:37,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-15 23:01:37,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-15 23:01:37,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:01:37,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:01:37,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33655,1694818872204 2023-09-15 23:01:37,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-15 23:01:37,907 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34705,1694818872254' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-09-15 23:01:37,907 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2ecfba17[Count = 0] remaining members to acquire global barrier 2023-09-15 23:01:37,907 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-09-15 23:01:37,907 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-15 23:01:37,909 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:34705-0x100b1d2daa90002, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-15 23:01:37,909 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:33655-0x100b1d2daa90001, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-15 23:01:37,909 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-15 23:01:37,909 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-15 23:01:37,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-15 23:01:37,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-15 23:01:37,909 DEBUG [member: 'jenkins-hbase4.apache.org,33655,1694818872204' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-15 23:01:37,909 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-15 23:01:37,909 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:41413-0x100b1d2daa90003, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-15 23:01:37,909 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:01:37,909 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-15 23:01:37,909 DEBUG [member: 'jenkins-hbase4.apache.org,33655,1694818872204' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-09-15 23:01:37,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-15 23:01:37,909 DEBUG [member: 'jenkins-hbase4.apache.org,33655,1694818872204' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,33655,1694818872204' in zk 2023-09-15 23:01:37,909 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-15 23:01:37,910 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:01:37,910 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-15 23:01:37,911 DEBUG [member: 'jenkins-hbase4.apache.org,33655,1694818872204' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-09-15 23:01:37,911 DEBUG [member: 'jenkins-hbase4.apache.org,33655,1694818872204' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-15 23:01:37,911 DEBUG [member: 'jenkins-hbase4.apache.org,33655,1694818872204' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-09-15 23:01:37,914 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-15 23:01:37,914 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-15 23:01:37,914 DEBUG [rs(jenkins-hbase4.apache.org,34705,1694818872254)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1694818896808.f783f80007700e62158bcd6f0e195070. 2023-09-15 23:01:37,914 DEBUG [rs(jenkins-hbase4.apache.org,41413,1694818872288)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1694818896808.cabb8bcdcb03b29f02722bf423e330b2. 2023-09-15 23:01:37,914 DEBUG [rs(jenkins-hbase4.apache.org,34705,1694818872254)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1694818896808.f783f80007700e62158bcd6f0e195070. started... 2023-09-15 23:01:37,914 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-15 23:01:37,914 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-15 23:01:37,914 DEBUG [rs(jenkins-hbase4.apache.org,41413,1694818872288)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1694818896808.cabb8bcdcb03b29f02722bf423e330b2. started... 2023-09-15 23:01:37,914 INFO [rs(jenkins-hbase4.apache.org,34705,1694818872254)-snapshot-pool-0] regionserver.HRegion(2745): Flushing f783f80007700e62158bcd6f0e195070 1/1 column families, dataSize=266 B heapSize=832 B 2023-09-15 23:01:37,915 INFO [rs(jenkins-hbase4.apache.org,41413,1694818872288)-snapshot-pool-0] regionserver.HRegion(2745): Flushing cabb8bcdcb03b29f02722bf423e330b2 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-09-15 23:01:37,947 INFO [rs(jenkins-hbase4.apache.org,34705,1694818872254)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230915b49e7f96357a4a439e5c4f3b86a82810 to hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230915b49e7f96357a4a439e5c4f3b86a82810 2023-09-15 23:01:37,955 INFO [rs(jenkins-hbase4.apache.org,41413,1694818872288)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230915e98c911e6a3b4943b84dce1a421b30c4 to hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230915e98c911e6a3b4943b84dce1a421b30c4 2023-09-15 23:01:37,959 DEBUG [Listener at jenkins-hbase4.apache.org/46629] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-15 23:01:37,965 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-15 23:01:37,965 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-09-15 23:01:37,966 DEBUG [Listener at jenkins-hbase4.apache.org/46629] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-15 23:01:37,968 INFO [rs(jenkins-hbase4.apache.org,34705,1694818872254)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=266, hasBloomFilter=true, into tmp file hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/default/testtb-testExportFileSystemState/f783f80007700e62158bcd6f0e195070/.tmp/cf/fef90c71ee564356a0d73eca54807761 2023-09-15 23:01:37,971 INFO [rs(jenkins-hbase4.apache.org,41413,1694818872288)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.0 K, hasBloomFilter=true, into tmp file hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/default/testtb-testExportFileSystemState/cabb8bcdcb03b29f02722bf423e330b2/.tmp/cf/ae881a4336284647be03d6dc5a3d15b1 2023-09-15 23:01:37,978 DEBUG [rs(jenkins-hbase4.apache.org,41413,1694818872288)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/default/testtb-testExportFileSystemState/cabb8bcdcb03b29f02722bf423e330b2/.tmp/cf/ae881a4336284647be03d6dc5a3d15b1 as hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/default/testtb-testExportFileSystemState/cabb8bcdcb03b29f02722bf423e330b2/cf/ae881a4336284647be03d6dc5a3d15b1 2023-09-15 23:01:37,978 DEBUG [rs(jenkins-hbase4.apache.org,34705,1694818872254)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/default/testtb-testExportFileSystemState/f783f80007700e62158bcd6f0e195070/.tmp/cf/fef90c71ee564356a0d73eca54807761 as hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/default/testtb-testExportFileSystemState/f783f80007700e62158bcd6f0e195070/cf/fef90c71ee564356a0d73eca54807761 2023-09-15 23:01:37,986 INFO [rs(jenkins-hbase4.apache.org,41413,1694818872288)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/default/testtb-testExportFileSystemState/cabb8bcdcb03b29f02722bf423e330b2/cf/ae881a4336284647be03d6dc5a3d15b1, entries=46, sequenceid=6, filesize=12.7 K 2023-09-15 23:01:37,986 INFO [rs(jenkins-hbase4.apache.org,34705,1694818872254)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/default/testtb-testExportFileSystemState/f783f80007700e62158bcd6f0e195070/cf/fef90c71ee564356a0d73eca54807761, entries=4, sequenceid=6, filesize=5.6 K 2023-09-15 23:01:37,988 INFO [rs(jenkins-hbase4.apache.org,34705,1694818872254)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for f783f80007700e62158bcd6f0e195070 in 74ms, sequenceid=6, compaction requested=false 2023-09-15 23:01:37,988 INFO [rs(jenkins-hbase4.apache.org,41413,1694818872288)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for cabb8bcdcb03b29f02722bf423e330b2 in 73ms, sequenceid=6, compaction requested=false 2023-09-15 23:01:37,989 DEBUG [rs(jenkins-hbase4.apache.org,34705,1694818872254)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for f783f80007700e62158bcd6f0e195070: 2023-09-15 23:01:37,989 DEBUG [rs(jenkins-hbase4.apache.org,41413,1694818872288)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for cabb8bcdcb03b29f02722bf423e330b2: 2023-09-15 23:01:37,990 DEBUG [rs(jenkins-hbase4.apache.org,34705,1694818872254)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1694818896808.f783f80007700e62158bcd6f0e195070.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-09-15 23:01:37,990 DEBUG [rs(jenkins-hbase4.apache.org,41413,1694818872288)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1694818896808.cabb8bcdcb03b29f02722bf423e330b2.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-09-15 23:01:37,990 DEBUG [rs(jenkins-hbase4.apache.org,34705,1694818872254)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-15 23:01:37,990 DEBUG [rs(jenkins-hbase4.apache.org,41413,1694818872288)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-15 23:01:37,990 DEBUG [rs(jenkins-hbase4.apache.org,34705,1694818872254)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/default/testtb-testExportFileSystemState/f783f80007700e62158bcd6f0e195070/cf/fef90c71ee564356a0d73eca54807761] hfiles 2023-09-15 23:01:37,990 DEBUG [rs(jenkins-hbase4.apache.org,41413,1694818872288)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/default/testtb-testExportFileSystemState/cabb8bcdcb03b29f02722bf423e330b2/cf/ae881a4336284647be03d6dc5a3d15b1] hfiles 2023-09-15 23:01:37,990 DEBUG [rs(jenkins-hbase4.apache.org,41413,1694818872288)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/default/testtb-testExportFileSystemState/cabb8bcdcb03b29f02722bf423e330b2/cf/ae881a4336284647be03d6dc5a3d15b1 for snapshot=snaptb0-testExportFileSystemState 2023-09-15 23:01:37,990 DEBUG [rs(jenkins-hbase4.apache.org,34705,1694818872254)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/default/testtb-testExportFileSystemState/f783f80007700e62158bcd6f0e195070/cf/fef90c71ee564356a0d73eca54807761 for snapshot=snaptb0-testExportFileSystemState 2023-09-15 23:01:38,005 DEBUG [rs(jenkins-hbase4.apache.org,34705,1694818872254)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1694818896808.f783f80007700e62158bcd6f0e195070. completed. 2023-09-15 23:01:38,005 DEBUG [rs(jenkins-hbase4.apache.org,34705,1694818872254)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1694818896808.f783f80007700e62158bcd6f0e195070. 2023-09-15 23:01:38,005 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-15 23:01:38,005 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-15 23:01:38,005 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:01:38,005 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-09-15 23:01:38,005 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,34705,1694818872254' in zk 2023-09-15 23:01:38,007 DEBUG [rs(jenkins-hbase4.apache.org,41413,1694818872288)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1694818896808.cabb8bcdcb03b29f02722bf423e330b2. completed. 2023-09-15 23:01:38,007 DEBUG [rs(jenkins-hbase4.apache.org,41413,1694818872288)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1694818896808.cabb8bcdcb03b29f02722bf423e330b2. 2023-09-15 23:01:38,007 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-15 23:01:38,007 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-15 23:01:38,007 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:01:38,007 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-09-15 23:01:38,007 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,41413,1694818872288' in zk 2023-09-15 23:01:38,016 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-09-15 23:01:38,016 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:01:38,016 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-15 23:01:38,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:01:38,016 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-09-15 23:01:38,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-15 23:01:38,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-15 23:01:38,019 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-09-15 23:01:38,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-15 23:01:38,019 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-15 23:01:38,019 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:01:38,019 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-09-15 23:01:38,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-15 23:01:38,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-15 23:01:38,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:01:38,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:01:38,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33655,1694818872204 2023-09-15 23:01:38,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-15 23:01:38,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-15 23:01:38,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:01:38,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:01:38,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33655,1694818872204 2023-09-15 23:01:38,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,34705,1694818872254': 2023-09-15 23:01:38,023 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34705,1694818872254' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-09-15 23:01:38,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:01:38,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-15 23:01:38,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-15 23:01:38,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-15 23:01:38,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-15 23:01:38,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-15 23:01:38,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:01:38,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:01:38,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33655,1694818872204 2023-09-15 23:01:38,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-15 23:01:38,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-15 23:01:38,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:01:38,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:01:38,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33655,1694818872204 2023-09-15 23:01:38,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,41413,1694818872288': 2023-09-15 23:01:38,027 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41413,1694818872288' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-09-15 23:01:38,027 INFO [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemState' execution completed 2023-09-15 23:01:38,027 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-15 23:01:38,027 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-15 23:01:38,027 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemState 2023-09-15 23:01:38,027 INFO [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-15 23:01:38,029 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:41413-0x100b1d2daa90003, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-15 23:01:38,029 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:33655-0x100b1d2daa90001, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-15 23:01:38,029 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:34705-0x100b1d2daa90002, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-15 23:01:38,029 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:33655-0x100b1d2daa90001, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 23:01:38,029 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-15 23:01:38,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-15 23:01:38,029 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-15 23:01:38,029 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:34705-0x100b1d2daa90002, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 23:01:38,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-15 23:01:38,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-15 23:01:38,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-15 23:01:38,029 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-15 23:01:38,029 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-15 23:01:38,029 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:41413-0x100b1d2daa90003, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 23:01:38,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-15 23:01:38,030 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 23:01:38,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 23:01:38,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-15 23:01:38,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-15 23:01:38,029 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:01:38,030 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 23:01:38,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 23:01:38,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-15 23:01:38,030 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:01:38,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-15 23:01:38,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-15 23:01:38,030 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 23:01:38,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 23:01:38,031 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33655,1694818872204 2023-09-15 23:01:38,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-15 23:01:38,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-15 23:01:38,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-15 23:01:38,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:01:38,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:01:38,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33655,1694818872204 2023-09-15 23:01:38,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-15 23:01:38,032 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:01:38,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-15 23:01:38,033 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:01:38,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:01:38,033 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33655,1694818872204 2023-09-15 23:01:38,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:01:38,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33655,1694818872204 2023-09-15 23:01:38,036 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33655,1694818872204 2023-09-15 23:01:38,036 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-15 23:01:38,036 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:01:38,036 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:34705-0x100b1d2daa90002, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 23:01:38,036 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-15 23:01:38,036 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:33655-0x100b1d2daa90001, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 23:01:38,036 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:41413-0x100b1d2daa90003, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 23:01:38,038 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:33655-0x100b1d2daa90001, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 23:01:38,038 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 23:01:38,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 23:01:38,038 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:41413-0x100b1d2daa90003, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 23:01:38,038 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 23:01:38,036 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 23:01:38,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 23:01:38,036 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:34705-0x100b1d2daa90002, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 23:01:38,036 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemState 2023-09-15 23:01:38,038 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 23:01:38,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 23:01:38,036 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:01:38,038 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-09-15 23:01:38,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 23:01:38,039 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-15 23:01:38,039 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemState 2023-09-15 23:01:38,039 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 23:01:38,039 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-15 23:01:38,039 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33655,1694818872204 2023-09-15 23:01:38,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 23:01:38,039 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 23:01:38,039 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-15 23:01:38,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 23:01:38,039 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:01:38,039 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:01:38,039 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-15 23:01:38,039 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-15 23:01:38,041 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230915e98c911e6a3b4943b84dce1a421b30c4, hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230915b49e7f96357a4a439e5c4f3b86a82810] mob files 2023-09-15 23:01:38,041 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230915e98c911e6a3b4943b84dce1a421b30c4 2023-09-15 23:01:38,041 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230915b49e7f96357a4a439e5c4f3b86a82810 2023-09-15 23:01:38,055 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemState 2023-09-15 23:01:38,056 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-09-15 23:01:38,083 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState to hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-09-15 23:01:38,083 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-09-15 23:01:38,084 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-09-15 23:01:38,084 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-09-15 23:01:38,084 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1694818897857Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1694818898055 (+198 ms)Consolidate snapshot: snaptb0-testExportFileSystemState at 1694818898055Loading Region manifests for snaptb0-testExportFileSystemState at 1694818898055Writing data manifest for snaptb0-testExportFileSystemState at 1694818898061 (+6 ms)Verifying snapshot: snaptb0-testExportFileSystemState at 1694818898074 (+13 ms)Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1694818898083 (+9 ms) 2023-09-15 23:01:38,087 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=35, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-15 23:01:38,089 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=35, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 228 msec 2023-09-15 23:01:38,166 DEBUG [Listener at jenkins-hbase4.apache.org/46629] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-15 23:01:38,167 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-15 23:01:38,167 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-15 23:01:38,167 INFO [Listener at jenkins-hbase4.apache.org/46629] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/export-test/export-1694818898167 2023-09-15 23:01:38,168 INFO [Listener at jenkins-hbase4.apache.org/46629] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:44545, tgtDir=hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/export-test/export-1694818898167, rawTgtDir=hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/export-test/export-1694818898167, srcFsUri=hdfs://localhost:44545, srcDir=hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64 2023-09-15 23:01:38,198 DEBUG [Listener at jenkins-hbase4.apache.org/46629] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:44545, inputRoot=hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64 2023-09-15 23:01:38,198 DEBUG [Listener at jenkins-hbase4.apache.org/46629] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1070007360_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/export-test/export-1694818898167, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/export-test/export-1694818898167/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-09-15 23:01:38,198 INFO [Listener at jenkins-hbase4.apache.org/46629] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:44545, inputRoot=hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64, snapshotDir=hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.hbase-snapshot/snaptb0-testExportFileSystemState. 2023-09-15 23:01:38,210 INFO [Listener at jenkins-hbase4.apache.org/46629] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.hbase-snapshot/snaptb0-testExportFileSystemState to hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/export-test/export-1694818898167/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-09-15 23:01:38,245 DEBUG [Listener at jenkins-hbase4.apache.org/46629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-15 23:01:38,246 DEBUG [Listener at jenkins-hbase4.apache.org/46629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-15 23:01:38,246 DEBUG [Listener at jenkins-hbase4.apache.org/46629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-15 23:01:38,246 DEBUG [Listener at jenkins-hbase4.apache.org/46629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-15 23:01:39,174 DEBUG [Listener at jenkins-hbase4.apache.org/46629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c5e9ebbf-ce0f-c6b3-3dce-6299f7b47f51/hadoop-5757340517003824019.jar 2023-09-15 23:01:39,175 DEBUG [Listener at jenkins-hbase4.apache.org/46629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-15 23:01:39,175 DEBUG [Listener at jenkins-hbase4.apache.org/46629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-15 23:01:39,242 DEBUG [Listener at jenkins-hbase4.apache.org/46629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c5e9ebbf-ce0f-c6b3-3dce-6299f7b47f51/hadoop-2783298748634182331.jar 2023-09-15 23:01:39,243 DEBUG [Listener at jenkins-hbase4.apache.org/46629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-15 23:01:39,243 DEBUG [Listener at jenkins-hbase4.apache.org/46629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-15 23:01:39,244 DEBUG [Listener at jenkins-hbase4.apache.org/46629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-15 23:01:39,244 DEBUG [Listener at jenkins-hbase4.apache.org/46629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-15 23:01:39,245 DEBUG [Listener at jenkins-hbase4.apache.org/46629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-15 23:01:39,245 DEBUG [Listener at jenkins-hbase4.apache.org/46629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-15 23:01:39,245 DEBUG [Listener at jenkins-hbase4.apache.org/46629] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-15 23:01:39,246 DEBUG [Listener at jenkins-hbase4.apache.org/46629] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-15 23:01:39,246 DEBUG [Listener at jenkins-hbase4.apache.org/46629] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-15 23:01:39,247 DEBUG [Listener at jenkins-hbase4.apache.org/46629] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-15 23:01:39,247 DEBUG [Listener at jenkins-hbase4.apache.org/46629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-15 23:01:39,248 DEBUG [Listener at jenkins-hbase4.apache.org/46629] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-15 23:01:39,248 DEBUG [Listener at jenkins-hbase4.apache.org/46629] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-15 23:01:39,248 DEBUG [Listener at jenkins-hbase4.apache.org/46629] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-15 23:01:39,249 DEBUG [Listener at jenkins-hbase4.apache.org/46629] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-15 23:01:39,249 DEBUG [Listener at jenkins-hbase4.apache.org/46629] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-15 23:01:39,250 DEBUG [Listener at jenkins-hbase4.apache.org/46629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-15 23:01:39,250 DEBUG [Listener at jenkins-hbase4.apache.org/46629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-15 23:01:39,251 DEBUG [Listener at jenkins-hbase4.apache.org/46629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-15 23:01:39,251 DEBUG [Listener at jenkins-hbase4.apache.org/46629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-15 23:01:39,251 DEBUG [Listener at jenkins-hbase4.apache.org/46629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-15 23:01:39,252 DEBUG [Listener at jenkins-hbase4.apache.org/46629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-15 23:01:39,253 DEBUG [Listener at jenkins-hbase4.apache.org/46629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-15 23:01:40,115 WARN [Listener at jenkins-hbase4.apache.org/46629] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-15 23:01:40,118 INFO [Listener at jenkins-hbase4.apache.org/46629] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemState' hfile list 2023-09-15 23:01:40,120 DEBUG [Listener at jenkins-hbase4.apache.org/46629] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-09-15 23:01:40,971 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-15 23:01:40,971 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-15 23:01:40,979 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694818878578_0001_000001 (auth:SIMPLE) 2023-09-15 23:01:41,579 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694818878578_0002_000001 (auth:SIMPLE) 2023-09-15 23:01:42,084 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-15 23:01:45,584 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694818878578_0002_000001 (auth:SIMPLE) 2023-09-15 23:01:47,815 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694818878578_0002_000001 (auth:SIMPLE) 2023-09-15 23:01:51,063 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694818878578_0002_000001 (auth:SIMPLE) 2023-09-15 23:01:52,311 INFO [Listener at jenkins-hbase4.apache.org/46629] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-15 23:01:52,312 INFO [Listener at jenkins-hbase4.apache.org/46629] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-15 23:01:52,321 INFO [Listener at jenkins-hbase4.apache.org/46629] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemState 2023-09-15 23:01:52,321 INFO [Listener at jenkins-hbase4.apache.org/46629] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-15 23:01:52,321 INFO [Listener at jenkins-hbase4.apache.org/46629] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-15 23:01:52,322 DEBUG [Listener at jenkins-hbase4.apache.org/46629] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1896422628_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-09-15 23:01:52,322 DEBUG [Listener at jenkins-hbase4.apache.org/46629] snapshot.TestExportSnapshot(367): hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-09-15 23:01:52,322 DEBUG [Listener at jenkins-hbase4.apache.org/46629] snapshot.TestExportSnapshot(367): hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-09-15 23:01:52,322 DEBUG [Listener at jenkins-hbase4.apache.org/46629] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1896422628_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/export-test/export-1694818898167/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/export-test/export-1694818898167/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-09-15 23:01:52,323 DEBUG [Listener at jenkins-hbase4.apache.org/46629] snapshot.TestExportSnapshot(367): hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/export-test/export-1694818898167/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-09-15 23:01:52,323 DEBUG [Listener at jenkins-hbase4.apache.org/46629] snapshot.TestExportSnapshot(367): hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/export-test/export-1694818898167/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-09-15 23:01:52,330 INFO [Listener at jenkins-hbase4.apache.org/46629] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemState 2023-09-15 23:01:52,331 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemState 2023-09-15 23:01:52,332 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] procedure2.ProcedureExecutor(1028): Stored pid=36, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemState 2023-09-15 23:01:52,336 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-09-15 23:01:52,336 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694818912336"}]},"ts":"1694818912336"} 2023-09-15 23:01:52,338 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLING in hbase:meta 2023-09-15 23:01:52,340 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemState to state=DISABLING 2023-09-15 23:01:52,341 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=f783f80007700e62158bcd6f0e195070, UNASSIGN}, {pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=cabb8bcdcb03b29f02722bf423e330b2, UNASSIGN}] 2023-09-15 23:01:52,343 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=f783f80007700e62158bcd6f0e195070, UNASSIGN 2023-09-15 23:01:52,343 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=cabb8bcdcb03b29f02722bf423e330b2, UNASSIGN 2023-09-15 23:01:52,344 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=f783f80007700e62158bcd6f0e195070, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:01:52,344 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=cabb8bcdcb03b29f02722bf423e330b2, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:01:52,344 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1694818896808.cabb8bcdcb03b29f02722bf423e330b2.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1694818912344"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694818912344"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694818912344"}]},"ts":"1694818912344"} 2023-09-15 23:01:52,344 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1694818896808.f783f80007700e62158bcd6f0e195070.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1694818912344"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694818912344"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694818912344"}]},"ts":"1694818912344"} 2023-09-15 23:01:52,346 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=39, ppid=38, state=RUNNABLE; CloseRegionProcedure cabb8bcdcb03b29f02722bf423e330b2, server=jenkins-hbase4.apache.org,41413,1694818872288}] 2023-09-15 23:01:52,347 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=40, ppid=37, state=RUNNABLE; CloseRegionProcedure f783f80007700e62158bcd6f0e195070, server=jenkins-hbase4.apache.org,34705,1694818872254}] 2023-09-15 23:01:52,437 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-09-15 23:01:52,499 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close cabb8bcdcb03b29f02722bf423e330b2 2023-09-15 23:01:52,499 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing cabb8bcdcb03b29f02722bf423e330b2, disabling compactions & flushes 2023-09-15 23:01:52,499 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1694818896808.cabb8bcdcb03b29f02722bf423e330b2. 2023-09-15 23:01:52,499 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1694818896808.cabb8bcdcb03b29f02722bf423e330b2. 2023-09-15 23:01:52,499 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1694818896808.cabb8bcdcb03b29f02722bf423e330b2. after waiting 0 ms 2023-09-15 23:01:52,499 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1694818896808.cabb8bcdcb03b29f02722bf423e330b2. 2023-09-15 23:01:52,500 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close f783f80007700e62158bcd6f0e195070 2023-09-15 23:01:52,503 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing f783f80007700e62158bcd6f0e195070, disabling compactions & flushes 2023-09-15 23:01:52,503 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1694818896808.f783f80007700e62158bcd6f0e195070. 2023-09-15 23:01:52,503 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1694818896808.f783f80007700e62158bcd6f0e195070. 2023-09-15 23:01:52,503 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1694818896808.f783f80007700e62158bcd6f0e195070. after waiting 0 ms 2023-09-15 23:01:52,503 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1694818896808.f783f80007700e62158bcd6f0e195070. 2023-09-15 23:01:52,509 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/default/testtb-testExportFileSystemState/cabb8bcdcb03b29f02722bf423e330b2/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-15 23:01:52,509 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/default/testtb-testExportFileSystemState/f783f80007700e62158bcd6f0e195070/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-15 23:01:52,509 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-15 23:01:52,510 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1694818896808.cabb8bcdcb03b29f02722bf423e330b2. 2023-09-15 23:01:52,510 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-15 23:01:52,510 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for cabb8bcdcb03b29f02722bf423e330b2: 2023-09-15 23:01:52,511 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1694818896808.f783f80007700e62158bcd6f0e195070. 2023-09-15 23:01:52,511 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for f783f80007700e62158bcd6f0e195070: 2023-09-15 23:01:52,513 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed cabb8bcdcb03b29f02722bf423e330b2 2023-09-15 23:01:52,513 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=cabb8bcdcb03b29f02722bf423e330b2, regionState=CLOSED 2023-09-15 23:01:52,513 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1694818896808.cabb8bcdcb03b29f02722bf423e330b2.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1694818912513"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694818912513"}]},"ts":"1694818912513"} 2023-09-15 23:01:52,513 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed f783f80007700e62158bcd6f0e195070 2023-09-15 23:01:52,514 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=f783f80007700e62158bcd6f0e195070, regionState=CLOSED 2023-09-15 23:01:52,514 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1694818896808.f783f80007700e62158bcd6f0e195070.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1694818912514"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694818912514"}]},"ts":"1694818912514"} 2023-09-15 23:01:52,517 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=39, resume processing ppid=38 2023-09-15 23:01:52,517 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=39, ppid=38, state=SUCCESS; CloseRegionProcedure cabb8bcdcb03b29f02722bf423e330b2, server=jenkins-hbase4.apache.org,41413,1694818872288 in 169 msec 2023-09-15 23:01:52,518 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=40, resume processing ppid=37 2023-09-15 23:01:52,518 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=40, ppid=37, state=SUCCESS; CloseRegionProcedure f783f80007700e62158bcd6f0e195070, server=jenkins-hbase4.apache.org,34705,1694818872254 in 169 msec 2023-09-15 23:01:52,520 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=38, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=cabb8bcdcb03b29f02722bf423e330b2, UNASSIGN in 176 msec 2023-09-15 23:01:52,521 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=37, resume processing ppid=36 2023-09-15 23:01:52,522 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=37, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=f783f80007700e62158bcd6f0e195070, UNASSIGN in 177 msec 2023-09-15 23:01:52,522 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694818912522"}]},"ts":"1694818912522"} 2023-09-15 23:01:52,524 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLED in hbase:meta 2023-09-15 23:01:52,526 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemState to state=DISABLED 2023-09-15 23:01:52,528 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=36, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemState in 195 msec 2023-09-15 23:01:52,638 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-09-15 23:01:52,638 INFO [Listener at jenkins-hbase4.apache.org/46629] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemState, procId: 36 completed 2023-09-15 23:01:52,639 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemState 2023-09-15 23:01:52,640 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] procedure2.ProcedureExecutor(1028): Stored pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-15 23:01:52,642 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-15 23:01:52,643 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemState 2023-09-15 23:01:52,643 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=41, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-15 23:01:52,645 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41413] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemState 2023-09-15 23:01:52,648 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.tmp/data/default/testtb-testExportFileSystemState/f783f80007700e62158bcd6f0e195070 2023-09-15 23:01:52,648 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.tmp/data/default/testtb-testExportFileSystemState/cabb8bcdcb03b29f02722bf423e330b2 2023-09-15 23:01:52,649 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:34705-0x100b1d2daa90002, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-15 23:01:52,649 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:41413-0x100b1d2daa90003, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-15 23:01:52,649 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-15 23:01:52,649 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:33655-0x100b1d2daa90001, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-15 23:01:52,649 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-09-15 23:01:52,649 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-09-15 23:01:52,649 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-09-15 23:01:52,649 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-09-15 23:01:52,651 DEBUG [HFileArchiver-10] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.tmp/data/default/testtb-testExportFileSystemState/cabb8bcdcb03b29f02722bf423e330b2/cf, FileablePath, hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.tmp/data/default/testtb-testExportFileSystemState/cabb8bcdcb03b29f02722bf423e330b2/recovered.edits] 2023-09-15 23:01:52,651 DEBUG [HFileArchiver-9] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.tmp/data/default/testtb-testExportFileSystemState/f783f80007700e62158bcd6f0e195070/cf, FileablePath, hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.tmp/data/default/testtb-testExportFileSystemState/f783f80007700e62158bcd6f0e195070/recovered.edits] 2023-09-15 23:01:52,651 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:41413-0x100b1d2daa90003, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-15 23:01:52,651 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:34705-0x100b1d2daa90002, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-15 23:01:52,651 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-15 23:01:52,651 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-15 23:01:52,651 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:33655-0x100b1d2daa90001, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-15 23:01:52,651 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:34705-0x100b1d2daa90002, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-15 23:01:52,651 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:33655-0x100b1d2daa90001, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-15 23:01:52,657 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:41413-0x100b1d2daa90003, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-15 23:01:52,658 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-09-15 23:01:52,658 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.tmp/data/default/testtb-testExportFileSystemState/cabb8bcdcb03b29f02722bf423e330b2/cf/ae881a4336284647be03d6dc5a3d15b1 to hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/archive/data/default/testtb-testExportFileSystemState/cabb8bcdcb03b29f02722bf423e330b2/cf/ae881a4336284647be03d6dc5a3d15b1 2023-09-15 23:01:52,661 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.tmp/data/default/testtb-testExportFileSystemState/cabb8bcdcb03b29f02722bf423e330b2/recovered.edits/9.seqid to hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/archive/data/default/testtb-testExportFileSystemState/cabb8bcdcb03b29f02722bf423e330b2/recovered.edits/9.seqid 2023-09-15 23:01:52,662 DEBUG [HFileArchiver-10] backup.HFileArchiver(596): Deleted hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.tmp/data/default/testtb-testExportFileSystemState/cabb8bcdcb03b29f02722bf423e330b2 2023-09-15 23:01:52,664 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.tmp/data/default/testtb-testExportFileSystemState/f783f80007700e62158bcd6f0e195070/cf/fef90c71ee564356a0d73eca54807761 to hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/archive/data/default/testtb-testExportFileSystemState/f783f80007700e62158bcd6f0e195070/cf/fef90c71ee564356a0d73eca54807761 2023-09-15 23:01:52,667 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.tmp/data/default/testtb-testExportFileSystemState/f783f80007700e62158bcd6f0e195070/recovered.edits/9.seqid to hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/archive/data/default/testtb-testExportFileSystemState/f783f80007700e62158bcd6f0e195070/recovered.edits/9.seqid 2023-09-15 23:01:52,667 DEBUG [HFileArchiver-9] backup.HFileArchiver(596): Deleted hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.tmp/data/default/testtb-testExportFileSystemState/f783f80007700e62158bcd6f0e195070 2023-09-15 23:01:52,667 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-09-15 23:01:52,668 DEBUG [PEWorker-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-09-15 23:01:52,669 DEBUG [PEWorker-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf] 2023-09-15 23:01:52,672 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230915e98c911e6a3b4943b84dce1a421b30c4 to hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230915e98c911e6a3b4943b84dce1a421b30c4 2023-09-15 23:01:52,673 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230915b49e7f96357a4a439e5c4f3b86a82810 to hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230915b49e7f96357a4a439e5c4f3b86a82810 2023-09-15 23:01:52,674 DEBUG [PEWorker-2] backup.HFileArchiver(596): Deleted hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-09-15 23:01:52,676 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=41, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-15 23:01:52,679 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemState from hbase:meta 2023-09-15 23:01:52,681 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemState' descriptor. 2023-09-15 23:01:52,682 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=41, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-15 23:01:52,682 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemState' from region states. 2023-09-15 23:01:52,682 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,,1694818896808.f783f80007700e62158bcd6f0e195070.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1694818912682"}]},"ts":"9223372036854775807"} 2023-09-15 23:01:52,682 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,1,1694818896808.cabb8bcdcb03b29f02722bf423e330b2.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1694818912682"}]},"ts":"9223372036854775807"} 2023-09-15 23:01:52,684 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-15 23:01:52,684 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => f783f80007700e62158bcd6f0e195070, NAME => 'testtb-testExportFileSystemState,,1694818896808.f783f80007700e62158bcd6f0e195070.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => cabb8bcdcb03b29f02722bf423e330b2, NAME => 'testtb-testExportFileSystemState,1,1694818896808.cabb8bcdcb03b29f02722bf423e330b2.', STARTKEY => '1', ENDKEY => ''}] 2023-09-15 23:01:52,684 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemState' as deleted. 2023-09-15 23:01:52,685 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1694818912685"}]},"ts":"9223372036854775807"} 2023-09-15 23:01:52,686 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemState state from META 2023-09-15 23:01:52,688 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=41, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-15 23:01:52,690 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=41, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemState in 50 msec 2023-09-15 23:01:52,759 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-09-15 23:01:52,760 INFO [Listener at jenkins-hbase4.apache.org/46629] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemState, procId: 41 completed 2023-09-15 23:01:52,768 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemState" 2023-09-15 23:01:52,771 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemState 2023-09-15 23:01:52,772 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemState" 2023-09-15 23:01:52,774 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemState 2023-09-15 23:01:52,802 INFO [Listener at jenkins-hbase4.apache.org/46629] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=760 (was 752) Potentially hanging thread: hconnection-0x78d29e78-shared-pool-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1501995251_1 at /127.0.0.1:55014 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1896422628_17 at /127.0.0.1:55040 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1629749639) connection to jenkins-hbase4.apache.org/172.31.14.131:41997 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: IPC Client (1629749639) connection to jenkins-hbase4.apache.org/172.31.14.131:46629 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1896422628_17 at /127.0.0.1:51238 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x78d29e78-shared-pool-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1896422628_17 at /127.0.0.1:37508 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x78d29e78-shared-pool-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x78d29e78-shared-pool-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1960 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) - Thread LEAK? -, OpenFileDescriptor=935 (was 923) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=194 (was 164) - SystemLoadAverage LEAK? -, ProcessCount=167 (was 167), AvailableMemoryMB=5294 (was 5486) 2023-09-15 23:01:52,802 WARN [Listener at jenkins-hbase4.apache.org/46629] hbase.ResourceChecker(130): Thread=760 is superior to 500 2023-09-15 23:01:52,828 INFO [Listener at jenkins-hbase4.apache.org/46629] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=760, OpenFileDescriptor=935, MaxFileDescriptor=60000, SystemLoadAverage=194, ProcessCount=167, AvailableMemoryMB=5292 2023-09-15 23:01:52,828 WARN [Listener at jenkins-hbase4.apache.org/46629] hbase.ResourceChecker(130): Thread=760 is superior to 500 2023-09-15 23:01:52,830 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-15 23:01:52,832 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] procedure2.ProcedureExecutor(1028): Stored pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testConsecutiveExports 2023-09-15 23:01:52,835 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_PRE_OPERATION 2023-09-15 23:01:52,835 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testConsecutiveExports" procId is: 42 2023-09-15 23:01:52,836 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-15 23:01:52,836 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-09-15 23:01:52,839 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.tmp/data/default/testtb-testConsecutiveExports/ea71f7341677d187d5a63cba9d6f715f 2023-09-15 23:01:52,839 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.tmp/data/default/testtb-testConsecutiveExports/6613a69f1c86c2bb009015471c50c44f 2023-09-15 23:01:52,839 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.tmp/data/default/testtb-testConsecutiveExports/ea71f7341677d187d5a63cba9d6f715f empty. 2023-09-15 23:01:52,839 DEBUG [HFileArchiver-12] backup.HFileArchiver(153): Directory hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.tmp/data/default/testtb-testConsecutiveExports/6613a69f1c86c2bb009015471c50c44f empty. 2023-09-15 23:01:52,840 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.tmp/data/default/testtb-testConsecutiveExports/ea71f7341677d187d5a63cba9d6f715f 2023-09-15 23:01:52,840 DEBUG [HFileArchiver-12] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.tmp/data/default/testtb-testConsecutiveExports/6613a69f1c86c2bb009015471c50c44f 2023-09-15 23:01:52,840 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-09-15 23:01:52,859 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.tmp/data/default/testtb-testConsecutiveExports/.tabledesc/.tableinfo.0000000001 2023-09-15 23:01:52,861 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(7675): creating {ENCODED => 6613a69f1c86c2bb009015471c50c44f, NAME => 'testtb-testConsecutiveExports,1,1694818912830.6613a69f1c86c2bb009015471c50c44f.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.tmp 2023-09-15 23:01:52,861 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(7675): creating {ENCODED => ea71f7341677d187d5a63cba9d6f715f, NAME => 'testtb-testConsecutiveExports,,1694818912830.ea71f7341677d187d5a63cba9d6f715f.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.tmp 2023-09-15 23:01:52,875 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1694818912830.6613a69f1c86c2bb009015471c50c44f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-15 23:01:52,875 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1604): Closing 6613a69f1c86c2bb009015471c50c44f, disabling compactions & flushes 2023-09-15 23:01:52,876 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1694818912830.6613a69f1c86c2bb009015471c50c44f. 2023-09-15 23:01:52,876 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1694818912830.6613a69f1c86c2bb009015471c50c44f. 2023-09-15 23:01:52,876 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1694818912830.6613a69f1c86c2bb009015471c50c44f. after waiting 0 ms 2023-09-15 23:01:52,876 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1694818912830.6613a69f1c86c2bb009015471c50c44f. 2023-09-15 23:01:52,876 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1694818912830.6613a69f1c86c2bb009015471c50c44f. 2023-09-15 23:01:52,876 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1558): Region close journal for 6613a69f1c86c2bb009015471c50c44f: 2023-09-15 23:01:52,877 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1694818912830.ea71f7341677d187d5a63cba9d6f715f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-15 23:01:52,877 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1604): Closing ea71f7341677d187d5a63cba9d6f715f, disabling compactions & flushes 2023-09-15 23:01:52,877 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1694818912830.ea71f7341677d187d5a63cba9d6f715f. 2023-09-15 23:01:52,877 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1694818912830.ea71f7341677d187d5a63cba9d6f715f. 2023-09-15 23:01:52,877 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1694818912830.ea71f7341677d187d5a63cba9d6f715f. after waiting 0 ms 2023-09-15 23:01:52,877 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1694818912830.ea71f7341677d187d5a63cba9d6f715f. 2023-09-15 23:01:52,877 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1694818912830.ea71f7341677d187d5a63cba9d6f715f. 2023-09-15 23:01:52,877 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1558): Region close journal for ea71f7341677d187d5a63cba9d6f715f: 2023-09-15 23:01:52,880 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ADD_TO_META 2023-09-15 23:01:52,881 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1694818912830.6613a69f1c86c2bb009015471c50c44f.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1694818912880"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694818912880"}]},"ts":"1694818912880"} 2023-09-15 23:01:52,881 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1694818912830.ea71f7341677d187d5a63cba9d6f715f.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1694818912880"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694818912880"}]},"ts":"1694818912880"} 2023-09-15 23:01:52,883 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-15 23:01:52,884 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-15 23:01:52,884 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694818912884"}]},"ts":"1694818912884"} 2023-09-15 23:01:52,886 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLING in hbase:meta 2023-09-15 23:01:52,890 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-15 23:01:52,892 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-15 23:01:52,892 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-15 23:01:52,892 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-15 23:01:52,892 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-15 23:01:52,892 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=ea71f7341677d187d5a63cba9d6f715f, ASSIGN}, {pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=6613a69f1c86c2bb009015471c50c44f, ASSIGN}] 2023-09-15 23:01:52,895 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=6613a69f1c86c2bb009015471c50c44f, ASSIGN 2023-09-15 23:01:52,895 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=ea71f7341677d187d5a63cba9d6f715f, ASSIGN 2023-09-15 23:01:52,895 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=ea71f7341677d187d5a63cba9d6f715f, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34705,1694818872254; forceNewPlan=false, retain=false 2023-09-15 23:01:52,895 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=6613a69f1c86c2bb009015471c50c44f, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33655,1694818872204; forceNewPlan=false, retain=false 2023-09-15 23:01:52,937 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-09-15 23:01:53,046 INFO [jenkins-hbase4:44427] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-15 23:01:53,048 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=6613a69f1c86c2bb009015471c50c44f, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33655,1694818872204 2023-09-15 23:01:53,048 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=ea71f7341677d187d5a63cba9d6f715f, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:01:53,048 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1694818912830.6613a69f1c86c2bb009015471c50c44f.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1694818913048"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694818913048"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694818913048"}]},"ts":"1694818913048"} 2023-09-15 23:01:53,049 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1694818912830.ea71f7341677d187d5a63cba9d6f715f.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1694818913048"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694818913048"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694818913048"}]},"ts":"1694818913048"} 2023-09-15 23:01:53,050 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=45, ppid=44, state=RUNNABLE; OpenRegionProcedure 6613a69f1c86c2bb009015471c50c44f, server=jenkins-hbase4.apache.org,33655,1694818872204}] 2023-09-15 23:01:53,051 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=46, ppid=43, state=RUNNABLE; OpenRegionProcedure ea71f7341677d187d5a63cba9d6f715f, server=jenkins-hbase4.apache.org,34705,1694818872254}] 2023-09-15 23:01:53,138 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-09-15 23:01:53,204 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,33655,1694818872204 2023-09-15 23:01:53,204 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-15 23:01:53,208 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48138, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-15 23:01:53,210 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,,1694818912830.ea71f7341677d187d5a63cba9d6f715f. 2023-09-15 23:01:53,211 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => ea71f7341677d187d5a63cba9d6f715f, NAME => 'testtb-testConsecutiveExports,,1694818912830.ea71f7341677d187d5a63cba9d6f715f.', STARTKEY => '', ENDKEY => '1'} 2023-09-15 23:01:53,211 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,,1694818912830.ea71f7341677d187d5a63cba9d6f715f. service=AccessControlService 2023-09-15 23:01:53,211 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-15 23:01:53,211 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports ea71f7341677d187d5a63cba9d6f715f 2023-09-15 23:01:53,211 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1694818912830.ea71f7341677d187d5a63cba9d6f715f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-15 23:01:53,211 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for ea71f7341677d187d5a63cba9d6f715f 2023-09-15 23:01:53,211 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for ea71f7341677d187d5a63cba9d6f715f 2023-09-15 23:01:53,212 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,1,1694818912830.6613a69f1c86c2bb009015471c50c44f. 2023-09-15 23:01:53,212 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 6613a69f1c86c2bb009015471c50c44f, NAME => 'testtb-testConsecutiveExports,1,1694818912830.6613a69f1c86c2bb009015471c50c44f.', STARTKEY => '1', ENDKEY => ''} 2023-09-15 23:01:53,212 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,1,1694818912830.6613a69f1c86c2bb009015471c50c44f. service=AccessControlService 2023-09-15 23:01:53,213 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-15 23:01:53,213 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports 6613a69f1c86c2bb009015471c50c44f 2023-09-15 23:01:53,213 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1694818912830.6613a69f1c86c2bb009015471c50c44f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-15 23:01:53,213 INFO [StoreOpener-ea71f7341677d187d5a63cba9d6f715f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region ea71f7341677d187d5a63cba9d6f715f 2023-09-15 23:01:53,213 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 6613a69f1c86c2bb009015471c50c44f 2023-09-15 23:01:53,213 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 6613a69f1c86c2bb009015471c50c44f 2023-09-15 23:01:53,214 INFO [StoreOpener-6613a69f1c86c2bb009015471c50c44f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 6613a69f1c86c2bb009015471c50c44f 2023-09-15 23:01:53,214 DEBUG [StoreOpener-ea71f7341677d187d5a63cba9d6f715f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/default/testtb-testConsecutiveExports/ea71f7341677d187d5a63cba9d6f715f/cf 2023-09-15 23:01:53,214 DEBUG [StoreOpener-ea71f7341677d187d5a63cba9d6f715f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/default/testtb-testConsecutiveExports/ea71f7341677d187d5a63cba9d6f715f/cf 2023-09-15 23:01:53,215 INFO [StoreOpener-ea71f7341677d187d5a63cba9d6f715f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ea71f7341677d187d5a63cba9d6f715f columnFamilyName cf 2023-09-15 23:01:53,215 DEBUG [StoreOpener-6613a69f1c86c2bb009015471c50c44f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/default/testtb-testConsecutiveExports/6613a69f1c86c2bb009015471c50c44f/cf 2023-09-15 23:01:53,215 DEBUG [StoreOpener-6613a69f1c86c2bb009015471c50c44f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/default/testtb-testConsecutiveExports/6613a69f1c86c2bb009015471c50c44f/cf 2023-09-15 23:01:53,216 INFO [StoreOpener-6613a69f1c86c2bb009015471c50c44f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6613a69f1c86c2bb009015471c50c44f columnFamilyName cf 2023-09-15 23:01:53,216 INFO [StoreOpener-ea71f7341677d187d5a63cba9d6f715f-1] regionserver.HStore(310): Store=ea71f7341677d187d5a63cba9d6f715f/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-15 23:01:53,217 INFO [StoreOpener-6613a69f1c86c2bb009015471c50c44f-1] regionserver.HStore(310): Store=6613a69f1c86c2bb009015471c50c44f/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-15 23:01:53,217 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/default/testtb-testConsecutiveExports/ea71f7341677d187d5a63cba9d6f715f 2023-09-15 23:01:53,218 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/default/testtb-testConsecutiveExports/6613a69f1c86c2bb009015471c50c44f 2023-09-15 23:01:53,218 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/default/testtb-testConsecutiveExports/ea71f7341677d187d5a63cba9d6f715f 2023-09-15 23:01:53,218 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/default/testtb-testConsecutiveExports/6613a69f1c86c2bb009015471c50c44f 2023-09-15 23:01:53,220 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for ea71f7341677d187d5a63cba9d6f715f 2023-09-15 23:01:53,221 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 6613a69f1c86c2bb009015471c50c44f 2023-09-15 23:01:53,223 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/default/testtb-testConsecutiveExports/ea71f7341677d187d5a63cba9d6f715f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-15 23:01:53,224 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened ea71f7341677d187d5a63cba9d6f715f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73546398, jitterRate=0.09592673182487488}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-15 23:01:53,224 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for ea71f7341677d187d5a63cba9d6f715f: 2023-09-15 23:01:53,225 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,,1694818912830.ea71f7341677d187d5a63cba9d6f715f., pid=46, masterSystemTime=1694818913204 2023-09-15 23:01:53,225 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/default/testtb-testConsecutiveExports/6613a69f1c86c2bb009015471c50c44f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-15 23:01:53,226 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 6613a69f1c86c2bb009015471c50c44f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71421480, jitterRate=0.0642629861831665}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-15 23:01:53,226 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 6613a69f1c86c2bb009015471c50c44f: 2023-09-15 23:01:53,227 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,1,1694818912830.6613a69f1c86c2bb009015471c50c44f., pid=45, masterSystemTime=1694818913204 2023-09-15 23:01:53,227 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,,1694818912830.ea71f7341677d187d5a63cba9d6f715f. 2023-09-15 23:01:53,230 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,,1694818912830.ea71f7341677d187d5a63cba9d6f715f. 2023-09-15 23:01:53,231 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=ea71f7341677d187d5a63cba9d6f715f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:01:53,231 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,,1694818912830.ea71f7341677d187d5a63cba9d6f715f.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1694818913231"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1694818913231"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1694818913231"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1694818913231"}]},"ts":"1694818913231"} 2023-09-15 23:01:53,232 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,1,1694818912830.6613a69f1c86c2bb009015471c50c44f. 2023-09-15 23:01:53,233 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,1,1694818912830.6613a69f1c86c2bb009015471c50c44f. 2023-09-15 23:01:53,233 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=6613a69f1c86c2bb009015471c50c44f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33655,1694818872204 2023-09-15 23:01:53,233 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,1,1694818912830.6613a69f1c86c2bb009015471c50c44f.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1694818913233"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1694818913233"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1694818913233"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1694818913233"}]},"ts":"1694818913233"} 2023-09-15 23:01:53,236 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=46, resume processing ppid=43 2023-09-15 23:01:53,236 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=46, ppid=43, state=SUCCESS; OpenRegionProcedure ea71f7341677d187d5a63cba9d6f715f, server=jenkins-hbase4.apache.org,34705,1694818872254 in 183 msec 2023-09-15 23:01:53,237 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=45, resume processing ppid=44 2023-09-15 23:01:53,237 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=45, ppid=44, state=SUCCESS; OpenRegionProcedure 6613a69f1c86c2bb009015471c50c44f, server=jenkins-hbase4.apache.org,33655,1694818872204 in 185 msec 2023-09-15 23:01:53,238 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=43, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=ea71f7341677d187d5a63cba9d6f715f, ASSIGN in 344 msec 2023-09-15 23:01:53,239 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=44, resume processing ppid=42 2023-09-15 23:01:53,239 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=44, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=6613a69f1c86c2bb009015471c50c44f, ASSIGN in 345 msec 2023-09-15 23:01:53,240 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-15 23:01:53,240 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694818913240"}]},"ts":"1694818913240"} 2023-09-15 23:01:53,242 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLED in hbase:meta 2023-09-15 23:01:53,245 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_POST_OPERATION 2023-09-15 23:01:53,245 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testConsecutiveExports jenkins: RWXCA 2023-09-15 23:01:53,247 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41413] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-09-15 23:01:53,249 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:34705-0x100b1d2daa90002, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-15 23:01:53,249 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-15 23:01:53,249 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:33655-0x100b1d2daa90001, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-15 23:01:53,249 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:41413-0x100b1d2daa90003, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-15 23:01:53,251 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-09-15 23:01:53,251 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-09-15 23:01:53,251 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-09-15 23:01:53,251 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-09-15 23:01:53,253 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=42, state=SUCCESS; CreateTableProcedure table=testtb-testConsecutiveExports in 420 msec 2023-09-15 23:01:53,439 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-09-15 23:01:53,440 INFO [Listener at jenkins-hbase4.apache.org/46629] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testConsecutiveExports, procId: 42 completed 2023-09-15 23:01:53,442 DEBUG [Listener at jenkins-hbase4.apache.org/46629] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-09-15 23:01:53,442 DEBUG [Listener at jenkins-hbase4.apache.org/46629] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1694818912830.ea71f7341677d187d5a63cba9d6f715f. 2023-09-15 23:01:53,444 INFO [Listener at jenkins-hbase4.apache.org/46629] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-15 23:01:53,452 DEBUG [hconnection-0x3d72c724-shared-pool-17] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-15 23:01:53,457 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48154, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-15 23:01:53,461 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-15 23:01:53,461 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1694818913461 (current time:1694818913461). 2023-09-15 23:01:53,461 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-15 23:01:53,462 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] zookeeper.ReadOnlyZKClient(139): Connect 0x60129a5e to 127.0.0.1:51149 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-15 23:01:53,471 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4cf82563, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-15 23:01:53,472 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-15 23:01:53,475 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36794, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-15 23:01:53,476 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x60129a5e to 127.0.0.1:51149 2023-09-15 23:01:53,476 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-15 23:01:53,477 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] zookeeper.ReadOnlyZKClient(139): Connect 0x09ebca89 to 127.0.0.1:51149 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-15 23:01:53,482 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7d5f7180, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-15 23:01:53,484 DEBUG [hconnection-0x70018075-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-15 23:01:53,487 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36802, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-15 23:01:53,491 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x09ebca89 to 127.0.0.1:51149 2023-09-15 23:01:53,491 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-15 23:01:53,491 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-09-15 23:01:53,492 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-15 23:01:53,492 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-15 23:01:53,494 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] procedure2.ProcedureExecutor(1028): Stored pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-15 23:01:53,495 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-15 23:01:53,496 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=47, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1694819513496 2023-09-15 23:01:53,496 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-09-15 23:01:53,496 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-15 23:01:53,497 DEBUG [Listener at jenkins-hbase4.apache.org/46629] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-15 23:01:53,498 DEBUG [Listener at jenkins-hbase4.apache.org/46629] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-15 23:01:53,498 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-15 23:01:53,498 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=47, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-15 23:01:53,500 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=47, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 5 msec 2023-09-15 23:01:53,501 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-15 23:01:53,501 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1694819513501 2023-09-15 23:01:53,514 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testConsecutiveExports 2023-09-15 23:01:53,514 INFO [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testConsecutiveExports' 2023-09-15 23:01:53,514 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-15 23:01:53,516 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' 2023-09-15 23:01:53,516 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-09-15 23:01:53,516 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-15 23:01:53,516 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-15 23:01:53,519 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:34705-0x100b1d2daa90002, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 23:01:53,519 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:41413-0x100b1d2daa90003, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 23:01:53,519 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 23:01:53,519 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 23:01:53,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 23:01:53,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 23:01:53,519 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:01:53,519 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:33655-0x100b1d2daa90001, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 23:01:53,519 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 23:01:53,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 23:01:53,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-15 23:01:53,519 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:01:53,519 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33655,1694818872204 2023-09-15 23:01:53,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-15 23:01:53,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-15 23:01:53,520 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34705-0x100b1d2daa90002, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-15 23:01:53,520 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41413-0x100b1d2daa90003, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-15 23:01:53,520 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33655-0x100b1d2daa90001, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-15 23:01:53,520 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33655,1694818872204 2023-09-15 23:01:53,520 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-15 23:01:53,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-09-15 23:01:53,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-15 23:01:53,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-09-15 23:01:53,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-15 23:01:53,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-09-15 23:01:53,520 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-15 23:01:53,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-15 23:01:53,520 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-15 23:01:53,521 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-15 23:01:53,521 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-09-15 23:01:53,521 DEBUG [member: 'jenkins-hbase4.apache.org,33655,1694818872204' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-15 23:01:53,521 DEBUG [member: 'jenkins-hbase4.apache.org,33655,1694818872204' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-15 23:01:53,523 DEBUG [member: 'jenkins-hbase4.apache.org,33655,1694818872204' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-15 23:01:53,523 DEBUG [member: 'jenkins-hbase4.apache.org,33655,1694818872204' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-09-15 23:01:53,523 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-09-15 23:01:53,523 DEBUG [member: 'jenkins-hbase4.apache.org,33655,1694818872204' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33655,1694818872204' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-09-15 23:01:53,523 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-09-15 23:01:53,523 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-15 23:01:53,524 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-15 23:01:53,524 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-15 23:01:53,525 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-15 23:01:53,525 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-09-15 23:01:53,525 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-15 23:01:53,525 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34705,1694818872254' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-09-15 23:01:53,528 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-15 23:01:53,528 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-09-15 23:01:53,528 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41413,1694818872288' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-09-15 23:01:53,529 DEBUG [member: 'jenkins-hbase4.apache.org,33655,1694818872204' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-15 23:01:53,530 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33655,1694818872204 2023-09-15 23:01:53,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33655,1694818872204 2023-09-15 23:01:53,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-15 23:01:53,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-15 23:01:53,530 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-15 23:01:53,531 DEBUG [member: 'jenkins-hbase4.apache.org,33655,1694818872204' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33655-0x100b1d2daa90001, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-15 23:01:53,531 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-15 23:01:53,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-15 23:01:53,530 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:01:53,531 DEBUG [member: 'jenkins-hbase4.apache.org,33655,1694818872204' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-15 23:01:53,531 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41413-0x100b1d2daa90003, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-15 23:01:53,531 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34705-0x100b1d2daa90002, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-15 23:01:53,531 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-15 23:01:53,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-15 23:01:53,531 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-15 23:01:53,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-15 23:01:53,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:01:53,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:01:53,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33655,1694818872204 2023-09-15 23:01:53,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-15 23:01:53,533 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33655,1694818872204' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-09-15 23:01:53,533 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1852104b[Count = 1] remaining members to acquire global barrier 2023-09-15 23:01:53,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:01:53,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-15 23:01:53,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-15 23:01:53,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-15 23:01:53,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-15 23:01:53,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-15 23:01:53,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:01:53,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:01:53,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33655,1694818872204 2023-09-15 23:01:53,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-15 23:01:53,535 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34705,1694818872254' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-09-15 23:01:53,535 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1852104b[Count = 0] remaining members to acquire global barrier 2023-09-15 23:01:53,535 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-09-15 23:01:53,535 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-15 23:01:53,537 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:41413-0x100b1d2daa90003, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-15 23:01:53,537 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:33655-0x100b1d2daa90001, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-15 23:01:53,537 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:34705-0x100b1d2daa90002, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-15 23:01:53,537 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-15 23:01:53,537 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-15 23:01:53,537 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33655,1694818872204 2023-09-15 23:01:53,537 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-15 23:01:53,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-15 23:01:53,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-15 23:01:53,537 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-15 23:01:53,537 DEBUG [member: 'jenkins-hbase4.apache.org,33655,1694818872204' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-15 23:01:53,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-15 23:01:53,537 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:01:53,537 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-15 23:01:53,537 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-15 23:01:53,537 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-15 23:01:53,537 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-09-15 23:01:53,537 DEBUG [rs(jenkins-hbase4.apache.org,33655,1694818872204)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1694818912830.6613a69f1c86c2bb009015471c50c44f. 2023-09-15 23:01:53,537 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,41413,1694818872288' in zk 2023-09-15 23:01:53,537 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-15 23:01:53,538 DEBUG [rs(jenkins-hbase4.apache.org,33655,1694818872204)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1694818912830.6613a69f1c86c2bb009015471c50c44f. started... 2023-09-15 23:01:53,537 DEBUG [member: 'jenkins-hbase4.apache.org,33655,1694818872204' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-15 23:01:53,538 DEBUG [member: 'jenkins-hbase4.apache.org,33655,1694818872204' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-15 23:01:53,537 DEBUG [rs(jenkins-hbase4.apache.org,34705,1694818872254)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1694818912830.ea71f7341677d187d5a63cba9d6f715f. 2023-09-15 23:01:53,538 DEBUG [rs(jenkins-hbase4.apache.org,34705,1694818872254)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1694818912830.ea71f7341677d187d5a63cba9d6f715f. started... 2023-09-15 23:01:53,539 DEBUG [rs(jenkins-hbase4.apache.org,33655,1694818872204)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 6613a69f1c86c2bb009015471c50c44f: 2023-09-15 23:01:53,539 DEBUG [rs(jenkins-hbase4.apache.org,34705,1694818872254)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for ea71f7341677d187d5a63cba9d6f715f: 2023-09-15 23:01:53,539 DEBUG [rs(jenkins-hbase4.apache.org,33655,1694818872204)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1694818912830.6613a69f1c86c2bb009015471c50c44f.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-09-15 23:01:53,539 DEBUG [rs(jenkins-hbase4.apache.org,34705,1694818872254)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1694818912830.ea71f7341677d187d5a63cba9d6f715f.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-09-15 23:01:53,539 DEBUG [rs(jenkins-hbase4.apache.org,33655,1694818872204)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-15 23:01:53,539 DEBUG [rs(jenkins-hbase4.apache.org,34705,1694818872254)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-15 23:01:53,540 DEBUG [rs(jenkins-hbase4.apache.org,33655,1694818872204)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-15 23:01:53,540 DEBUG [rs(jenkins-hbase4.apache.org,34705,1694818872254)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-15 23:01:53,548 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-09-15 23:01:53,548 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-15 23:01:53,548 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-09-15 23:01:53,571 DEBUG [rs(jenkins-hbase4.apache.org,33655,1694818872204)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1694818912830.6613a69f1c86c2bb009015471c50c44f. completed. 2023-09-15 23:01:53,571 DEBUG [rs(jenkins-hbase4.apache.org,33655,1694818872204)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1694818912830.6613a69f1c86c2bb009015471c50c44f. 2023-09-15 23:01:53,571 DEBUG [member: 'jenkins-hbase4.apache.org,33655,1694818872204' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-15 23:01:53,571 DEBUG [rs(jenkins-hbase4.apache.org,34705,1694818872254)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1694818912830.ea71f7341677d187d5a63cba9d6f715f. completed. 2023-09-15 23:01:53,571 DEBUG [member: 'jenkins-hbase4.apache.org,33655,1694818872204' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-15 23:01:53,572 DEBUG [member: 'jenkins-hbase4.apache.org,33655,1694818872204' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33655,1694818872204 2023-09-15 23:01:53,572 DEBUG [rs(jenkins-hbase4.apache.org,34705,1694818872254)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1694818912830.ea71f7341677d187d5a63cba9d6f715f. 2023-09-15 23:01:53,572 DEBUG [member: 'jenkins-hbase4.apache.org,33655,1694818872204' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-09-15 23:01:53,572 DEBUG [member: 'jenkins-hbase4.apache.org,33655,1694818872204' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,33655,1694818872204' in zk 2023-09-15 23:01:53,572 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-15 23:01:53,572 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-15 23:01:53,572 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:01:53,572 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-09-15 23:01:53,572 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,34705,1694818872254' in zk 2023-09-15 23:01:53,575 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33655,1694818872204 2023-09-15 23:01:53,575 DEBUG [member: 'jenkins-hbase4.apache.org,33655,1694818872204' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-09-15 23:01:53,575 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:01:53,575 DEBUG [member: 'jenkins-hbase4.apache.org,33655,1694818872204' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-15 23:01:53,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33655,1694818872204 2023-09-15 23:01:53,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-15 23:01:53,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-15 23:01:53,575 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-09-15 23:01:53,576 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-15 23:01:53,575 DEBUG [member: 'jenkins-hbase4.apache.org,33655,1694818872204' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-09-15 23:01:53,576 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-09-15 23:01:53,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-15 23:01:53,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-15 23:01:53,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-15 23:01:53,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:01:53,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:01:53,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33655,1694818872204 2023-09-15 23:01:53,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-15 23:01:53,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-15 23:01:53,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:01:53,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:01:53,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33655,1694818872204 2023-09-15 23:01:53,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,33655,1694818872204': 2023-09-15 23:01:53,582 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33655,1694818872204' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-09-15 23:01:53,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:01:53,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-15 23:01:53,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-15 23:01:53,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-15 23:01:53,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-15 23:01:53,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-15 23:01:53,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:01:53,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:01:53,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33655,1694818872204 2023-09-15 23:01:53,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-15 23:01:53,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-15 23:01:53,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:01:53,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:01:53,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33655,1694818872204 2023-09-15 23:01:53,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,34705,1694818872254': 2023-09-15 23:01:53,586 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34705,1694818872254' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-09-15 23:01:53,586 INFO [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testConsecutiveExports' execution completed 2023-09-15 23:01:53,586 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-15 23:01:53,586 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-15 23:01:53,586 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testConsecutiveExports 2023-09-15 23:01:53,586 INFO [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-15 23:01:53,588 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:41413-0x100b1d2daa90003, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-15 23:01:53,588 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-15 23:01:53,588 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:41413-0x100b1d2daa90003, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 23:01:53,588 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-15 23:01:53,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-15 23:01:53,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-15 23:01:53,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-15 23:01:53,588 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:34705-0x100b1d2daa90002, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-15 23:01:53,588 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:33655-0x100b1d2daa90001, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-15 23:01:53,589 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-15 23:01:53,589 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:34705-0x100b1d2daa90002, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 23:01:53,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-15 23:01:53,589 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:01:53,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-15 23:01:53,589 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-15 23:01:53,589 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:33655-0x100b1d2daa90001, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 23:01:53,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-15 23:01:53,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-15 23:01:53,589 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:01:53,589 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 23:01:53,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 23:01:53,590 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 23:01:53,589 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 23:01:53,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 23:01:53,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 23:01:53,590 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33655,1694818872204 2023-09-15 23:01:53,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-15 23:01:53,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-15 23:01:53,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-15 23:01:53,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-15 23:01:53,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-15 23:01:53,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-15 23:01:53,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:01:53,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:01:53,592 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:01:53,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33655,1694818872204 2023-09-15 23:01:53,592 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:01:53,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-15 23:01:53,593 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33655,1694818872204 2023-09-15 23:01:53,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-15 23:01:53,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:01:53,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:01:53,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33655,1694818872204 2023-09-15 23:01:53,596 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33655,1694818872204 2023-09-15 23:01:53,596 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-15 23:01:53,596 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:01:53,596 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:41413-0x100b1d2daa90003, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 23:01:53,596 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:34705-0x100b1d2daa90002, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 23:01:53,596 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 23:01:53,596 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 23:01:53,596 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-15 23:01:53,596 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:33655-0x100b1d2daa90001, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 23:01:53,596 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testConsecutiveExports 2023-09-15 23:01:53,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 23:01:53,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 23:01:53,596 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:34705-0x100b1d2daa90002, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 23:01:53,596 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:41413-0x100b1d2daa90003, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 23:01:53,598 DEBUG [Listener at jenkins-hbase4.apache.org/46629] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-15 23:01:53,596 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:01:53,598 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-15 23:01:53,598 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 23:01:53,598 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-09-15 23:01:53,597 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:33655-0x100b1d2daa90001, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 23:01:53,598 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 23:01:53,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 23:01:53,597 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 23:01:53,598 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-09-15 23:01:53,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 23:01:53,598 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33655,1694818872204 2023-09-15 23:01:53,598 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-15 23:01:53,598 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-15 23:01:53,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 23:01:53,599 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:01:53,599 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:01:53,599 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-15 23:01:53,599 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-15 23:01:53,599 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-09-15 23:01:53,599 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-09-15 23:01:53,599 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 23:01:53,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 23:01:53,599 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-15 23:01:53,599 DEBUG [Listener at jenkins-hbase4.apache.org/46629] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-15 23:01:53,609 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testConsecutiveExports 2023-09-15 23:01:53,610 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-09-15 23:01:53,632 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports to hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.hbase-snapshot/emptySnaptb0-testConsecutiveExports 2023-09-15 23:01:53,633 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-09-15 23:01:53,633 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-09-15 23:01:53,633 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-09-15 23:01:53,634 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1694818913496Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1694818913609 (+113 ms)Consolidate snapshot: emptySnaptb0-testConsecutiveExports at 1694818913609Loading Region manifests for emptySnaptb0-testConsecutiveExports at 1694818913609Writing data manifest for emptySnaptb0-testConsecutiveExports at 1694818913615 (+6 ms)Verifying snapshot: emptySnaptb0-testConsecutiveExports at 1694818913626 (+11 ms)Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1694818913633 (+7 ms) 2023-09-15 23:01:53,638 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-15 23:01:53,640 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 141 msec 2023-09-15 23:01:53,799 DEBUG [Listener at jenkins-hbase4.apache.org/46629] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-15 23:01:53,801 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-09-15 23:01:53,801 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-15 23:01:53,804 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34705] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,,1694818912830.ea71f7341677d187d5a63cba9d6f715f. with WAL disabled. Data may be lost in the event of a crash. 2023-09-15 23:01:53,805 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33655] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,1,1694818912830.6613a69f1c86c2bb009015471c50c44f. with WAL disabled. Data may be lost in the event of a crash. 2023-09-15 23:01:53,808 DEBUG [Listener at jenkins-hbase4.apache.org/46629] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-09-15 23:01:53,808 DEBUG [Listener at jenkins-hbase4.apache.org/46629] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1694818912830.ea71f7341677d187d5a63cba9d6f715f. 2023-09-15 23:01:53,808 INFO [Listener at jenkins-hbase4.apache.org/46629] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-15 23:01:53,819 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-15 23:01:53,819 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1694818913819 (current time:1694818913819). 2023-09-15 23:01:53,820 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-15 23:01:53,821 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] zookeeper.ReadOnlyZKClient(139): Connect 0x08d94c31 to 127.0.0.1:51149 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-15 23:01:53,831 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@644e6c0a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-15 23:01:53,833 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-15 23:01:53,834 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36812, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-15 23:01:53,835 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x08d94c31 to 127.0.0.1:51149 2023-09-15 23:01:53,835 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-15 23:01:53,837 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] zookeeper.ReadOnlyZKClient(139): Connect 0x69e16d4d to 127.0.0.1:51149 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-15 23:01:53,843 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2b1b1c84, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-15 23:01:53,844 DEBUG [hconnection-0x3ca20bd1-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-15 23:01:53,847 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36824, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-15 23:01:53,851 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x69e16d4d to 127.0.0.1:51149 2023-09-15 23:01:53,851 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-15 23:01:53,851 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-09-15 23:01:53,852 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-15 23:01:53,852 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-15 23:01:53,854 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] procedure2.ProcedureExecutor(1028): Stored pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-15 23:01:53,855 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-15 23:01:53,856 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=49, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1694819513856 2023-09-15 23:01:53,856 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-15 23:01:53,856 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-09-15 23:01:53,857 DEBUG [Listener at jenkins-hbase4.apache.org/46629] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-15 23:01:53,857 DEBUG [Listener at jenkins-hbase4.apache.org/46629] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-15 23:01:53,858 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=49, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-15 23:01:53,858 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-15 23:01:53,859 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=49, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 5 msec 2023-09-15 23:01:53,860 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-15 23:01:53,861 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=50, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1694819513861 2023-09-15 23:01:53,870 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testConsecutiveExports 2023-09-15 23:01:53,870 INFO [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testConsecutiveExports' 2023-09-15 23:01:53,870 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-15 23:01:53,871 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testConsecutiveExports' starting 'acquire' 2023-09-15 23:01:53,871 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-09-15 23:01:53,871 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-15 23:01:53,871 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-15 23:01:53,872 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:34705-0x100b1d2daa90002, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 23:01:53,873 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:41413-0x100b1d2daa90003, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 23:01:53,873 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 23:01:53,873 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 23:01:53,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 23:01:53,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 23:01:53,872 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:01:53,872 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:33655-0x100b1d2daa90001, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 23:01:53,873 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 23:01:53,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 23:01:53,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-15 23:01:53,873 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:01:53,873 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33655,1694818872204 2023-09-15 23:01:53,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-15 23:01:53,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-15 23:01:53,873 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34705-0x100b1d2daa90002, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-15 23:01:53,874 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33655,1694818872204 2023-09-15 23:01:53,874 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-15 23:01:53,874 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41413-0x100b1d2daa90003, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-15 23:01:53,874 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33655-0x100b1d2daa90001, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-15 23:01:53,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-09-15 23:01:53,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-15 23:01:53,874 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-15 23:01:53,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-09-15 23:01:53,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-09-15 23:01:53,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-15 23:01:53,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-15 23:01:53,874 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-15 23:01:53,874 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-15 23:01:53,875 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-09-15 23:01:53,875 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-09-15 23:01:53,875 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-15 23:01:53,875 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-09-15 23:01:53,875 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-15 23:01:53,875 DEBUG [member: 'jenkins-hbase4.apache.org,33655,1694818872204' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-15 23:01:53,875 DEBUG [member: 'jenkins-hbase4.apache.org,33655,1694818872204' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-15 23:01:53,875 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-15 23:01:53,876 DEBUG [member: 'jenkins-hbase4.apache.org,33655,1694818872204' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-15 23:01:53,877 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-15 23:01:53,877 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-09-15 23:01:53,875 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-15 23:01:53,877 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34705,1694818872254' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-09-15 23:01:53,878 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-15 23:01:53,878 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-09-15 23:01:53,877 DEBUG [member: 'jenkins-hbase4.apache.org,33655,1694818872204' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-09-15 23:01:53,878 DEBUG [member: 'jenkins-hbase4.apache.org,33655,1694818872204' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33655,1694818872204' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-09-15 23:01:53,878 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41413,1694818872288' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-09-15 23:01:53,880 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-15 23:01:53,880 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:01:53,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:01:53,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-15 23:01:53,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-15 23:01:53,882 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-15 23:01:53,882 DEBUG [member: 'jenkins-hbase4.apache.org,33655,1694818872204' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-15 23:01:53,882 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34705-0x100b1d2daa90002, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-15 23:01:53,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-15 23:01:53,882 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33655,1694818872204 2023-09-15 23:01:53,882 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41413-0x100b1d2daa90003, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-15 23:01:53,882 DEBUG [member: 'jenkins-hbase4.apache.org,33655,1694818872204' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33655-0x100b1d2daa90001, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-15 23:01:53,882 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-15 23:01:53,882 DEBUG [member: 'jenkins-hbase4.apache.org,33655,1694818872204' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-15 23:01:53,882 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-15 23:01:53,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-15 23:01:53,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-15 23:01:53,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:01:53,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:01:53,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33655,1694818872204 2023-09-15 23:01:53,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-15 23:01:53,884 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34705,1694818872254' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-09-15 23:01:53,884 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@343383c8[Count = 1] remaining members to acquire global barrier 2023-09-15 23:01:53,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33655,1694818872204 2023-09-15 23:01:53,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-15 23:01:53,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-15 23:01:53,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-15 23:01:53,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-15 23:01:53,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-15 23:01:53,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:01:53,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:01:53,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33655,1694818872204 2023-09-15 23:01:53,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-15 23:01:53,886 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33655,1694818872204' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-09-15 23:01:53,886 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@343383c8[Count = 0] remaining members to acquire global barrier 2023-09-15 23:01:53,886 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-09-15 23:01:53,887 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-15 23:01:53,888 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:34705-0x100b1d2daa90002, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-15 23:01:53,888 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:33655-0x100b1d2daa90001, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-15 23:01:53,888 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-15 23:01:53,888 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:41413-0x100b1d2daa90003, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-15 23:01:53,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-15 23:01:53,888 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:01:53,888 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-15 23:01:53,888 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-15 23:01:53,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-15 23:01:53,888 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-15 23:01:53,888 DEBUG [member: 'jenkins-hbase4.apache.org,33655,1694818872204' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-15 23:01:53,888 DEBUG [rs(jenkins-hbase4.apache.org,34705,1694818872254)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1694818912830.ea71f7341677d187d5a63cba9d6f715f. 2023-09-15 23:01:53,888 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33655,1694818872204 2023-09-15 23:01:53,888 DEBUG [rs(jenkins-hbase4.apache.org,34705,1694818872254)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1694818912830.ea71f7341677d187d5a63cba9d6f715f. started... 2023-09-15 23:01:53,888 DEBUG [member: 'jenkins-hbase4.apache.org,33655,1694818872204' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-15 23:01:53,889 DEBUG [member: 'jenkins-hbase4.apache.org,33655,1694818872204' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-15 23:01:53,889 DEBUG [rs(jenkins-hbase4.apache.org,33655,1694818872204)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1694818912830.6613a69f1c86c2bb009015471c50c44f. 2023-09-15 23:01:53,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-15 23:01:53,888 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-15 23:01:53,889 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-15 23:01:53,889 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-15 23:01:53,889 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-09-15 23:01:53,889 INFO [rs(jenkins-hbase4.apache.org,34705,1694818872254)-snapshot-pool-0] regionserver.HRegion(2745): Flushing ea71f7341677d187d5a63cba9d6f715f 1/1 column families, dataSize=467 B heapSize=1.23 KB 2023-09-15 23:01:53,889 DEBUG [rs(jenkins-hbase4.apache.org,33655,1694818872204)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1694818912830.6613a69f1c86c2bb009015471c50c44f. started... 2023-09-15 23:01:53,888 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-15 23:01:53,889 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,41413,1694818872288' in zk 2023-09-15 23:01:53,889 INFO [rs(jenkins-hbase4.apache.org,33655,1694818872204)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 6613a69f1c86c2bb009015471c50c44f 1/1 column families, dataSize=2.80 KB heapSize=6.30 KB 2023-09-15 23:01:53,891 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-09-15 23:01:53,891 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-15 23:01:53,891 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-09-15 23:01:53,923 INFO [rs(jenkins-hbase4.apache.org,34705,1694818872254)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230915ed0566360b024d5bb4edac1abee0b469 to hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230915ed0566360b024d5bb4edac1abee0b469 2023-09-15 23:01:53,924 INFO [rs(jenkins-hbase4.apache.org,33655,1694818872204)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202309154682af4aec724d71890da4319870d30a to hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b202309154682af4aec724d71890da4319870d30a 2023-09-15 23:01:53,936 INFO [rs(jenkins-hbase4.apache.org,34705,1694818872254)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=467, hasBloomFilter=true, into tmp file hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/default/testtb-testConsecutiveExports/ea71f7341677d187d5a63cba9d6f715f/.tmp/cf/1e66359ab972436690a8b1f3163c1d65 2023-09-15 23:01:53,936 INFO [rs(jenkins-hbase4.apache.org,33655,1694818872204)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=2.8 K, hasBloomFilter=true, into tmp file hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/default/testtb-testConsecutiveExports/6613a69f1c86c2bb009015471c50c44f/.tmp/cf/ae5b71d1b1fb42d0ac891daa2cd514d3 2023-09-15 23:01:53,944 DEBUG [rs(jenkins-hbase4.apache.org,34705,1694818872254)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/default/testtb-testConsecutiveExports/ea71f7341677d187d5a63cba9d6f715f/.tmp/cf/1e66359ab972436690a8b1f3163c1d65 as hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/default/testtb-testConsecutiveExports/ea71f7341677d187d5a63cba9d6f715f/cf/1e66359ab972436690a8b1f3163c1d65 2023-09-15 23:01:53,945 DEBUG [rs(jenkins-hbase4.apache.org,33655,1694818872204)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/default/testtb-testConsecutiveExports/6613a69f1c86c2bb009015471c50c44f/.tmp/cf/ae5b71d1b1fb42d0ac891daa2cd514d3 as hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/default/testtb-testConsecutiveExports/6613a69f1c86c2bb009015471c50c44f/cf/ae5b71d1b1fb42d0ac891daa2cd514d3 2023-09-15 23:01:53,950 INFO [rs(jenkins-hbase4.apache.org,33655,1694818872204)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/default/testtb-testConsecutiveExports/6613a69f1c86c2bb009015471c50c44f/cf/ae5b71d1b1fb42d0ac891daa2cd514d3, entries=43, sequenceid=6, filesize=12.0 K 2023-09-15 23:01:53,951 INFO [rs(jenkins-hbase4.apache.org,34705,1694818872254)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/default/testtb-testConsecutiveExports/ea71f7341677d187d5a63cba9d6f715f/cf/1e66359ab972436690a8b1f3163c1d65, entries=7, sequenceid=6, filesize=6.1 K 2023-09-15 23:01:53,951 INFO [rs(jenkins-hbase4.apache.org,33655,1694818872204)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.80 KB/2869, heapSize ~6.28 KB/6432, currentSize=0 B/0 for 6613a69f1c86c2bb009015471c50c44f in 62ms, sequenceid=6, compaction requested=false 2023-09-15 23:01:53,951 DEBUG [rs(jenkins-hbase4.apache.org,33655,1694818872204)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-09-15 23:01:53,952 INFO [rs(jenkins-hbase4.apache.org,34705,1694818872254)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~467 B/467, heapSize ~1.22 KB/1248, currentSize=0 B/0 for ea71f7341677d187d5a63cba9d6f715f in 63ms, sequenceid=6, compaction requested=false 2023-09-15 23:01:53,952 DEBUG [rs(jenkins-hbase4.apache.org,34705,1694818872254)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-09-15 23:01:53,953 DEBUG [rs(jenkins-hbase4.apache.org,34705,1694818872254)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for ea71f7341677d187d5a63cba9d6f715f: 2023-09-15 23:01:53,953 DEBUG [rs(jenkins-hbase4.apache.org,33655,1694818872204)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 6613a69f1c86c2bb009015471c50c44f: 2023-09-15 23:01:53,953 DEBUG [rs(jenkins-hbase4.apache.org,34705,1694818872254)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1694818912830.ea71f7341677d187d5a63cba9d6f715f.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-09-15 23:01:53,953 DEBUG [rs(jenkins-hbase4.apache.org,33655,1694818872204)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1694818912830.6613a69f1c86c2bb009015471c50c44f.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-09-15 23:01:53,954 DEBUG [rs(jenkins-hbase4.apache.org,34705,1694818872254)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-15 23:01:53,954 DEBUG [rs(jenkins-hbase4.apache.org,33655,1694818872204)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-15 23:01:53,954 DEBUG [rs(jenkins-hbase4.apache.org,34705,1694818872254)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/default/testtb-testConsecutiveExports/ea71f7341677d187d5a63cba9d6f715f/cf/1e66359ab972436690a8b1f3163c1d65] hfiles 2023-09-15 23:01:53,954 DEBUG [rs(jenkins-hbase4.apache.org,33655,1694818872204)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/default/testtb-testConsecutiveExports/6613a69f1c86c2bb009015471c50c44f/cf/ae5b71d1b1fb42d0ac891daa2cd514d3] hfiles 2023-09-15 23:01:53,954 DEBUG [rs(jenkins-hbase4.apache.org,34705,1694818872254)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/default/testtb-testConsecutiveExports/ea71f7341677d187d5a63cba9d6f715f/cf/1e66359ab972436690a8b1f3163c1d65 for snapshot=snaptb0-testConsecutiveExports 2023-09-15 23:01:53,954 DEBUG [rs(jenkins-hbase4.apache.org,33655,1694818872204)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/default/testtb-testConsecutiveExports/6613a69f1c86c2bb009015471c50c44f/cf/ae5b71d1b1fb42d0ac891daa2cd514d3 for snapshot=snaptb0-testConsecutiveExports 2023-09-15 23:01:53,957 DEBUG [Listener at jenkins-hbase4.apache.org/46629] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-15 23:01:53,958 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-09-15 23:01:53,959 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-09-15 23:01:53,959 DEBUG [Listener at jenkins-hbase4.apache.org/46629] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-15 23:01:53,972 DEBUG [rs(jenkins-hbase4.apache.org,34705,1694818872254)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1694818912830.ea71f7341677d187d5a63cba9d6f715f. completed. 2023-09-15 23:01:53,972 DEBUG [rs(jenkins-hbase4.apache.org,34705,1694818872254)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1694818912830.ea71f7341677d187d5a63cba9d6f715f. 2023-09-15 23:01:53,972 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-15 23:01:53,972 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-15 23:01:53,972 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:01:53,972 DEBUG [rs(jenkins-hbase4.apache.org,33655,1694818872204)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1694818912830.6613a69f1c86c2bb009015471c50c44f. completed. 2023-09-15 23:01:53,972 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-09-15 23:01:53,972 DEBUG [rs(jenkins-hbase4.apache.org,33655,1694818872204)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1694818912830.6613a69f1c86c2bb009015471c50c44f. 2023-09-15 23:01:53,972 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,34705,1694818872254' in zk 2023-09-15 23:01:53,972 DEBUG [member: 'jenkins-hbase4.apache.org,33655,1694818872204' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-15 23:01:53,972 DEBUG [member: 'jenkins-hbase4.apache.org,33655,1694818872204' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-15 23:01:53,972 DEBUG [member: 'jenkins-hbase4.apache.org,33655,1694818872204' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33655,1694818872204 2023-09-15 23:01:53,972 DEBUG [member: 'jenkins-hbase4.apache.org,33655,1694818872204' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-09-15 23:01:53,972 DEBUG [member: 'jenkins-hbase4.apache.org,33655,1694818872204' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,33655,1694818872204' in zk 2023-09-15 23:01:53,974 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-09-15 23:01:53,974 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:01:53,975 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-15 23:01:53,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:01:53,975 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-09-15 23:01:53,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-15 23:01:53,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-15 23:01:53,976 DEBUG [member: 'jenkins-hbase4.apache.org,33655,1694818872204' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-09-15 23:01:53,976 DEBUG [member: 'jenkins-hbase4.apache.org,33655,1694818872204' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-15 23:01:53,976 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33655,1694818872204 2023-09-15 23:01:53,977 DEBUG [member: 'jenkins-hbase4.apache.org,33655,1694818872204' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-09-15 23:01:53,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-15 23:01:53,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-15 23:01:53,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-15 23:01:53,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:01:53,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:01:53,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33655,1694818872204 2023-09-15 23:01:53,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-15 23:01:53,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-15 23:01:53,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:01:53,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:01:53,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33655,1694818872204 2023-09-15 23:01:53,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,34705,1694818872254': 2023-09-15 23:01:53,981 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34705,1694818872254' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-09-15 23:01:53,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33655,1694818872204 2023-09-15 23:01:53,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-15 23:01:53,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-15 23:01:53,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-15 23:01:53,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-15 23:01:53,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-15 23:01:53,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:01:53,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:01:53,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33655,1694818872204 2023-09-15 23:01:53,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-15 23:01:53,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-15 23:01:53,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:01:53,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:01:53,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33655,1694818872204 2023-09-15 23:01:53,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,33655,1694818872204': 2023-09-15 23:01:53,984 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33655,1694818872204' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-09-15 23:01:53,984 INFO [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testConsecutiveExports' execution completed 2023-09-15 23:01:53,985 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-15 23:01:53,985 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-15 23:01:53,985 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testConsecutiveExports 2023-09-15 23:01:53,985 INFO [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-15 23:01:53,987 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-15 23:01:53,987 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:33655-0x100b1d2daa90001, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-15 23:01:53,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-15 23:01:53,987 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-15 23:01:53,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-15 23:01:53,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-15 23:01:53,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-15 23:01:53,987 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:33655-0x100b1d2daa90001, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 23:01:53,987 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:34705-0x100b1d2daa90002, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-15 23:01:53,987 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:41413-0x100b1d2daa90003, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-15 23:01:53,987 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-15 23:01:53,987 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:41413-0x100b1d2daa90003, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 23:01:53,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-15 23:01:53,987 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-15 23:01:53,987 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 23:01:53,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-15 23:01:53,987 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:34705-0x100b1d2daa90002, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 23:01:53,988 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:01:53,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 23:01:53,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-15 23:01:53,988 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 23:01:53,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-15 23:01:53,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 23:01:53,988 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:01:53,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-15 23:01:53,988 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 23:01:53,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 23:01:53,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-15 23:01:53,988 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33655,1694818872204 2023-09-15 23:01:53,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-15 23:01:53,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-15 23:01:53,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-15 23:01:53,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:01:53,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:01:53,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33655,1694818872204 2023-09-15 23:01:53,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-15 23:01:53,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-15 23:01:53,991 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:01:53,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:01:53,991 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:01:53,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:01:53,992 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33655,1694818872204 2023-09-15 23:01:53,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33655,1694818872204 2023-09-15 23:01:53,999 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:41413-0x100b1d2daa90003, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 23:01:53,999 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33655,1694818872204 2023-09-15 23:01:53,999 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 23:01:53,999 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:41413-0x100b1d2daa90003, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 23:01:53,999 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:34705-0x100b1d2daa90002, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 23:01:53,999 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testConsecutiveExports 2023-09-15 23:01:53,999 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:33655-0x100b1d2daa90001, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 23:01:53,999 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-09-15 23:01:53,999 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 23:01:54,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 23:01:53,999 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:33655-0x100b1d2daa90001, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 23:01:53,999 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 23:01:53,999 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:34705-0x100b1d2daa90002, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 23:01:53,999 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-15 23:01:53,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 23:01:53,999 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-15 23:01:54,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 23:01:54,000 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testConsecutiveExports 2023-09-15 23:01:54,002 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 23:01:54,002 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:01:54,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 23:01:54,002 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 23:01:54,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 23:01:54,002 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-15 23:01:54,002 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:01:54,002 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 23:01:54,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 23:01:54,002 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-15 23:01:54,002 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33655,1694818872204 2023-09-15 23:01:54,002 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-15 23:01:54,002 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:01:54,002 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:01:54,002 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-15 23:01:54,002 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-15 23:01:54,003 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b202309154682af4aec724d71890da4319870d30a, hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230915ed0566360b024d5bb4edac1abee0b469] mob files 2023-09-15 23:01:54,003 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b202309154682af4aec724d71890da4319870d30a 2023-09-15 23:01:54,003 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230915ed0566360b024d5bb4edac1abee0b469 2023-09-15 23:01:54,013 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testConsecutiveExports 2023-09-15 23:01:54,014 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-15 23:01:54,032 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports to hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-09-15 23:01:54,033 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-09-15 23:01:54,033 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-15 23:01:54,033 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-15 23:01:54,033 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1694818913856Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1694818914013 (+157 ms)Consolidate snapshot: snaptb0-testConsecutiveExports at 1694818914013Loading Region manifests for snaptb0-testConsecutiveExports at 1694818914013Writing data manifest for snaptb0-testConsecutiveExports at 1694818914018 (+5 ms)Verifying snapshot: snaptb0-testConsecutiveExports at 1694818914025 (+7 ms)Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1694818914033 (+8 ms) 2023-09-15 23:01:54,036 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=50, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-15 23:01:54,037 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=50, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 179 msec 2023-09-15 23:01:54,159 DEBUG [Listener at jenkins-hbase4.apache.org/46629] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-15 23:01:54,160 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-09-15 23:01:54,160 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-15 23:01:54,160 INFO [Listener at jenkins-hbase4.apache.org/46629] snapshot.TestExportSnapshot(389): Local export destination path: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c5e9ebbf-ce0f-c6b3-3dce-6299f7b47f51/local-export-1694818914160 2023-09-15 23:01:54,161 INFO [Listener at jenkins-hbase4.apache.org/46629] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c5e9ebbf-ce0f-c6b3-3dce-6299f7b47f51/local-export-1694818914160, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c5e9ebbf-ce0f-c6b3-3dce-6299f7b47f51/local-export-1694818914160, srcFsUri=hdfs://localhost:44545, srcDir=hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64 2023-09-15 23:01:54,183 DEBUG [Listener at jenkins-hbase4.apache.org/46629] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:44545, inputRoot=hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64 2023-09-15 23:01:54,183 DEBUG [Listener at jenkins-hbase4.apache.org/46629] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@1f0f7459, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c5e9ebbf-ce0f-c6b3-3dce-6299f7b47f51/local-export-1694818914160, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c5e9ebbf-ce0f-c6b3-3dce-6299f7b47f51/local-export-1694818914160/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-15 23:01:54,183 INFO [Listener at jenkins-hbase4.apache.org/46629] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:44545, inputRoot=hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64, snapshotDir=hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-09-15 23:01:54,191 INFO [Listener at jenkins-hbase4.apache.org/46629] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c5e9ebbf-ce0f-c6b3-3dce-6299f7b47f51/local-export-1694818914160/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-15 23:01:54,202 DEBUG [Listener at jenkins-hbase4.apache.org/46629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-15 23:01:54,202 DEBUG [Listener at jenkins-hbase4.apache.org/46629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-15 23:01:54,203 DEBUG [Listener at jenkins-hbase4.apache.org/46629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-15 23:01:54,203 DEBUG [Listener at jenkins-hbase4.apache.org/46629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-15 23:01:55,097 DEBUG [Listener at jenkins-hbase4.apache.org/46629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c5e9ebbf-ce0f-c6b3-3dce-6299f7b47f51/hadoop-6240484049102108072.jar 2023-09-15 23:01:55,097 DEBUG [Listener at jenkins-hbase4.apache.org/46629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-15 23:01:55,098 DEBUG [Listener at jenkins-hbase4.apache.org/46629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-15 23:01:55,164 DEBUG [Listener at jenkins-hbase4.apache.org/46629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c5e9ebbf-ce0f-c6b3-3dce-6299f7b47f51/hadoop-6758234379001025440.jar 2023-09-15 23:01:55,164 DEBUG [Listener at jenkins-hbase4.apache.org/46629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-15 23:01:55,165 DEBUG [Listener at jenkins-hbase4.apache.org/46629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-15 23:01:55,165 DEBUG [Listener at jenkins-hbase4.apache.org/46629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-15 23:01:55,165 DEBUG [Listener at jenkins-hbase4.apache.org/46629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-15 23:01:55,166 DEBUG [Listener at jenkins-hbase4.apache.org/46629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-15 23:01:55,166 DEBUG [Listener at jenkins-hbase4.apache.org/46629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-15 23:01:55,167 DEBUG [Listener at jenkins-hbase4.apache.org/46629] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-15 23:01:55,167 DEBUG [Listener at jenkins-hbase4.apache.org/46629] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-15 23:01:55,167 DEBUG [Listener at jenkins-hbase4.apache.org/46629] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-15 23:01:55,168 DEBUG [Listener at jenkins-hbase4.apache.org/46629] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-15 23:01:55,168 DEBUG [Listener at jenkins-hbase4.apache.org/46629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-15 23:01:55,168 DEBUG [Listener at jenkins-hbase4.apache.org/46629] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-15 23:01:55,169 DEBUG [Listener at jenkins-hbase4.apache.org/46629] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-15 23:01:55,169 DEBUG [Listener at jenkins-hbase4.apache.org/46629] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-15 23:01:55,169 DEBUG [Listener at jenkins-hbase4.apache.org/46629] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-15 23:01:55,170 DEBUG [Listener at jenkins-hbase4.apache.org/46629] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-15 23:01:55,171 DEBUG [Listener at jenkins-hbase4.apache.org/46629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-15 23:01:55,171 DEBUG [Listener at jenkins-hbase4.apache.org/46629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-15 23:01:55,172 DEBUG [Listener at jenkins-hbase4.apache.org/46629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-15 23:01:55,172 DEBUG [Listener at jenkins-hbase4.apache.org/46629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-15 23:01:55,172 DEBUG [Listener at jenkins-hbase4.apache.org/46629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-15 23:01:55,173 DEBUG [Listener at jenkins-hbase4.apache.org/46629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-15 23:01:55,173 DEBUG [Listener at jenkins-hbase4.apache.org/46629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-15 23:01:55,564 WARN [Listener at jenkins-hbase4.apache.org/46629] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-15 23:01:55,566 INFO [Listener at jenkins-hbase4.apache.org/46629] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-09-15 23:01:55,568 DEBUG [Listener at jenkins-hbase4.apache.org/46629] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-09-15 23:01:57,240 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-15 23:01:57,240 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-15 23:01:57,243 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694818878578_0002_000001 (auth:SIMPLE) 2023-09-15 23:01:58,059 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694818878578_0003_000001 (auth:SIMPLE) 2023-09-15 23:01:58,087 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-15 23:02:01,724 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694818878578_0003_000001 (auth:SIMPLE) 2023-09-15 23:02:03,934 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694818878578_0003_000001 (auth:SIMPLE) 2023-09-15 23:02:06,262 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694818878578_0003_000001 (auth:SIMPLE) 2023-09-15 23:02:07,728 INFO [Listener at jenkins-hbase4.apache.org/46629] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-15 23:02:07,728 INFO [Listener at jenkins-hbase4.apache.org/46629] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-15 23:02:07,734 INFO [Listener at jenkins-hbase4.apache.org/46629] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-09-15 23:02:07,734 INFO [Listener at jenkins-hbase4.apache.org/46629] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-15 23:02:07,734 INFO [Listener at jenkins-hbase4.apache.org/46629] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-15 23:02:07,735 DEBUG [Listener at jenkins-hbase4.apache.org/46629] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1896422628_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-09-15 23:02:07,737 DEBUG [Listener at jenkins-hbase4.apache.org/46629] snapshot.TestExportSnapshot(367): hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-09-15 23:02:07,737 DEBUG [Listener at jenkins-hbase4.apache.org/46629] snapshot.TestExportSnapshot(367): hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-09-15 23:02:07,737 DEBUG [Listener at jenkins-hbase4.apache.org/46629] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@70f5fb34 in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c5e9ebbf-ce0f-c6b3-3dce-6299f7b47f51/local-export-1694818914160/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c5e9ebbf-ce0f-c6b3-3dce-6299f7b47f51/local-export-1694818914160/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-09-15 23:02:07,738 DEBUG [Listener at jenkins-hbase4.apache.org/46629] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c5e9ebbf-ce0f-c6b3-3dce-6299f7b47f51/local-export-1694818914160/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-09-15 23:02:07,738 DEBUG [Listener at jenkins-hbase4.apache.org/46629] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c5e9ebbf-ce0f-c6b3-3dce-6299f7b47f51/local-export-1694818914160/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-09-15 23:02:07,739 INFO [Listener at jenkins-hbase4.apache.org/46629] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c5e9ebbf-ce0f-c6b3-3dce-6299f7b47f51/local-export-1694818914160, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c5e9ebbf-ce0f-c6b3-3dce-6299f7b47f51/local-export-1694818914160, srcFsUri=hdfs://localhost:44545, srcDir=hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64 2023-09-15 23:02:07,760 DEBUG [Listener at jenkins-hbase4.apache.org/46629] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:44545, inputRoot=hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64 2023-09-15 23:02:07,760 DEBUG [Listener at jenkins-hbase4.apache.org/46629] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@2b8e851c, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c5e9ebbf-ce0f-c6b3-3dce-6299f7b47f51/local-export-1694818914160, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c5e9ebbf-ce0f-c6b3-3dce-6299f7b47f51/local-export-1694818914160/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-15 23:02:07,760 INFO [Listener at jenkins-hbase4.apache.org/46629] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:44545, inputRoot=hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64, snapshotDir=hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-09-15 23:02:07,771 INFO [Listener at jenkins-hbase4.apache.org/46629] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c5e9ebbf-ce0f-c6b3-3dce-6299f7b47f51/local-export-1694818914160/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-15 23:02:07,782 DEBUG [Listener at jenkins-hbase4.apache.org/46629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-15 23:02:07,783 DEBUG [Listener at jenkins-hbase4.apache.org/46629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-15 23:02:07,783 DEBUG [Listener at jenkins-hbase4.apache.org/46629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-15 23:02:07,783 DEBUG [Listener at jenkins-hbase4.apache.org/46629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-15 23:02:08,652 DEBUG [Listener at jenkins-hbase4.apache.org/46629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c5e9ebbf-ce0f-c6b3-3dce-6299f7b47f51/hadoop-4337055048852701458.jar 2023-09-15 23:02:08,652 DEBUG [Listener at jenkins-hbase4.apache.org/46629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-15 23:02:08,653 DEBUG [Listener at jenkins-hbase4.apache.org/46629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-15 23:02:08,719 DEBUG [Listener at jenkins-hbase4.apache.org/46629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c5e9ebbf-ce0f-c6b3-3dce-6299f7b47f51/hadoop-815269987175783845.jar 2023-09-15 23:02:08,719 DEBUG [Listener at jenkins-hbase4.apache.org/46629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-15 23:02:08,720 DEBUG [Listener at jenkins-hbase4.apache.org/46629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-15 23:02:08,720 DEBUG [Listener at jenkins-hbase4.apache.org/46629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-15 23:02:08,720 DEBUG [Listener at jenkins-hbase4.apache.org/46629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-15 23:02:08,721 DEBUG [Listener at jenkins-hbase4.apache.org/46629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-15 23:02:08,721 DEBUG [Listener at jenkins-hbase4.apache.org/46629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-15 23:02:08,722 DEBUG [Listener at jenkins-hbase4.apache.org/46629] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-15 23:02:08,722 DEBUG [Listener at jenkins-hbase4.apache.org/46629] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-15 23:02:08,722 DEBUG [Listener at jenkins-hbase4.apache.org/46629] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-15 23:02:08,723 DEBUG [Listener at jenkins-hbase4.apache.org/46629] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-15 23:02:08,723 DEBUG [Listener at jenkins-hbase4.apache.org/46629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-15 23:02:08,724 DEBUG [Listener at jenkins-hbase4.apache.org/46629] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-15 23:02:08,724 DEBUG [Listener at jenkins-hbase4.apache.org/46629] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-15 23:02:08,724 DEBUG [Listener at jenkins-hbase4.apache.org/46629] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-15 23:02:08,724 DEBUG [Listener at jenkins-hbase4.apache.org/46629] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-15 23:02:08,725 DEBUG [Listener at jenkins-hbase4.apache.org/46629] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-15 23:02:08,726 DEBUG [Listener at jenkins-hbase4.apache.org/46629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-15 23:02:08,726 DEBUG [Listener at jenkins-hbase4.apache.org/46629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-15 23:02:08,726 DEBUG [Listener at jenkins-hbase4.apache.org/46629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-15 23:02:08,727 DEBUG [Listener at jenkins-hbase4.apache.org/46629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-15 23:02:08,727 DEBUG [Listener at jenkins-hbase4.apache.org/46629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-15 23:02:08,727 DEBUG [Listener at jenkins-hbase4.apache.org/46629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-15 23:02:08,728 DEBUG [Listener at jenkins-hbase4.apache.org/46629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-15 23:02:09,080 WARN [Listener at jenkins-hbase4.apache.org/46629] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-15 23:02:09,082 INFO [Listener at jenkins-hbase4.apache.org/46629] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-09-15 23:02:09,084 DEBUG [Listener at jenkins-hbase4.apache.org/46629] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-09-15 23:02:12,434 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-15 23:02:12,434 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-15 23:02:12,437 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694818878578_0003_000001 (auth:SIMPLE) 2023-09-15 23:02:13,251 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694818878578_0004_000001 (auth:SIMPLE) 2023-09-15 23:02:16,949 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694818878578_0004_000001 (auth:SIMPLE) 2023-09-15 23:02:19,162 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694818878578_0004_000001 (auth:SIMPLE) 2023-09-15 23:02:21,365 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694818878578_0004_000001 (auth:SIMPLE) 2023-09-15 23:02:23,253 INFO [Listener at jenkins-hbase4.apache.org/46629] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-15 23:02:23,253 INFO [Listener at jenkins-hbase4.apache.org/46629] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-15 23:02:23,256 INFO [Listener at jenkins-hbase4.apache.org/46629] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-09-15 23:02:23,256 INFO [Listener at jenkins-hbase4.apache.org/46629] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-15 23:02:23,257 INFO [Listener at jenkins-hbase4.apache.org/46629] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-15 23:02:23,257 DEBUG [Listener at jenkins-hbase4.apache.org/46629] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1896422628_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-09-15 23:02:23,261 DEBUG [Listener at jenkins-hbase4.apache.org/46629] snapshot.TestExportSnapshot(367): hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-09-15 23:02:23,261 DEBUG [Listener at jenkins-hbase4.apache.org/46629] snapshot.TestExportSnapshot(367): hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-09-15 23:02:23,261 DEBUG [Listener at jenkins-hbase4.apache.org/46629] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@70f5fb34 in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c5e9ebbf-ce0f-c6b3-3dce-6299f7b47f51/local-export-1694818914160/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c5e9ebbf-ce0f-c6b3-3dce-6299f7b47f51/local-export-1694818914160/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-09-15 23:02:23,262 DEBUG [Listener at jenkins-hbase4.apache.org/46629] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c5e9ebbf-ce0f-c6b3-3dce-6299f7b47f51/local-export-1694818914160/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-09-15 23:02:23,262 DEBUG [Listener at jenkins-hbase4.apache.org/46629] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c5e9ebbf-ce0f-c6b3-3dce-6299f7b47f51/local-export-1694818914160/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-09-15 23:02:23,274 INFO [Listener at jenkins-hbase4.apache.org/46629] client.HBaseAdmin$15(890): Started disable of testtb-testConsecutiveExports 2023-09-15 23:02:23,274 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testConsecutiveExports 2023-09-15 23:02:23,275 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] procedure2.ProcedureExecutor(1028): Stored pid=51, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testConsecutiveExports 2023-09-15 23:02:23,278 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-09-15 23:02:23,278 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694818943278"}]},"ts":"1694818943278"} 2023-09-15 23:02:23,279 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLING in hbase:meta 2023-09-15 23:02:23,282 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testConsecutiveExports to state=DISABLING 2023-09-15 23:02:23,283 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=ea71f7341677d187d5a63cba9d6f715f, UNASSIGN}, {pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=6613a69f1c86c2bb009015471c50c44f, UNASSIGN}] 2023-09-15 23:02:23,285 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=6613a69f1c86c2bb009015471c50c44f, UNASSIGN 2023-09-15 23:02:23,285 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=ea71f7341677d187d5a63cba9d6f715f, UNASSIGN 2023-09-15 23:02:23,285 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=6613a69f1c86c2bb009015471c50c44f, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,33655,1694818872204 2023-09-15 23:02:23,285 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=ea71f7341677d187d5a63cba9d6f715f, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:02:23,285 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1694818912830.6613a69f1c86c2bb009015471c50c44f.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1694818943285"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694818943285"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694818943285"}]},"ts":"1694818943285"} 2023-09-15 23:02:23,285 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1694818912830.ea71f7341677d187d5a63cba9d6f715f.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1694818943285"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694818943285"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694818943285"}]},"ts":"1694818943285"} 2023-09-15 23:02:23,287 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=54, ppid=53, state=RUNNABLE; CloseRegionProcedure 6613a69f1c86c2bb009015471c50c44f, server=jenkins-hbase4.apache.org,33655,1694818872204}] 2023-09-15 23:02:23,287 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=55, ppid=52, state=RUNNABLE; CloseRegionProcedure ea71f7341677d187d5a63cba9d6f715f, server=jenkins-hbase4.apache.org,34705,1694818872254}] 2023-09-15 23:02:23,379 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-09-15 23:02:23,439 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 6613a69f1c86c2bb009015471c50c44f 2023-09-15 23:02:23,439 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 6613a69f1c86c2bb009015471c50c44f, disabling compactions & flushes 2023-09-15 23:02:23,439 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1694818912830.6613a69f1c86c2bb009015471c50c44f. 2023-09-15 23:02:23,439 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1694818912830.6613a69f1c86c2bb009015471c50c44f. 2023-09-15 23:02:23,439 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1694818912830.6613a69f1c86c2bb009015471c50c44f. after waiting 0 ms 2023-09-15 23:02:23,439 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1694818912830.6613a69f1c86c2bb009015471c50c44f. 2023-09-15 23:02:23,440 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close ea71f7341677d187d5a63cba9d6f715f 2023-09-15 23:02:23,443 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing ea71f7341677d187d5a63cba9d6f715f, disabling compactions & flushes 2023-09-15 23:02:23,443 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1694818912830.ea71f7341677d187d5a63cba9d6f715f. 2023-09-15 23:02:23,443 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1694818912830.ea71f7341677d187d5a63cba9d6f715f. 2023-09-15 23:02:23,443 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1694818912830.ea71f7341677d187d5a63cba9d6f715f. after waiting 0 ms 2023-09-15 23:02:23,443 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1694818912830.ea71f7341677d187d5a63cba9d6f715f. 2023-09-15 23:02:23,450 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/default/testtb-testConsecutiveExports/6613a69f1c86c2bb009015471c50c44f/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-15 23:02:23,450 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/default/testtb-testConsecutiveExports/ea71f7341677d187d5a63cba9d6f715f/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-15 23:02:23,450 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-15 23:02:23,450 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-15 23:02:23,451 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1694818912830.6613a69f1c86c2bb009015471c50c44f. 2023-09-15 23:02:23,451 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1694818912830.ea71f7341677d187d5a63cba9d6f715f. 2023-09-15 23:02:23,451 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 6613a69f1c86c2bb009015471c50c44f: 2023-09-15 23:02:23,451 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for ea71f7341677d187d5a63cba9d6f715f: 2023-09-15 23:02:23,453 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed ea71f7341677d187d5a63cba9d6f715f 2023-09-15 23:02:23,454 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=ea71f7341677d187d5a63cba9d6f715f, regionState=CLOSED 2023-09-15 23:02:23,454 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1694818912830.ea71f7341677d187d5a63cba9d6f715f.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1694818943453"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694818943453"}]},"ts":"1694818943453"} 2023-09-15 23:02:23,454 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 6613a69f1c86c2bb009015471c50c44f 2023-09-15 23:02:23,454 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=6613a69f1c86c2bb009015471c50c44f, regionState=CLOSED 2023-09-15 23:02:23,454 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1694818912830.6613a69f1c86c2bb009015471c50c44f.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1694818943454"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694818943454"}]},"ts":"1694818943454"} 2023-09-15 23:02:23,457 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=55, resume processing ppid=52 2023-09-15 23:02:23,457 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=55, ppid=52, state=SUCCESS; CloseRegionProcedure ea71f7341677d187d5a63cba9d6f715f, server=jenkins-hbase4.apache.org,34705,1694818872254 in 168 msec 2023-09-15 23:02:23,458 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=54, resume processing ppid=53 2023-09-15 23:02:23,458 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=54, ppid=53, state=SUCCESS; CloseRegionProcedure 6613a69f1c86c2bb009015471c50c44f, server=jenkins-hbase4.apache.org,33655,1694818872204 in 169 msec 2023-09-15 23:02:23,458 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=52, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=ea71f7341677d187d5a63cba9d6f715f, UNASSIGN in 174 msec 2023-09-15 23:02:23,459 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=53, resume processing ppid=51 2023-09-15 23:02:23,459 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=53, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=6613a69f1c86c2bb009015471c50c44f, UNASSIGN in 175 msec 2023-09-15 23:02:23,460 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694818943460"}]},"ts":"1694818943460"} 2023-09-15 23:02:23,461 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLED in hbase:meta 2023-09-15 23:02:23,463 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testConsecutiveExports to state=DISABLED 2023-09-15 23:02:23,464 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=51, state=SUCCESS; DisableTableProcedure table=testtb-testConsecutiveExports in 189 msec 2023-09-15 23:02:23,580 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-09-15 23:02:23,580 INFO [Listener at jenkins-hbase4.apache.org/46629] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testConsecutiveExports, procId: 51 completed 2023-09-15 23:02:23,581 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testConsecutiveExports 2023-09-15 23:02:23,582 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] procedure2.ProcedureExecutor(1028): Stored pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-15 23:02:23,584 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-15 23:02:23,584 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] access.PermissionStorage(259): Removing permissions of removed table testtb-testConsecutiveExports 2023-09-15 23:02:23,585 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=56, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-15 23:02:23,588 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41413] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testConsecutiveExports 2023-09-15 23:02:23,591 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:33655-0x100b1d2daa90001, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-15 23:02:23,591 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:41413-0x100b1d2daa90003, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-15 23:02:23,591 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-15 23:02:23,591 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:34705-0x100b1d2daa90002, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-15 23:02:23,591 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-09-15 23:02:23,591 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-09-15 23:02:23,591 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-09-15 23:02:23,591 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-09-15 23:02:23,591 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.tmp/data/default/testtb-testConsecutiveExports/ea71f7341677d187d5a63cba9d6f715f 2023-09-15 23:02:23,591 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.tmp/data/default/testtb-testConsecutiveExports/6613a69f1c86c2bb009015471c50c44f 2023-09-15 23:02:23,593 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.tmp/data/default/testtb-testConsecutiveExports/ea71f7341677d187d5a63cba9d6f715f/cf, FileablePath, hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.tmp/data/default/testtb-testConsecutiveExports/ea71f7341677d187d5a63cba9d6f715f/recovered.edits] 2023-09-15 23:02:23,594 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:41413-0x100b1d2daa90003, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-15 23:02:23,594 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-15 23:02:23,594 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:34705-0x100b1d2daa90002, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-15 23:02:23,594 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.tmp/data/default/testtb-testConsecutiveExports/6613a69f1c86c2bb009015471c50c44f/cf, FileablePath, hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.tmp/data/default/testtb-testConsecutiveExports/6613a69f1c86c2bb009015471c50c44f/recovered.edits] 2023-09-15 23:02:23,594 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:41413-0x100b1d2daa90003, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-15 23:02:23,594 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:33655-0x100b1d2daa90001, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-15 23:02:23,594 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:33655-0x100b1d2daa90001, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-15 23:02:23,594 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:34705-0x100b1d2daa90002, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-15 23:02:23,594 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-15 23:02:23,595 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-09-15 23:02:23,598 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.tmp/data/default/testtb-testConsecutiveExports/ea71f7341677d187d5a63cba9d6f715f/cf/1e66359ab972436690a8b1f3163c1d65 to hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/archive/data/default/testtb-testConsecutiveExports/ea71f7341677d187d5a63cba9d6f715f/cf/1e66359ab972436690a8b1f3163c1d65 2023-09-15 23:02:23,598 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.tmp/data/default/testtb-testConsecutiveExports/6613a69f1c86c2bb009015471c50c44f/cf/ae5b71d1b1fb42d0ac891daa2cd514d3 to hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/archive/data/default/testtb-testConsecutiveExports/6613a69f1c86c2bb009015471c50c44f/cf/ae5b71d1b1fb42d0ac891daa2cd514d3 2023-09-15 23:02:23,602 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.tmp/data/default/testtb-testConsecutiveExports/ea71f7341677d187d5a63cba9d6f715f/recovered.edits/9.seqid to hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/archive/data/default/testtb-testConsecutiveExports/ea71f7341677d187d5a63cba9d6f715f/recovered.edits/9.seqid 2023-09-15 23:02:23,602 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.tmp/data/default/testtb-testConsecutiveExports/6613a69f1c86c2bb009015471c50c44f/recovered.edits/9.seqid to hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/archive/data/default/testtb-testConsecutiveExports/6613a69f1c86c2bb009015471c50c44f/recovered.edits/9.seqid 2023-09-15 23:02:23,602 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.tmp/data/default/testtb-testConsecutiveExports/ea71f7341677d187d5a63cba9d6f715f 2023-09-15 23:02:23,602 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.tmp/data/default/testtb-testConsecutiveExports/6613a69f1c86c2bb009015471c50c44f 2023-09-15 23:02:23,602 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-09-15 23:02:23,603 DEBUG [PEWorker-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-09-15 23:02:23,604 DEBUG [PEWorker-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf] 2023-09-15 23:02:23,607 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b202309154682af4aec724d71890da4319870d30a to hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b202309154682af4aec724d71890da4319870d30a 2023-09-15 23:02:23,608 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230915ed0566360b024d5bb4edac1abee0b469 to hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230915ed0566360b024d5bb4edac1abee0b469 2023-09-15 23:02:23,608 DEBUG [PEWorker-1] backup.HFileArchiver(596): Deleted hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-09-15 23:02:23,611 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=56, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-15 23:02:23,613 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testConsecutiveExports from hbase:meta 2023-09-15 23:02:23,615 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testConsecutiveExports' descriptor. 2023-09-15 23:02:23,616 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=56, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-15 23:02:23,616 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testConsecutiveExports' from region states. 2023-09-15 23:02:23,616 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,,1694818912830.ea71f7341677d187d5a63cba9d6f715f.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1694818943616"}]},"ts":"9223372036854775807"} 2023-09-15 23:02:23,616 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,1,1694818912830.6613a69f1c86c2bb009015471c50c44f.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1694818943616"}]},"ts":"9223372036854775807"} 2023-09-15 23:02:23,618 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-15 23:02:23,618 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => ea71f7341677d187d5a63cba9d6f715f, NAME => 'testtb-testConsecutiveExports,,1694818912830.ea71f7341677d187d5a63cba9d6f715f.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 6613a69f1c86c2bb009015471c50c44f, NAME => 'testtb-testConsecutiveExports,1,1694818912830.6613a69f1c86c2bb009015471c50c44f.', STARTKEY => '1', ENDKEY => ''}] 2023-09-15 23:02:23,618 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testConsecutiveExports' as deleted. 2023-09-15 23:02:23,618 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1694818943618"}]},"ts":"9223372036854775807"} 2023-09-15 23:02:23,620 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testConsecutiveExports state from META 2023-09-15 23:02:23,621 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=56, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-15 23:02:23,623 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=56, state=SUCCESS; DeleteTableProcedure table=testtb-testConsecutiveExports in 40 msec 2023-09-15 23:02:23,696 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-09-15 23:02:23,696 INFO [Listener at jenkins-hbase4.apache.org/46629] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testConsecutiveExports, procId: 56 completed 2023-09-15 23:02:23,706 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testConsecutiveExports" 2023-09-15 23:02:23,707 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testConsecutiveExports 2023-09-15 23:02:23,709 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testConsecutiveExports" 2023-09-15 23:02:23,710 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testConsecutiveExports 2023-09-15 23:02:23,736 INFO [Listener at jenkins-hbase4.apache.org/46629] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=748 (was 760), OpenFileDescriptor=902 (was 935), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=200 (was 194) - SystemLoadAverage LEAK? -, ProcessCount=166 (was 167), AvailableMemoryMB=5139 (was 5292) 2023-09-15 23:02:23,736 WARN [Listener at jenkins-hbase4.apache.org/46629] hbase.ResourceChecker(130): Thread=748 is superior to 500 2023-09-15 23:02:23,755 INFO [Listener at jenkins-hbase4.apache.org/46629] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=748, OpenFileDescriptor=902, MaxFileDescriptor=60000, SystemLoadAverage=200, ProcessCount=166, AvailableMemoryMB=5139 2023-09-15 23:02:23,755 WARN [Listener at jenkins-hbase4.apache.org/46629] hbase.ResourceChecker(130): Thread=748 is superior to 500 2023-09-15 23:02:23,757 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-15 23:02:23,758 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] procedure2.ProcedureExecutor(1028): Stored pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-15 23:02:23,760 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-09-15 23:02:23,760 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion" procId is: 57 2023-09-15 23:02:23,761 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-15 23:02:23,761 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-09-15 23:02:23,763 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/aa5581efb16c18499914b11aedd5365f 2023-09-15 23:02:23,763 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/3d7d5328b03e7580532dc45552cc1dc1 2023-09-15 23:02:23,764 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/aa5581efb16c18499914b11aedd5365f empty. 2023-09-15 23:02:23,764 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/3d7d5328b03e7580532dc45552cc1dc1 empty. 2023-09-15 23:02:23,764 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/aa5581efb16c18499914b11aedd5365f 2023-09-15 23:02:23,764 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/3d7d5328b03e7580532dc45552cc1dc1 2023-09-15 23:02:23,765 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-09-15 23:02:23,775 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/.tabledesc/.tableinfo.0000000001 2023-09-15 23:02:23,776 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(7675): creating {ENCODED => 3d7d5328b03e7580532dc45552cc1dc1, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1694818943756.3d7d5328b03e7580532dc45552cc1dc1.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.tmp 2023-09-15 23:02:23,776 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(7675): creating {ENCODED => aa5581efb16c18499914b11aedd5365f, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1694818943756.aa5581efb16c18499914b11aedd5365f.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.tmp 2023-09-15 23:02:23,793 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1694818943756.3d7d5328b03e7580532dc45552cc1dc1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-15 23:02:23,794 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1604): Closing 3d7d5328b03e7580532dc45552cc1dc1, disabling compactions & flushes 2023-09-15 23:02:23,794 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1694818943756.3d7d5328b03e7580532dc45552cc1dc1. 2023-09-15 23:02:23,794 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1694818943756.3d7d5328b03e7580532dc45552cc1dc1. 2023-09-15 23:02:23,794 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1694818943756.3d7d5328b03e7580532dc45552cc1dc1. after waiting 0 ms 2023-09-15 23:02:23,794 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1694818943756.3d7d5328b03e7580532dc45552cc1dc1. 2023-09-15 23:02:23,794 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1694818943756.3d7d5328b03e7580532dc45552cc1dc1. 2023-09-15 23:02:23,794 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1558): Region close journal for 3d7d5328b03e7580532dc45552cc1dc1: 2023-09-15 23:02:23,794 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1694818943756.aa5581efb16c18499914b11aedd5365f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-15 23:02:23,795 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1604): Closing aa5581efb16c18499914b11aedd5365f, disabling compactions & flushes 2023-09-15 23:02:23,795 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1694818943756.aa5581efb16c18499914b11aedd5365f. 2023-09-15 23:02:23,795 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1694818943756.aa5581efb16c18499914b11aedd5365f. 2023-09-15 23:02:23,795 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1694818943756.aa5581efb16c18499914b11aedd5365f. after waiting 0 ms 2023-09-15 23:02:23,795 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1694818943756.aa5581efb16c18499914b11aedd5365f. 2023-09-15 23:02:23,795 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1694818943756.aa5581efb16c18499914b11aedd5365f. 2023-09-15 23:02:23,795 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1558): Region close journal for aa5581efb16c18499914b11aedd5365f: 2023-09-15 23:02:23,797 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ADD_TO_META 2023-09-15 23:02:23,798 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1694818943756.3d7d5328b03e7580532dc45552cc1dc1.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1694818943798"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694818943798"}]},"ts":"1694818943798"} 2023-09-15 23:02:23,798 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1694818943756.aa5581efb16c18499914b11aedd5365f.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1694818943798"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694818943798"}]},"ts":"1694818943798"} 2023-09-15 23:02:23,803 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-15 23:02:23,804 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-15 23:02:23,804 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694818943804"}]},"ts":"1694818943804"} 2023-09-15 23:02:23,805 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLING in hbase:meta 2023-09-15 23:02:23,808 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-15 23:02:23,810 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-15 23:02:23,810 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-15 23:02:23,810 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-15 23:02:23,810 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-15 23:02:23,810 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=aa5581efb16c18499914b11aedd5365f, ASSIGN}, {pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=3d7d5328b03e7580532dc45552cc1dc1, ASSIGN}] 2023-09-15 23:02:23,812 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=aa5581efb16c18499914b11aedd5365f, ASSIGN 2023-09-15 23:02:23,812 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=3d7d5328b03e7580532dc45552cc1dc1, ASSIGN 2023-09-15 23:02:23,813 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=aa5581efb16c18499914b11aedd5365f, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41413,1694818872288; forceNewPlan=false, retain=false 2023-09-15 23:02:23,813 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=3d7d5328b03e7580532dc45552cc1dc1, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34705,1694818872254; forceNewPlan=false, retain=false 2023-09-15 23:02:23,862 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-09-15 23:02:23,963 INFO [jenkins-hbase4:44427] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-15 23:02:23,966 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=aa5581efb16c18499914b11aedd5365f, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:02:23,966 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=3d7d5328b03e7580532dc45552cc1dc1, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:02:23,966 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1694818943756.aa5581efb16c18499914b11aedd5365f.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1694818943966"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694818943966"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694818943966"}]},"ts":"1694818943966"} 2023-09-15 23:02:23,966 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1694818943756.3d7d5328b03e7580532dc45552cc1dc1.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1694818943966"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694818943966"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694818943966"}]},"ts":"1694818943966"} 2023-09-15 23:02:23,968 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=60, ppid=58, state=RUNNABLE; OpenRegionProcedure aa5581efb16c18499914b11aedd5365f, server=jenkins-hbase4.apache.org,41413,1694818872288}] 2023-09-15 23:02:23,969 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=61, ppid=59, state=RUNNABLE; OpenRegionProcedure 3d7d5328b03e7580532dc45552cc1dc1, server=jenkins-hbase4.apache.org,34705,1694818872254}] 2023-09-15 23:02:24,063 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-09-15 23:02:24,126 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,,1694818943756.aa5581efb16c18499914b11aedd5365f. 2023-09-15 23:02:24,126 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,1,1694818943756.3d7d5328b03e7580532dc45552cc1dc1. 2023-09-15 23:02:24,126 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => aa5581efb16c18499914b11aedd5365f, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1694818943756.aa5581efb16c18499914b11aedd5365f.', STARTKEY => '', ENDKEY => '1'} 2023-09-15 23:02:24,126 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 3d7d5328b03e7580532dc45552cc1dc1, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1694818943756.3d7d5328b03e7580532dc45552cc1dc1.', STARTKEY => '1', ENDKEY => ''} 2023-09-15 23:02:24,127 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,1,1694818943756.3d7d5328b03e7580532dc45552cc1dc1. service=AccessControlService 2023-09-15 23:02:24,127 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,,1694818943756.aa5581efb16c18499914b11aedd5365f. service=AccessControlService 2023-09-15 23:02:24,127 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-15 23:02:24,127 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-15 23:02:24,127 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 3d7d5328b03e7580532dc45552cc1dc1 2023-09-15 23:02:24,127 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion aa5581efb16c18499914b11aedd5365f 2023-09-15 23:02:24,127 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1694818943756.3d7d5328b03e7580532dc45552cc1dc1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-15 23:02:24,127 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1694818943756.aa5581efb16c18499914b11aedd5365f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-15 23:02:24,127 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 3d7d5328b03e7580532dc45552cc1dc1 2023-09-15 23:02:24,127 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for aa5581efb16c18499914b11aedd5365f 2023-09-15 23:02:24,127 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for aa5581efb16c18499914b11aedd5365f 2023-09-15 23:02:24,127 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 3d7d5328b03e7580532dc45552cc1dc1 2023-09-15 23:02:24,128 INFO [StoreOpener-aa5581efb16c18499914b11aedd5365f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region aa5581efb16c18499914b11aedd5365f 2023-09-15 23:02:24,128 INFO [StoreOpener-3d7d5328b03e7580532dc45552cc1dc1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 3d7d5328b03e7580532dc45552cc1dc1 2023-09-15 23:02:24,130 DEBUG [StoreOpener-aa5581efb16c18499914b11aedd5365f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/default/testtb-testExportFileSystemStateWithMergeRegion/aa5581efb16c18499914b11aedd5365f/cf 2023-09-15 23:02:24,130 DEBUG [StoreOpener-3d7d5328b03e7580532dc45552cc1dc1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/default/testtb-testExportFileSystemStateWithMergeRegion/3d7d5328b03e7580532dc45552cc1dc1/cf 2023-09-15 23:02:24,130 DEBUG [StoreOpener-aa5581efb16c18499914b11aedd5365f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/default/testtb-testExportFileSystemStateWithMergeRegion/aa5581efb16c18499914b11aedd5365f/cf 2023-09-15 23:02:24,130 DEBUG [StoreOpener-3d7d5328b03e7580532dc45552cc1dc1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/default/testtb-testExportFileSystemStateWithMergeRegion/3d7d5328b03e7580532dc45552cc1dc1/cf 2023-09-15 23:02:24,131 INFO [StoreOpener-aa5581efb16c18499914b11aedd5365f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region aa5581efb16c18499914b11aedd5365f columnFamilyName cf 2023-09-15 23:02:24,131 INFO [StoreOpener-3d7d5328b03e7580532dc45552cc1dc1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3d7d5328b03e7580532dc45552cc1dc1 columnFamilyName cf 2023-09-15 23:02:24,133 INFO [StoreOpener-aa5581efb16c18499914b11aedd5365f-1] regionserver.HStore(310): Store=aa5581efb16c18499914b11aedd5365f/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-15 23:02:24,133 INFO [StoreOpener-3d7d5328b03e7580532dc45552cc1dc1-1] regionserver.HStore(310): Store=3d7d5328b03e7580532dc45552cc1dc1/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-15 23:02:24,134 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/default/testtb-testExportFileSystemStateWithMergeRegion/3d7d5328b03e7580532dc45552cc1dc1 2023-09-15 23:02:24,134 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/default/testtb-testExportFileSystemStateWithMergeRegion/3d7d5328b03e7580532dc45552cc1dc1 2023-09-15 23:02:24,137 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 3d7d5328b03e7580532dc45552cc1dc1 2023-09-15 23:02:24,137 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/default/testtb-testExportFileSystemStateWithMergeRegion/aa5581efb16c18499914b11aedd5365f 2023-09-15 23:02:24,138 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/default/testtb-testExportFileSystemStateWithMergeRegion/aa5581efb16c18499914b11aedd5365f 2023-09-15 23:02:24,139 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/default/testtb-testExportFileSystemStateWithMergeRegion/3d7d5328b03e7580532dc45552cc1dc1/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-15 23:02:24,140 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 3d7d5328b03e7580532dc45552cc1dc1; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65128499, jitterRate=-0.029509738087654114}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-15 23:02:24,140 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 3d7d5328b03e7580532dc45552cc1dc1: 2023-09-15 23:02:24,141 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,1,1694818943756.3d7d5328b03e7580532dc45552cc1dc1., pid=61, masterSystemTime=1694818944122 2023-09-15 23:02:24,141 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for aa5581efb16c18499914b11aedd5365f 2023-09-15 23:02:24,142 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,1,1694818943756.3d7d5328b03e7580532dc45552cc1dc1. 2023-09-15 23:02:24,142 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,1,1694818943756.3d7d5328b03e7580532dc45552cc1dc1. 2023-09-15 23:02:24,143 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=3d7d5328b03e7580532dc45552cc1dc1, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:02:24,143 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1694818943756.3d7d5328b03e7580532dc45552cc1dc1.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1694818944143"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1694818944143"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1694818944143"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1694818944143"}]},"ts":"1694818944143"} 2023-09-15 23:02:24,144 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/default/testtb-testExportFileSystemStateWithMergeRegion/aa5581efb16c18499914b11aedd5365f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-15 23:02:24,144 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened aa5581efb16c18499914b11aedd5365f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61041300, jitterRate=-0.09041374921798706}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-15 23:02:24,144 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for aa5581efb16c18499914b11aedd5365f: 2023-09-15 23:02:24,145 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,,1694818943756.aa5581efb16c18499914b11aedd5365f., pid=60, masterSystemTime=1694818944119 2023-09-15 23:02:24,146 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,,1694818943756.aa5581efb16c18499914b11aedd5365f. 2023-09-15 23:02:24,147 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,,1694818943756.aa5581efb16c18499914b11aedd5365f. 2023-09-15 23:02:24,147 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=aa5581efb16c18499914b11aedd5365f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:02:24,147 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=61, resume processing ppid=59 2023-09-15 23:02:24,147 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=61, ppid=59, state=SUCCESS; OpenRegionProcedure 3d7d5328b03e7580532dc45552cc1dc1, server=jenkins-hbase4.apache.org,34705,1694818872254 in 176 msec 2023-09-15 23:02:24,147 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1694818943756.aa5581efb16c18499914b11aedd5365f.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1694818944147"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1694818944147"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1694818944147"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1694818944147"}]},"ts":"1694818944147"} 2023-09-15 23:02:24,153 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=59, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=3d7d5328b03e7580532dc45552cc1dc1, ASSIGN in 337 msec 2023-09-15 23:02:24,154 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=60, resume processing ppid=58 2023-09-15 23:02:24,154 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=60, ppid=58, state=SUCCESS; OpenRegionProcedure aa5581efb16c18499914b11aedd5365f, server=jenkins-hbase4.apache.org,41413,1694818872288 in 181 msec 2023-09-15 23:02:24,156 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=58, resume processing ppid=57 2023-09-15 23:02:24,156 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=58, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=aa5581efb16c18499914b11aedd5365f, ASSIGN in 344 msec 2023-09-15 23:02:24,157 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-15 23:02:24,157 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694818944157"}]},"ts":"1694818944157"} 2023-09-15 23:02:24,158 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLED in hbase:meta 2023-09-15 23:02:24,160 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_POST_OPERATION 2023-09-15 23:02:24,161 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion jenkins: RWXCA 2023-09-15 23:02:24,162 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41413] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-09-15 23:02:24,164 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:33655-0x100b1d2daa90001, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-15 23:02:24,164 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-15 23:02:24,164 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:41413-0x100b1d2daa90003, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-15 23:02:24,164 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:34705-0x100b1d2daa90002, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-15 23:02:24,166 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-15 23:02:24,166 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-15 23:02:24,166 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-15 23:02:24,166 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-15 23:02:24,167 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=57, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 409 msec 2023-09-15 23:02:24,364 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-09-15 23:02:24,364 INFO [Listener at jenkins-hbase4.apache.org/46629] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 57 completed 2023-09-15 23:02:24,367 DEBUG [Listener at jenkins-hbase4.apache.org/46629] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-09-15 23:02:24,367 DEBUG [Listener at jenkins-hbase4.apache.org/46629] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1694818943756.aa5581efb16c18499914b11aedd5365f. 2023-09-15 23:02:24,369 INFO [Listener at jenkins-hbase4.apache.org/46629] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-15 23:02:24,388 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-15 23:02:24,388 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1694818944388 (current time:1694818944388). 2023-09-15 23:02:24,388 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-15 23:02:24,388 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] zookeeper.ReadOnlyZKClient(139): Connect 0x541d3d23 to 127.0.0.1:51149 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-15 23:02:24,394 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@b6eead1, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-15 23:02:24,395 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-15 23:02:24,398 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34758, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-15 23:02:24,399 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x541d3d23 to 127.0.0.1:51149 2023-09-15 23:02:24,399 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-15 23:02:24,399 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] zookeeper.ReadOnlyZKClient(139): Connect 0x2830d154 to 127.0.0.1:51149 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-15 23:02:24,410 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@15790554, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-15 23:02:24,411 DEBUG [hconnection-0x69bd4d48-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-15 23:02:24,412 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34772, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-15 23:02:24,417 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2830d154 to 127.0.0.1:51149 2023-09-15 23:02:24,417 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-15 23:02:24,417 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-09-15 23:02:24,418 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-15 23:02:24,418 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-15 23:02:24,420 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] procedure2.ProcedureExecutor(1028): Stored pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-15 23:02:24,421 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-15 23:02:24,422 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=62, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1694819544422 2023-09-15 23:02:24,422 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-09-15 23:02:24,422 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-15 23:02:24,423 DEBUG [Listener at jenkins-hbase4.apache.org/46629] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-15 23:02:24,423 DEBUG [Listener at jenkins-hbase4.apache.org/46629] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-15 23:02:24,424 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=62, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-15 23:02:24,424 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-15 23:02:24,425 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=62, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 5 msec 2023-09-15 23:02:24,426 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-15 23:02:24,426 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=63, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1694819544426 2023-09-15 23:02:24,442 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 23:02:24,442 INFO [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' 2023-09-15 23:02:24,442 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-15 23:02:24,443 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-09-15 23:02:24,444 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-09-15 23:02:24,444 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 23:02:24,444 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 23:02:24,445 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:34705-0x100b1d2daa90002, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 23:02:24,445 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:41413-0x100b1d2daa90003, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 23:02:24,445 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 23:02:24,445 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 23:02:24,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 23:02:24,445 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:02:24,445 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:33655-0x100b1d2daa90001, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 23:02:24,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 23:02:24,446 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 23:02:24,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 23:02:24,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 23:02:24,446 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:02:24,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 23:02:24,446 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:02:24,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 23:02:24,446 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41413-0x100b1d2daa90003, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 23:02:24,446 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33655-0x100b1d2daa90001, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 23:02:24,446 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:02:24,447 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-15 23:02:24,446 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34705-0x100b1d2daa90002, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 23:02:24,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-09-15 23:02:24,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-09-15 23:02:24,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 23:02:24,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 23:02:24,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-09-15 23:02:24,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 23:02:24,447 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-15 23:02:24,447 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-15 23:02:24,447 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-15 23:02:24,447 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 23:02:24,447 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 23:02:24,447 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-15 23:02:24,447 DEBUG [member: 'jenkins-hbase4.apache.org,33655,1694818872204' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-15 23:02:24,447 DEBUG [member: 'jenkins-hbase4.apache.org,33655,1694818872204' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-15 23:02:24,447 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 23:02:24,447 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-15 23:02:24,449 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-15 23:02:24,449 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-15 23:02:24,450 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-15 23:02:24,448 DEBUG [member: 'jenkins-hbase4.apache.org,33655,1694818872204' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-15 23:02:24,450 DEBUG [member: 'jenkins-hbase4.apache.org,33655,1694818872204' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-15 23:02:24,450 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41413,1694818872288' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-15 23:02:24,449 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-15 23:02:24,450 DEBUG [member: 'jenkins-hbase4.apache.org,33655,1694818872204' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33655,1694818872204' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-15 23:02:24,450 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-15 23:02:24,451 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-15 23:02:24,451 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34705,1694818872254' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-15 23:02:24,452 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 23:02:24,452 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:02:24,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:02:24,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-15 23:02:24,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-15 23:02:24,454 DEBUG [member: 'jenkins-hbase4.apache.org,33655,1694818872204' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 23:02:24,454 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:02:24,454 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 23:02:24,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-15 23:02:24,454 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41413-0x100b1d2daa90003, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 23:02:24,454 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-15 23:02:24,454 DEBUG [member: 'jenkins-hbase4.apache.org,33655,1694818872204' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33655-0x100b1d2daa90001, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 23:02:24,454 DEBUG [member: 'jenkins-hbase4.apache.org,33655,1694818872204' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-15 23:02:24,454 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34705-0x100b1d2daa90002, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 23:02:24,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-15 23:02:24,454 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-15 23:02:24,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 23:02:24,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:02:24,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:02:24,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33655,1694818872204 2023-09-15 23:02:24,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-15 23:02:24,455 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41413,1694818872288' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-09-15 23:02:24,456 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1c2ce177[Count = 1] remaining members to acquire global barrier 2023-09-15 23:02:24,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:02:24,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-15 23:02:24,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-15 23:02:24,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-15 23:02:24,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-15 23:02:24,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 23:02:24,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:02:24,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:02:24,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33655,1694818872204 2023-09-15 23:02:24,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-15 23:02:24,457 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34705,1694818872254' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-09-15 23:02:24,458 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1c2ce177[Count = 0] remaining members to acquire global barrier 2023-09-15 23:02:24,458 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-09-15 23:02:24,458 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 23:02:24,459 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:41413-0x100b1d2daa90003, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 23:02:24,459 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:33655-0x100b1d2daa90001, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 23:02:24,459 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 23:02:24,459 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 23:02:24,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 23:02:24,459 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:34705-0x100b1d2daa90002, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 23:02:24,459 DEBUG [member: 'jenkins-hbase4.apache.org,33655,1694818872204' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-15 23:02:24,459 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 23:02:24,459 DEBUG [member: 'jenkins-hbase4.apache.org,33655,1694818872204' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-15 23:02:24,459 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:02:24,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 23:02:24,459 DEBUG [member: 'jenkins-hbase4.apache.org,33655,1694818872204' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,33655,1694818872204' in zk 2023-09-15 23:02:24,459 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-15 23:02:24,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 23:02:24,459 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-15 23:02:24,459 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:02:24,460 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-15 23:02:24,460 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-15 23:02:24,460 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-15 23:02:24,460 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-15 23:02:24,460 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-15 23:02:24,460 DEBUG [rs(jenkins-hbase4.apache.org,41413,1694818872288)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1694818943756.aa5581efb16c18499914b11aedd5365f. 2023-09-15 23:02:24,460 DEBUG [rs(jenkins-hbase4.apache.org,34705,1694818872254)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1694818943756.3d7d5328b03e7580532dc45552cc1dc1. 2023-09-15 23:02:24,460 DEBUG [rs(jenkins-hbase4.apache.org,41413,1694818872288)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1694818943756.aa5581efb16c18499914b11aedd5365f. started... 2023-09-15 23:02:24,460 DEBUG [rs(jenkins-hbase4.apache.org,34705,1694818872254)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1694818943756.3d7d5328b03e7580532dc45552cc1dc1. started... 2023-09-15 23:02:24,461 DEBUG [rs(jenkins-hbase4.apache.org,41413,1694818872288)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for aa5581efb16c18499914b11aedd5365f: 2023-09-15 23:02:24,461 DEBUG [rs(jenkins-hbase4.apache.org,34705,1694818872254)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 3d7d5328b03e7580532dc45552cc1dc1: 2023-09-15 23:02:24,461 DEBUG [rs(jenkins-hbase4.apache.org,34705,1694818872254)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1694818943756.3d7d5328b03e7580532dc45552cc1dc1.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 23:02:24,461 DEBUG [rs(jenkins-hbase4.apache.org,41413,1694818872288)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1694818943756.aa5581efb16c18499914b11aedd5365f.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 23:02:24,461 DEBUG [rs(jenkins-hbase4.apache.org,34705,1694818872254)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-15 23:02:24,461 DEBUG [rs(jenkins-hbase4.apache.org,41413,1694818872288)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-15 23:02:24,461 DEBUG [rs(jenkins-hbase4.apache.org,34705,1694818872254)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-15 23:02:24,461 DEBUG [rs(jenkins-hbase4.apache.org,41413,1694818872288)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-15 23:02:24,464 DEBUG [member: 'jenkins-hbase4.apache.org,33655,1694818872204' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-15 23:02:24,464 DEBUG [member: 'jenkins-hbase4.apache.org,33655,1694818872204' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-15 23:02:24,464 DEBUG [member: 'jenkins-hbase4.apache.org,33655,1694818872204' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-15 23:02:24,486 DEBUG [rs(jenkins-hbase4.apache.org,41413,1694818872288)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1694818943756.aa5581efb16c18499914b11aedd5365f. completed. 2023-09-15 23:02:24,487 DEBUG [rs(jenkins-hbase4.apache.org,41413,1694818872288)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1694818943756.aa5581efb16c18499914b11aedd5365f. 2023-09-15 23:02:24,487 DEBUG [rs(jenkins-hbase4.apache.org,34705,1694818872254)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1694818943756.3d7d5328b03e7580532dc45552cc1dc1. completed. 2023-09-15 23:02:24,487 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-15 23:02:24,487 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-15 23:02:24,487 DEBUG [rs(jenkins-hbase4.apache.org,34705,1694818872254)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1694818943756.3d7d5328b03e7580532dc45552cc1dc1. 2023-09-15 23:02:24,487 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:02:24,487 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-15 23:02:24,487 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-15 23:02:24,487 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:02:24,487 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-15 23:02:24,487 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,41413,1694818872288' in zk 2023-09-15 23:02:24,487 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-15 23:02:24,487 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,34705,1694818872254' in zk 2023-09-15 23:02:24,489 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:02:24,489 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-15 23:02:24,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:02:24,489 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-15 23:02:24,489 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:02:24,489 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-15 23:02:24,489 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-15 23:02:24,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-15 23:02:24,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-15 23:02:24,490 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-15 23:02:24,489 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-15 23:02:24,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-15 23:02:24,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-15 23:02:24,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 23:02:24,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:02:24,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:02:24,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33655,1694818872204 2023-09-15 23:02:24,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-15 23:02:24,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 23:02:24,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:02:24,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:02:24,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33655,1694818872204 2023-09-15 23:02:24,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,41413,1694818872288': 2023-09-15 23:02:24,494 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41413,1694818872288' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-09-15 23:02:24,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:02:24,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-15 23:02:24,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-15 23:02:24,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-15 23:02:24,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-15 23:02:24,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 23:02:24,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:02:24,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:02:24,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33655,1694818872204 2023-09-15 23:02:24,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-15 23:02:24,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 23:02:24,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:02:24,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:02:24,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33655,1694818872204 2023-09-15 23:02:24,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,34705,1694818872254': 2023-09-15 23:02:24,498 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34705,1694818872254' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-09-15 23:02:24,498 INFO [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-09-15 23:02:24,498 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-15 23:02:24,498 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-15 23:02:24,498 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 23:02:24,498 INFO [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-15 23:02:24,500 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:41413-0x100b1d2daa90003, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 23:02:24,500 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:33655-0x100b1d2daa90001, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 23:02:24,500 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:41413-0x100b1d2daa90003, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 23:02:24,500 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:33655-0x100b1d2daa90001, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 23:02:24,500 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 23:02:24,500 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:34705-0x100b1d2daa90002, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 23:02:24,500 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 23:02:24,500 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 23:02:24,500 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 23:02:24,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 23:02:24,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 23:02:24,500 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:34705-0x100b1d2daa90002, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 23:02:24,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 23:02:24,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 23:02:24,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-15 23:02:24,502 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 23:02:24,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 23:02:24,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-15 23:02:24,502 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:02:24,502 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 23:02:24,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 23:02:24,502 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 23:02:24,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 23:02:24,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-15 23:02:24,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 23:02:24,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 23:02:24,503 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:02:24,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 23:02:24,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 23:02:24,504 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33655,1694818872204 2023-09-15 23:02:24,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-15 23:02:24,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 23:02:24,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:02:24,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:02:24,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33655,1694818872204 2023-09-15 23:02:24,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-15 23:02:24,506 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:02:24,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 23:02:24,507 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:02:24,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:02:24,507 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33655,1694818872204 2023-09-15 23:02:24,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:02:24,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33655,1694818872204 2023-09-15 23:02:24,512 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:34705-0x100b1d2daa90002, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 23:02:24,512 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:41413-0x100b1d2daa90003, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 23:02:24,512 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 23:02:24,513 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 23:02:24,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 23:02:24,513 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:34705-0x100b1d2daa90002, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 23:02:24,513 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 23:02:24,512 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:33655-0x100b1d2daa90001, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 23:02:24,513 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-09-15 23:02:24,513 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 23:02:24,513 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 23:02:24,512 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33655,1694818872204 2023-09-15 23:02:24,513 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-15 23:02:24,513 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 23:02:24,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 23:02:24,513 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:33655-0x100b1d2daa90001, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 23:02:24,513 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:41413-0x100b1d2daa90003, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 23:02:24,513 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-15 23:02:24,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 23:02:24,515 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 23:02:24,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 23:02:24,513 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 23:02:24,513 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:02:24,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 23:02:24,515 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:02:24,515 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 23:02:24,515 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33655,1694818872204 2023-09-15 23:02:24,515 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 23:02:24,515 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 23:02:24,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 23:02:24,515 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-15 23:02:24,515 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:02:24,516 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:02:24,516 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 23:02:24,516 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 23:02:24,523 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 23:02:24,523 DEBUG [Listener at jenkins-hbase4.apache.org/46629] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-15 23:02:24,524 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 23:02:24,524 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-09-15 23:02:24,525 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-09-15 23:02:24,525 DEBUG [Listener at jenkins-hbase4.apache.org/46629] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-15 23:02:24,545 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 23:02:24,545 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-09-15 23:02:24,545 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 23:02:24,546 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 23:02:24,546 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1694818944422Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1694818944523 (+101 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1694818944523Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1694818944523Writing data manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1694818944528 (+5 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1694818944540 (+12 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1694818944545 (+5 ms) 2023-09-15 23:02:24,548 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=63, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-15 23:02:24,550 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=63, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 125 msec 2023-09-15 23:02:24,725 DEBUG [Listener at jenkins-hbase4.apache.org/46629] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-15 23:02:24,726 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-09-15 23:02:24,726 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-15 23:02:24,728 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41413] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,,1694818943756.aa5581efb16c18499914b11aedd5365f. with WAL disabled. Data may be lost in the event of a crash. 2023-09-15 23:02:24,730 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34705] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,1,1694818943756.3d7d5328b03e7580532dc45552cc1dc1. with WAL disabled. Data may be lost in the event of a crash. 2023-09-15 23:02:24,732 DEBUG [Listener at jenkins-hbase4.apache.org/46629] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-09-15 23:02:24,733 DEBUG [Listener at jenkins-hbase4.apache.org/46629] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1694818943756.aa5581efb16c18499914b11aedd5365f. 2023-09-15 23:02:24,733 INFO [Listener at jenkins-hbase4.apache.org/46629] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-15 23:02:24,742 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-15 23:02:24,742 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1694818944742 (current time:1694818944742). 2023-09-15 23:02:24,742 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-15 23:02:24,743 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] zookeeper.ReadOnlyZKClient(139): Connect 0x76ac1545 to 127.0.0.1:51149 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-15 23:02:24,750 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@67920598, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-15 23:02:24,751 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-15 23:02:24,753 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34778, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-15 23:02:24,754 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x76ac1545 to 127.0.0.1:51149 2023-09-15 23:02:24,754 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-15 23:02:24,755 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] zookeeper.ReadOnlyZKClient(139): Connect 0x4d290cc3 to 127.0.0.1:51149 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-15 23:02:24,760 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5bb93e1e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-15 23:02:24,761 DEBUG [hconnection-0x2cf05e34-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-15 23:02:24,764 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34784, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-15 23:02:24,768 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4d290cc3 to 127.0.0.1:51149 2023-09-15 23:02:24,768 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-15 23:02:24,768 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-09-15 23:02:24,769 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-15 23:02:24,769 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-15 23:02:24,771 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] procedure2.ProcedureExecutor(1028): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-15 23:02:24,772 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-15 23:02:24,772 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1694819544772 2023-09-15 23:02:24,772 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-15 23:02:24,772 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-09-15 23:02:24,773 DEBUG [Listener at jenkins-hbase4.apache.org/46629] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-15 23:02:24,773 DEBUG [Listener at jenkins-hbase4.apache.org/46629] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-15 23:02:24,774 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-15 23:02:24,775 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-15 23:02:24,775 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 4 msec 2023-09-15 23:02:24,776 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-15 23:02:24,777 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=65, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1694819544777 2023-09-15 23:02:24,785 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 23:02:24,785 INFO [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' 2023-09-15 23:02:24,785 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-15 23:02:24,786 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-09-15 23:02:24,786 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-09-15 23:02:24,786 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 23:02:24,786 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 23:02:24,787 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:34705-0x100b1d2daa90002, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 23:02:24,787 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:41413-0x100b1d2daa90003, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 23:02:24,787 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 23:02:24,787 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 23:02:24,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 23:02:24,787 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:33655-0x100b1d2daa90001, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 23:02:24,787 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:02:24,788 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 23:02:24,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 23:02:24,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 23:02:24,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 23:02:24,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 23:02:24,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 23:02:24,788 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:02:24,788 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:02:24,788 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34705-0x100b1d2daa90002, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 23:02:24,788 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41413-0x100b1d2daa90003, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 23:02:24,789 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:02:24,789 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-15 23:02:24,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-09-15 23:02:24,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 23:02:24,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-09-15 23:02:24,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 23:02:24,789 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-15 23:02:24,789 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-15 23:02:24,789 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 23:02:24,789 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33655-0x100b1d2daa90001, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 23:02:24,789 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-15 23:02:24,789 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-15 23:02:24,789 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 23:02:24,790 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-15 23:02:24,790 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-15 23:02:24,790 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-15 23:02:24,790 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-15 23:02:24,790 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34705,1694818872254' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-15 23:02:24,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-09-15 23:02:24,791 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-15 23:02:24,791 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-15 23:02:24,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 23:02:24,791 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41413,1694818872288' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-15 23:02:24,791 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-15 23:02:24,791 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 23:02:24,792 DEBUG [member: 'jenkins-hbase4.apache.org,33655,1694818872204' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-15 23:02:24,792 DEBUG [member: 'jenkins-hbase4.apache.org,33655,1694818872204' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-15 23:02:24,792 DEBUG [member: 'jenkins-hbase4.apache.org,33655,1694818872204' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-15 23:02:24,792 DEBUG [member: 'jenkins-hbase4.apache.org,33655,1694818872204' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-15 23:02:24,792 DEBUG [member: 'jenkins-hbase4.apache.org,33655,1694818872204' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33655,1694818872204' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-15 23:02:24,793 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 23:02:24,793 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:02:24,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:02:24,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-15 23:02:24,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-15 23:02:24,794 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:02:24,794 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 23:02:24,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-15 23:02:24,794 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34705-0x100b1d2daa90002, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 23:02:24,794 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-15 23:02:24,796 DEBUG [member: 'jenkins-hbase4.apache.org,33655,1694818872204' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 23:02:24,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-15 23:02:24,796 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41413-0x100b1d2daa90003, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 23:02:24,796 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-15 23:02:24,796 DEBUG [member: 'jenkins-hbase4.apache.org,33655,1694818872204' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33655-0x100b1d2daa90001, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 23:02:24,796 DEBUG [member: 'jenkins-hbase4.apache.org,33655,1694818872204' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-15 23:02:24,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 23:02:24,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:02:24,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:02:24,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33655,1694818872204 2023-09-15 23:02:24,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-15 23:02:24,798 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34705,1694818872254' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-09-15 23:02:24,798 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4f60efe7[Count = 1] remaining members to acquire global barrier 2023-09-15 23:02:24,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:02:24,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-15 23:02:24,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-15 23:02:24,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-15 23:02:24,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-15 23:02:24,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 23:02:24,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:02:24,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:02:24,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33655,1694818872204 2023-09-15 23:02:24,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-15 23:02:24,800 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41413,1694818872288' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-09-15 23:02:24,800 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4f60efe7[Count = 0] remaining members to acquire global barrier 2023-09-15 23:02:24,800 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-09-15 23:02:24,800 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 23:02:24,801 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:34705-0x100b1d2daa90002, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 23:02:24,801 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:41413-0x100b1d2daa90003, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 23:02:24,801 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 23:02:24,801 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 23:02:24,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 23:02:24,801 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:33655-0x100b1d2daa90001, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 23:02:24,801 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-15 23:02:24,801 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 23:02:24,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 23:02:24,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 23:02:24,801 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-15 23:02:24,801 DEBUG [rs(jenkins-hbase4.apache.org,41413,1694818872288)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1694818943756.aa5581efb16c18499914b11aedd5365f. 2023-09-15 23:02:24,801 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-15 23:02:24,801 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-15 23:02:24,801 DEBUG [member: 'jenkins-hbase4.apache.org,33655,1694818872204' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-15 23:02:24,802 DEBUG [member: 'jenkins-hbase4.apache.org,33655,1694818872204' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-15 23:02:24,802 DEBUG [member: 'jenkins-hbase4.apache.org,33655,1694818872204' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,33655,1694818872204' in zk 2023-09-15 23:02:24,802 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-15 23:02:24,802 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-15 23:02:24,802 DEBUG [rs(jenkins-hbase4.apache.org,34705,1694818872254)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1694818943756.3d7d5328b03e7580532dc45552cc1dc1. 2023-09-15 23:02:24,801 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:02:24,802 DEBUG [rs(jenkins-hbase4.apache.org,34705,1694818872254)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1694818943756.3d7d5328b03e7580532dc45552cc1dc1. started... 2023-09-15 23:02:24,802 DEBUG [rs(jenkins-hbase4.apache.org,41413,1694818872288)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1694818943756.aa5581efb16c18499914b11aedd5365f. started... 2023-09-15 23:02:24,802 INFO [rs(jenkins-hbase4.apache.org,41413,1694818872288)-snapshot-pool-0] regionserver.HRegion(2745): Flushing aa5581efb16c18499914b11aedd5365f 1/1 column families, dataSize=266 B heapSize=832 B 2023-09-15 23:02:24,802 INFO [rs(jenkins-hbase4.apache.org,34705,1694818872254)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 3d7d5328b03e7580532dc45552cc1dc1 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-09-15 23:02:24,802 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:02:24,802 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-15 23:02:24,803 DEBUG [member: 'jenkins-hbase4.apache.org,33655,1694818872204' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-15 23:02:24,803 DEBUG [member: 'jenkins-hbase4.apache.org,33655,1694818872204' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-15 23:02:24,803 DEBUG [member: 'jenkins-hbase4.apache.org,33655,1694818872204' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-15 23:02:24,818 INFO [rs(jenkins-hbase4.apache.org,41413,1694818872288)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230915a92eda2910de4b80929241357debc368 to hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230915a92eda2910de4b80929241357debc368 2023-09-15 23:02:24,819 INFO [rs(jenkins-hbase4.apache.org,34705,1694818872254)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202309156a5829417bd247e5b5e2a57f4307915c to hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b202309156a5829417bd247e5b5e2a57f4307915c 2023-09-15 23:02:24,825 INFO [rs(jenkins-hbase4.apache.org,41413,1694818872288)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=266, hasBloomFilter=true, into tmp file hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/default/testtb-testExportFileSystemStateWithMergeRegion/aa5581efb16c18499914b11aedd5365f/.tmp/cf/09937954a71441e4b3624d0261519a04 2023-09-15 23:02:24,826 INFO [rs(jenkins-hbase4.apache.org,34705,1694818872254)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.0 K, hasBloomFilter=true, into tmp file hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/default/testtb-testExportFileSystemStateWithMergeRegion/3d7d5328b03e7580532dc45552cc1dc1/.tmp/cf/c16e02d34f7c4ab19c6d3682bce2f4c1 2023-09-15 23:02:24,830 DEBUG [rs(jenkins-hbase4.apache.org,34705,1694818872254)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/default/testtb-testExportFileSystemStateWithMergeRegion/3d7d5328b03e7580532dc45552cc1dc1/.tmp/cf/c16e02d34f7c4ab19c6d3682bce2f4c1 as hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/default/testtb-testExportFileSystemStateWithMergeRegion/3d7d5328b03e7580532dc45552cc1dc1/cf/c16e02d34f7c4ab19c6d3682bce2f4c1 2023-09-15 23:02:24,830 DEBUG [rs(jenkins-hbase4.apache.org,41413,1694818872288)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/default/testtb-testExportFileSystemStateWithMergeRegion/aa5581efb16c18499914b11aedd5365f/.tmp/cf/09937954a71441e4b3624d0261519a04 as hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/default/testtb-testExportFileSystemStateWithMergeRegion/aa5581efb16c18499914b11aedd5365f/cf/09937954a71441e4b3624d0261519a04 2023-09-15 23:02:24,835 INFO [rs(jenkins-hbase4.apache.org,34705,1694818872254)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/default/testtb-testExportFileSystemStateWithMergeRegion/3d7d5328b03e7580532dc45552cc1dc1/cf/c16e02d34f7c4ab19c6d3682bce2f4c1, entries=46, sequenceid=6, filesize=13.4 K 2023-09-15 23:02:24,835 INFO [rs(jenkins-hbase4.apache.org,41413,1694818872288)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/default/testtb-testExportFileSystemStateWithMergeRegion/aa5581efb16c18499914b11aedd5365f/cf/09937954a71441e4b3624d0261519a04, entries=4, sequenceid=6, filesize=5.6 K 2023-09-15 23:02:24,836 INFO [rs(jenkins-hbase4.apache.org,34705,1694818872254)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for 3d7d5328b03e7580532dc45552cc1dc1 in 34ms, sequenceid=6, compaction requested=false 2023-09-15 23:02:24,836 DEBUG [rs(jenkins-hbase4.apache.org,34705,1694818872254)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion' 2023-09-15 23:02:24,836 INFO [rs(jenkins-hbase4.apache.org,41413,1694818872288)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for aa5581efb16c18499914b11aedd5365f in 34ms, sequenceid=6, compaction requested=false 2023-09-15 23:02:24,836 DEBUG [rs(jenkins-hbase4.apache.org,41413,1694818872288)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion' 2023-09-15 23:02:24,839 DEBUG [rs(jenkins-hbase4.apache.org,34705,1694818872254)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 3d7d5328b03e7580532dc45552cc1dc1: 2023-09-15 23:02:24,839 DEBUG [rs(jenkins-hbase4.apache.org,41413,1694818872288)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for aa5581efb16c18499914b11aedd5365f: 2023-09-15 23:02:24,839 DEBUG [rs(jenkins-hbase4.apache.org,34705,1694818872254)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1694818943756.3d7d5328b03e7580532dc45552cc1dc1.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 23:02:24,839 DEBUG [rs(jenkins-hbase4.apache.org,41413,1694818872288)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1694818943756.aa5581efb16c18499914b11aedd5365f.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 23:02:24,839 DEBUG [rs(jenkins-hbase4.apache.org,34705,1694818872254)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-15 23:02:24,839 DEBUG [rs(jenkins-hbase4.apache.org,41413,1694818872288)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-15 23:02:24,840 DEBUG [rs(jenkins-hbase4.apache.org,34705,1694818872254)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/default/testtb-testExportFileSystemStateWithMergeRegion/3d7d5328b03e7580532dc45552cc1dc1/cf/c16e02d34f7c4ab19c6d3682bce2f4c1] hfiles 2023-09-15 23:02:24,840 DEBUG [rs(jenkins-hbase4.apache.org,41413,1694818872288)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/default/testtb-testExportFileSystemStateWithMergeRegion/aa5581efb16c18499914b11aedd5365f/cf/09937954a71441e4b3624d0261519a04] hfiles 2023-09-15 23:02:24,840 DEBUG [rs(jenkins-hbase4.apache.org,41413,1694818872288)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/default/testtb-testExportFileSystemStateWithMergeRegion/aa5581efb16c18499914b11aedd5365f/cf/09937954a71441e4b3624d0261519a04 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 23:02:24,840 DEBUG [rs(jenkins-hbase4.apache.org,34705,1694818872254)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/default/testtb-testExportFileSystemStateWithMergeRegion/3d7d5328b03e7580532dc45552cc1dc1/cf/c16e02d34f7c4ab19c6d3682bce2f4c1 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 23:02:24,849 DEBUG [rs(jenkins-hbase4.apache.org,34705,1694818872254)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1694818943756.3d7d5328b03e7580532dc45552cc1dc1. completed. 2023-09-15 23:02:24,849 DEBUG [rs(jenkins-hbase4.apache.org,41413,1694818872288)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1694818943756.aa5581efb16c18499914b11aedd5365f. completed. 2023-09-15 23:02:24,849 DEBUG [rs(jenkins-hbase4.apache.org,41413,1694818872288)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1694818943756.aa5581efb16c18499914b11aedd5365f. 2023-09-15 23:02:24,849 DEBUG [rs(jenkins-hbase4.apache.org,34705,1694818872254)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1694818943756.3d7d5328b03e7580532dc45552cc1dc1. 2023-09-15 23:02:24,849 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-15 23:02:24,849 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-15 23:02:24,849 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-15 23:02:24,849 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-15 23:02:24,849 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:02:24,849 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:02:24,850 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-15 23:02:24,850 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-15 23:02:24,850 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,41413,1694818872288' in zk 2023-09-15 23:02:24,850 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,34705,1694818872254' in zk 2023-09-15 23:02:24,851 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-15 23:02:24,851 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:02:24,851 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-15 23:02:24,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:02:24,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-15 23:02:24,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-15 23:02:24,851 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-15 23:02:24,852 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-15 23:02:24,851 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:02:24,852 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-15 23:02:24,853 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-15 23:02:24,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-15 23:02:24,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-15 23:02:24,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 23:02:24,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:02:24,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:02:24,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33655,1694818872204 2023-09-15 23:02:24,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-15 23:02:24,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 23:02:24,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:02:24,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:02:24,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33655,1694818872204 2023-09-15 23:02:24,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,41413,1694818872288': 2023-09-15 23:02:24,857 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41413,1694818872288' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-09-15 23:02:24,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:02:24,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-15 23:02:24,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-15 23:02:24,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-15 23:02:24,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-15 23:02:24,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 23:02:24,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:02:24,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:02:24,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33655,1694818872204 2023-09-15 23:02:24,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-15 23:02:24,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 23:02:24,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:02:24,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:02:24,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33655,1694818872204 2023-09-15 23:02:24,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,34705,1694818872254': 2023-09-15 23:02:24,860 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34705,1694818872254' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-09-15 23:02:24,860 INFO [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-09-15 23:02:24,860 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-15 23:02:24,860 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-15 23:02:24,860 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 23:02:24,860 INFO [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-15 23:02:24,866 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:34705-0x100b1d2daa90002, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 23:02:24,866 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 23:02:24,866 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 23:02:24,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 23:02:24,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-15 23:02:24,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-15 23:02:24,866 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:41413-0x100b1d2daa90003, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 23:02:24,866 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:33655-0x100b1d2daa90001, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 23:02:24,866 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 23:02:24,866 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:41413-0x100b1d2daa90003, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 23:02:24,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 23:02:24,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 23:02:24,867 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:02:24,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-15 23:02:24,866 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:34705-0x100b1d2daa90002, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 23:02:24,867 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 23:02:24,867 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 23:02:24,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 23:02:24,867 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:33655-0x100b1d2daa90001, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 23:02:24,867 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:02:24,867 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 23:02:24,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 23:02:24,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 23:02:24,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 23:02:24,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 23:02:24,868 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33655,1694818872204 2023-09-15 23:02:24,868 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 23:02:24,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 23:02:24,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-15 23:02:24,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 23:02:24,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 23:02:24,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 23:02:24,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:02:24,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:02:24,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33655,1694818872204 2023-09-15 23:02:24,869 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:02:24,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-15 23:02:24,869 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:02:24,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 23:02:24,870 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33655,1694818872204 2023-09-15 23:02:24,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:02:24,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:02:24,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33655,1694818872204 2023-09-15 23:02:24,872 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33655,1694818872204 2023-09-15 23:02:24,872 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 23:02:24,872 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:34705-0x100b1d2daa90002, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 23:02:24,872 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:41413-0x100b1d2daa90003, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 23:02:24,872 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 23:02:24,873 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-15 23:02:24,872 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 23:02:24,872 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:41413-0x100b1d2daa90003, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 23:02:24,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 23:02:24,872 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:34705-0x100b1d2daa90002, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 23:02:24,872 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:33655-0x100b1d2daa90001, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 23:02:24,872 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:02:24,874 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 23:02:24,874 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:02:24,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 23:02:24,874 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:33655-0x100b1d2daa90001, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 23:02:24,874 DEBUG [Listener at jenkins-hbase4.apache.org/46629] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-15 23:02:24,873 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 23:02:24,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 23:02:24,874 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 23:02:24,874 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-09-15 23:02:24,874 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 23:02:24,874 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 23:02:24,874 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 23:02:24,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 23:02:24,874 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 23:02:24,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 23:02:24,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 23:02:24,874 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-15 23:02:24,874 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33655,1694818872204 2023-09-15 23:02:24,875 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 23:02:24,875 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:02:24,875 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:02:24,875 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 23:02:24,875 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-09-15 23:02:24,875 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 23:02:24,875 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-09-15 23:02:24,875 DEBUG [Listener at jenkins-hbase4.apache.org/46629] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-15 23:02:24,875 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b202309156a5829417bd247e5b5e2a57f4307915c, hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230915a92eda2910de4b80929241357debc368] mob files 2023-09-15 23:02:24,876 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b202309156a5829417bd247e5b5e2a57f4307915c 2023-09-15 23:02:24,876 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230915a92eda2910de4b80929241357debc368 2023-09-15 23:02:24,887 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 23:02:24,888 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 23:02:24,907 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 23:02:24,908 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-09-15 23:02:24,908 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 23:02:24,908 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 23:02:24,908 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1694818944772Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1694818944887 (+115 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1694818944887Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion at 1694818944887Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion at 1694818944890 (+3 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1694818944900 (+10 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1694818944908 (+8 ms) 2023-09-15 23:02:24,911 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=65, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-15 23:02:24,912 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=65, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 138 msec 2023-09-15 23:02:25,075 DEBUG [Listener at jenkins-hbase4.apache.org/46629] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-15 23:02:25,076 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-09-15 23:02:25,076 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-15 23:02:25,104 DEBUG [Listener at jenkins-hbase4.apache.org/46629] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-15 23:02:25,107 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44040, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-15 23:02:25,109 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33655] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-09-15 23:02:25,109 DEBUG [Listener at jenkins-hbase4.apache.org/46629] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-15 23:02:25,114 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43458, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-15 23:02:25,114 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34705] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-09-15 23:02:25,114 DEBUG [Listener at jenkins-hbase4.apache.org/46629] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-15 23:02:25,118 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34790, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-15 23:02:25,118 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41413] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-09-15 23:02:25,120 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-09-15 23:02:25,121 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] procedure2.ProcedureExecutor(1028): Stored pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-15 23:02:25,123 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_PRE_OPERATION 2023-09-15 23:02:25,123 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion-1" procId is: 66 2023-09-15 23:02:25,124 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-15 23:02:25,124 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-09-15 23:02:25,126 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/da9a5cd60743ee48f6eddb97a5ea010b 2023-09-15 23:02:25,126 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/54c5bf13d3468c7b6979d92de59ce64b 2023-09-15 23:02:25,127 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/da9a5cd60743ee48f6eddb97a5ea010b empty. 2023-09-15 23:02:25,127 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/54c5bf13d3468c7b6979d92de59ce64b empty. 2023-09-15 23:02:25,127 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/da9a5cd60743ee48f6eddb97a5ea010b 2023-09-15 23:02:25,127 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/54c5bf13d3468c7b6979d92de59ce64b 2023-09-15 23:02:25,127 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-09-15 23:02:25,138 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/.tabledesc/.tableinfo.0000000001 2023-09-15 23:02:25,139 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(7675): creating {ENCODED => da9a5cd60743ee48f6eddb97a5ea010b, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1694818945120.da9a5cd60743ee48f6eddb97a5ea010b.', STARTKEY => '', ENDKEY => '2'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.tmp 2023-09-15 23:02:25,139 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(7675): creating {ENCODED => 54c5bf13d3468c7b6979d92de59ce64b, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1694818945120.54c5bf13d3468c7b6979d92de59ce64b.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.tmp 2023-09-15 23:02:25,148 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1694818945120.da9a5cd60743ee48f6eddb97a5ea010b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-15 23:02:25,148 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1604): Closing da9a5cd60743ee48f6eddb97a5ea010b, disabling compactions & flushes 2023-09-15 23:02:25,148 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1694818945120.da9a5cd60743ee48f6eddb97a5ea010b. 2023-09-15 23:02:25,149 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1694818945120.54c5bf13d3468c7b6979d92de59ce64b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-15 23:02:25,149 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1694818945120.da9a5cd60743ee48f6eddb97a5ea010b. 2023-09-15 23:02:25,149 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1604): Closing 54c5bf13d3468c7b6979d92de59ce64b, disabling compactions & flushes 2023-09-15 23:02:25,149 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1694818945120.da9a5cd60743ee48f6eddb97a5ea010b. after waiting 0 ms 2023-09-15 23:02:25,149 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1694818945120.da9a5cd60743ee48f6eddb97a5ea010b. 2023-09-15 23:02:25,149 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1694818945120.54c5bf13d3468c7b6979d92de59ce64b. 2023-09-15 23:02:25,149 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1694818945120.da9a5cd60743ee48f6eddb97a5ea010b. 2023-09-15 23:02:25,149 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1694818945120.54c5bf13d3468c7b6979d92de59ce64b. 2023-09-15 23:02:25,149 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1558): Region close journal for da9a5cd60743ee48f6eddb97a5ea010b: 2023-09-15 23:02:25,149 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1694818945120.54c5bf13d3468c7b6979d92de59ce64b. after waiting 0 ms 2023-09-15 23:02:25,149 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1694818945120.54c5bf13d3468c7b6979d92de59ce64b. 2023-09-15 23:02:25,149 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1694818945120.54c5bf13d3468c7b6979d92de59ce64b. 2023-09-15 23:02:25,149 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1558): Region close journal for 54c5bf13d3468c7b6979d92de59ce64b: 2023-09-15 23:02:25,151 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ADD_TO_META 2023-09-15 23:02:25,152 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1694818945120.da9a5cd60743ee48f6eddb97a5ea010b.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1694818945152"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694818945152"}]},"ts":"1694818945152"} 2023-09-15 23:02:25,152 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1694818945120.54c5bf13d3468c7b6979d92de59ce64b.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1694818945152"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694818945152"}]},"ts":"1694818945152"} 2023-09-15 23:02:25,154 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-15 23:02:25,155 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-15 23:02:25,155 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694818945155"}]},"ts":"1694818945155"} 2023-09-15 23:02:25,156 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLING in hbase:meta 2023-09-15 23:02:25,159 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-15 23:02:25,160 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-15 23:02:25,161 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-15 23:02:25,161 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-15 23:02:25,161 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-15 23:02:25,161 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=da9a5cd60743ee48f6eddb97a5ea010b, ASSIGN}, {pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=54c5bf13d3468c7b6979d92de59ce64b, ASSIGN}] 2023-09-15 23:02:25,164 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=da9a5cd60743ee48f6eddb97a5ea010b, ASSIGN 2023-09-15 23:02:25,164 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=54c5bf13d3468c7b6979d92de59ce64b, ASSIGN 2023-09-15 23:02:25,164 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=da9a5cd60743ee48f6eddb97a5ea010b, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41413,1694818872288; forceNewPlan=false, retain=false 2023-09-15 23:02:25,164 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=54c5bf13d3468c7b6979d92de59ce64b, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33655,1694818872204; forceNewPlan=false, retain=false 2023-09-15 23:02:25,225 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-09-15 23:02:25,315 INFO [jenkins-hbase4:44427] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-15 23:02:25,317 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=da9a5cd60743ee48f6eddb97a5ea010b, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:02:25,317 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=54c5bf13d3468c7b6979d92de59ce64b, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33655,1694818872204 2023-09-15 23:02:25,317 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1694818945120.da9a5cd60743ee48f6eddb97a5ea010b.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1694818945317"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694818945317"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694818945317"}]},"ts":"1694818945317"} 2023-09-15 23:02:25,317 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1694818945120.54c5bf13d3468c7b6979d92de59ce64b.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1694818945317"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694818945317"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694818945317"}]},"ts":"1694818945317"} 2023-09-15 23:02:25,319 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=69, ppid=67, state=RUNNABLE; OpenRegionProcedure da9a5cd60743ee48f6eddb97a5ea010b, server=jenkins-hbase4.apache.org,41413,1694818872288}] 2023-09-15 23:02:25,319 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=70, ppid=68, state=RUNNABLE; OpenRegionProcedure 54c5bf13d3468c7b6979d92de59ce64b, server=jenkins-hbase4.apache.org,33655,1694818872204}] 2023-09-15 23:02:25,426 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-09-15 23:02:25,473 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1694818945120.da9a5cd60743ee48f6eddb97a5ea010b. 2023-09-15 23:02:25,473 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => da9a5cd60743ee48f6eddb97a5ea010b, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1694818945120.da9a5cd60743ee48f6eddb97a5ea010b.', STARTKEY => '', ENDKEY => '2'} 2023-09-15 23:02:25,474 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,2,1694818945120.54c5bf13d3468c7b6979d92de59ce64b. 2023-09-15 23:02:25,474 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 54c5bf13d3468c7b6979d92de59ce64b, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1694818945120.54c5bf13d3468c7b6979d92de59ce64b.', STARTKEY => '2', ENDKEY => ''} 2023-09-15 23:02:25,474 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1694818945120.da9a5cd60743ee48f6eddb97a5ea010b. service=AccessControlService 2023-09-15 23:02:25,475 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,2,1694818945120.54c5bf13d3468c7b6979d92de59ce64b. service=AccessControlService 2023-09-15 23:02:25,475 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-15 23:02:25,475 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-15 23:02:25,475 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 da9a5cd60743ee48f6eddb97a5ea010b 2023-09-15 23:02:25,475 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 54c5bf13d3468c7b6979d92de59ce64b 2023-09-15 23:02:25,475 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1694818945120.da9a5cd60743ee48f6eddb97a5ea010b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-15 23:02:25,475 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1694818945120.54c5bf13d3468c7b6979d92de59ce64b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-15 23:02:25,475 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for da9a5cd60743ee48f6eddb97a5ea010b 2023-09-15 23:02:25,475 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 54c5bf13d3468c7b6979d92de59ce64b 2023-09-15 23:02:25,475 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 54c5bf13d3468c7b6979d92de59ce64b 2023-09-15 23:02:25,475 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for da9a5cd60743ee48f6eddb97a5ea010b 2023-09-15 23:02:25,476 INFO [StoreOpener-da9a5cd60743ee48f6eddb97a5ea010b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region da9a5cd60743ee48f6eddb97a5ea010b 2023-09-15 23:02:25,476 INFO [StoreOpener-54c5bf13d3468c7b6979d92de59ce64b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 54c5bf13d3468c7b6979d92de59ce64b 2023-09-15 23:02:25,478 DEBUG [StoreOpener-da9a5cd60743ee48f6eddb97a5ea010b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/da9a5cd60743ee48f6eddb97a5ea010b/cf 2023-09-15 23:02:25,478 DEBUG [StoreOpener-54c5bf13d3468c7b6979d92de59ce64b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/54c5bf13d3468c7b6979d92de59ce64b/cf 2023-09-15 23:02:25,478 DEBUG [StoreOpener-54c5bf13d3468c7b6979d92de59ce64b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/54c5bf13d3468c7b6979d92de59ce64b/cf 2023-09-15 23:02:25,478 DEBUG [StoreOpener-da9a5cd60743ee48f6eddb97a5ea010b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/da9a5cd60743ee48f6eddb97a5ea010b/cf 2023-09-15 23:02:25,478 INFO [StoreOpener-da9a5cd60743ee48f6eddb97a5ea010b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region da9a5cd60743ee48f6eddb97a5ea010b columnFamilyName cf 2023-09-15 23:02:25,478 INFO [StoreOpener-54c5bf13d3468c7b6979d92de59ce64b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 54c5bf13d3468c7b6979d92de59ce64b columnFamilyName cf 2023-09-15 23:02:25,479 INFO [StoreOpener-da9a5cd60743ee48f6eddb97a5ea010b-1] regionserver.HStore(310): Store=da9a5cd60743ee48f6eddb97a5ea010b/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-15 23:02:25,479 INFO [StoreOpener-54c5bf13d3468c7b6979d92de59ce64b-1] regionserver.HStore(310): Store=54c5bf13d3468c7b6979d92de59ce64b/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-15 23:02:25,480 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/54c5bf13d3468c7b6979d92de59ce64b 2023-09-15 23:02:25,480 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/da9a5cd60743ee48f6eddb97a5ea010b 2023-09-15 23:02:25,480 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/54c5bf13d3468c7b6979d92de59ce64b 2023-09-15 23:02:25,480 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/da9a5cd60743ee48f6eddb97a5ea010b 2023-09-15 23:02:25,483 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 54c5bf13d3468c7b6979d92de59ce64b 2023-09-15 23:02:25,483 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for da9a5cd60743ee48f6eddb97a5ea010b 2023-09-15 23:02:25,485 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/54c5bf13d3468c7b6979d92de59ce64b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-15 23:02:25,485 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/da9a5cd60743ee48f6eddb97a5ea010b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-15 23:02:25,485 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 54c5bf13d3468c7b6979d92de59ce64b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72875652, jitterRate=0.08593183755874634}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-15 23:02:25,485 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened da9a5cd60743ee48f6eddb97a5ea010b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68433316, jitterRate=0.019735872745513916}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-15 23:02:25,485 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 54c5bf13d3468c7b6979d92de59ce64b: 2023-09-15 23:02:25,485 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for da9a5cd60743ee48f6eddb97a5ea010b: 2023-09-15 23:02:25,486 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,2,1694818945120.54c5bf13d3468c7b6979d92de59ce64b., pid=70, masterSystemTime=1694818945471 2023-09-15 23:02:25,486 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1694818945120.da9a5cd60743ee48f6eddb97a5ea010b., pid=69, masterSystemTime=1694818945470 2023-09-15 23:02:25,487 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,2,1694818945120.54c5bf13d3468c7b6979d92de59ce64b. 2023-09-15 23:02:25,487 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,2,1694818945120.54c5bf13d3468c7b6979d92de59ce64b. 2023-09-15 23:02:25,488 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=54c5bf13d3468c7b6979d92de59ce64b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33655,1694818872204 2023-09-15 23:02:25,488 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1694818945120.54c5bf13d3468c7b6979d92de59ce64b.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1694818945488"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1694818945488"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1694818945488"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1694818945488"}]},"ts":"1694818945488"} 2023-09-15 23:02:25,488 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1694818945120.da9a5cd60743ee48f6eddb97a5ea010b. 2023-09-15 23:02:25,488 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1694818945120.da9a5cd60743ee48f6eddb97a5ea010b. 2023-09-15 23:02:25,489 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=da9a5cd60743ee48f6eddb97a5ea010b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:02:25,489 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1694818945120.da9a5cd60743ee48f6eddb97a5ea010b.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1694818945488"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1694818945488"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1694818945488"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1694818945488"}]},"ts":"1694818945488"} 2023-09-15 23:02:25,491 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=70, resume processing ppid=68 2023-09-15 23:02:25,491 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=70, ppid=68, state=SUCCESS; OpenRegionProcedure 54c5bf13d3468c7b6979d92de59ce64b, server=jenkins-hbase4.apache.org,33655,1694818872204 in 171 msec 2023-09-15 23:02:25,492 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=69, resume processing ppid=67 2023-09-15 23:02:25,492 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=69, ppid=67, state=SUCCESS; OpenRegionProcedure da9a5cd60743ee48f6eddb97a5ea010b, server=jenkins-hbase4.apache.org,41413,1694818872288 in 171 msec 2023-09-15 23:02:25,492 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=68, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=54c5bf13d3468c7b6979d92de59ce64b, ASSIGN in 330 msec 2023-09-15 23:02:25,493 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=67, resume processing ppid=66 2023-09-15 23:02:25,493 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=da9a5cd60743ee48f6eddb97a5ea010b, ASSIGN in 331 msec 2023-09-15 23:02:25,494 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-15 23:02:25,494 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694818945494"}]},"ts":"1694818945494"} 2023-09-15 23:02:25,495 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLED in hbase:meta 2023-09-15 23:02:25,501 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_POST_OPERATION 2023-09-15 23:02:25,502 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion-1 jenkins: RWXCA 2023-09-15 23:02:25,503 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41413] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-09-15 23:02:25,505 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:34705-0x100b1d2daa90002, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-15 23:02:25,505 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:41413-0x100b1d2daa90003, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-15 23:02:25,505 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-15 23:02:25,505 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:33655-0x100b1d2daa90001, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-15 23:02:25,507 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-15 23:02:25,507 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-15 23:02:25,507 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-15 23:02:25,507 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-15 23:02:25,507 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-09-15 23:02:25,507 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-09-15 23:02:25,507 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-09-15 23:02:25,507 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-09-15 23:02:25,508 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=66, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 386 msec 2023-09-15 23:02:25,728 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-09-15 23:02:25,728 INFO [Listener at jenkins-hbase4.apache.org/46629] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 66 completed 2023-09-15 23:02:25,748 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] master.HMaster$2(1952): Client=jenkins//172.31.14.131 merge regions da9a5cd60743ee48f6eddb97a5ea010b, 54c5bf13d3468c7b6979d92de59ce64b 2023-09-15 23:02:25,757 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] procedure2.ProcedureExecutor(1028): Stored pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[da9a5cd60743ee48f6eddb97a5ea010b, 54c5bf13d3468c7b6979d92de59ce64b], force=true 2023-09-15 23:02:25,759 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[da9a5cd60743ee48f6eddb97a5ea010b, 54c5bf13d3468c7b6979d92de59ce64b], force=true 2023-09-15 23:02:25,759 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[da9a5cd60743ee48f6eddb97a5ea010b, 54c5bf13d3468c7b6979d92de59ce64b], force=true 2023-09-15 23:02:25,759 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[da9a5cd60743ee48f6eddb97a5ea010b, 54c5bf13d3468c7b6979d92de59ce64b], force=true 2023-09-15 23:02:25,761 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-09-15 23:02:25,781 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=da9a5cd60743ee48f6eddb97a5ea010b, UNASSIGN}, {pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=54c5bf13d3468c7b6979d92de59ce64b, UNASSIGN}] 2023-09-15 23:02:25,783 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=54c5bf13d3468c7b6979d92de59ce64b, UNASSIGN 2023-09-15 23:02:25,783 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=da9a5cd60743ee48f6eddb97a5ea010b, UNASSIGN 2023-09-15 23:02:25,784 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=da9a5cd60743ee48f6eddb97a5ea010b, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:02:25,784 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=54c5bf13d3468c7b6979d92de59ce64b, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,33655,1694818872204 2023-09-15 23:02:25,784 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1694818945120.da9a5cd60743ee48f6eddb97a5ea010b.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1694818945784"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694818945784"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694818945784"}]},"ts":"1694818945784"} 2023-09-15 23:02:25,784 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1694818945120.54c5bf13d3468c7b6979d92de59ce64b.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1694818945784"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694818945784"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694818945784"}]},"ts":"1694818945784"} 2023-09-15 23:02:25,786 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=74, ppid=72, state=RUNNABLE; CloseRegionProcedure da9a5cd60743ee48f6eddb97a5ea010b, server=jenkins-hbase4.apache.org,41413,1694818872288}] 2023-09-15 23:02:25,787 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=75, ppid=73, state=RUNNABLE; CloseRegionProcedure 54c5bf13d3468c7b6979d92de59ce64b, server=jenkins-hbase4.apache.org,33655,1694818872204}] 2023-09-15 23:02:25,862 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-09-15 23:02:25,886 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion-1' 2023-09-15 23:02:25,938 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close da9a5cd60743ee48f6eddb97a5ea010b 2023-09-15 23:02:25,940 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing da9a5cd60743ee48f6eddb97a5ea010b, disabling compactions & flushes 2023-09-15 23:02:25,940 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1694818945120.da9a5cd60743ee48f6eddb97a5ea010b. 2023-09-15 23:02:25,940 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1694818945120.da9a5cd60743ee48f6eddb97a5ea010b. 2023-09-15 23:02:25,940 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1694818945120.da9a5cd60743ee48f6eddb97a5ea010b. after waiting 0 ms 2023-09-15 23:02:25,940 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1694818945120.da9a5cd60743ee48f6eddb97a5ea010b. 2023-09-15 23:02:25,940 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing da9a5cd60743ee48f6eddb97a5ea010b 1/1 column families, dataSize=24 B heapSize=352 B 2023-09-15 23:02:25,940 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 54c5bf13d3468c7b6979d92de59ce64b 2023-09-15 23:02:25,941 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 54c5bf13d3468c7b6979d92de59ce64b, disabling compactions & flushes 2023-09-15 23:02:25,942 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1694818945120.54c5bf13d3468c7b6979d92de59ce64b. 2023-09-15 23:02:25,942 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1694818945120.54c5bf13d3468c7b6979d92de59ce64b. 2023-09-15 23:02:25,942 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1694818945120.54c5bf13d3468c7b6979d92de59ce64b. after waiting 0 ms 2023-09-15 23:02:25,942 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1694818945120.54c5bf13d3468c7b6979d92de59ce64b. 2023-09-15 23:02:25,942 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 54c5bf13d3468c7b6979d92de59ce64b 1/1 column families, dataSize=24 B heapSize=352 B 2023-09-15 23:02:25,961 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/54c5bf13d3468c7b6979d92de59ce64b/.tmp/cf/44cf62d4448043dd8afccfd6d73122fa 2023-09-15 23:02:25,961 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/da9a5cd60743ee48f6eddb97a5ea010b/.tmp/cf/7b1207655d764e1582b2582f043dbd84 2023-09-15 23:02:25,967 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/54c5bf13d3468c7b6979d92de59ce64b/.tmp/cf/44cf62d4448043dd8afccfd6d73122fa as hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/54c5bf13d3468c7b6979d92de59ce64b/cf/44cf62d4448043dd8afccfd6d73122fa 2023-09-15 23:02:25,967 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/da9a5cd60743ee48f6eddb97a5ea010b/.tmp/cf/7b1207655d764e1582b2582f043dbd84 as hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/da9a5cd60743ee48f6eddb97a5ea010b/cf/7b1207655d764e1582b2582f043dbd84 2023-09-15 23:02:25,972 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/54c5bf13d3468c7b6979d92de59ce64b/cf/44cf62d4448043dd8afccfd6d73122fa, entries=1, sequenceid=5, filesize=4.7 K 2023-09-15 23:02:25,972 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/da9a5cd60743ee48f6eddb97a5ea010b/cf/7b1207655d764e1582b2582f043dbd84, entries=1, sequenceid=5, filesize=4.7 K 2023-09-15 23:02:25,973 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for 54c5bf13d3468c7b6979d92de59ce64b in 31ms, sequenceid=5, compaction requested=false 2023-09-15 23:02:25,974 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for da9a5cd60743ee48f6eddb97a5ea010b in 34ms, sequenceid=5, compaction requested=false 2023-09-15 23:02:25,982 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/54c5bf13d3468c7b6979d92de59ce64b/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-09-15 23:02:25,982 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-15 23:02:25,982 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1694818945120.54c5bf13d3468c7b6979d92de59ce64b. 2023-09-15 23:02:25,982 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 54c5bf13d3468c7b6979d92de59ce64b: 2023-09-15 23:02:25,984 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 54c5bf13d3468c7b6979d92de59ce64b 2023-09-15 23:02:25,985 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=54c5bf13d3468c7b6979d92de59ce64b, regionState=CLOSED 2023-09-15 23:02:25,985 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1694818945120.54c5bf13d3468c7b6979d92de59ce64b.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1694818945985"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694818945985"}]},"ts":"1694818945985"} 2023-09-15 23:02:25,988 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/da9a5cd60743ee48f6eddb97a5ea010b/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-09-15 23:02:25,989 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=75, resume processing ppid=73 2023-09-15 23:02:25,989 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=75, ppid=73, state=SUCCESS; CloseRegionProcedure 54c5bf13d3468c7b6979d92de59ce64b, server=jenkins-hbase4.apache.org,33655,1694818872204 in 200 msec 2023-09-15 23:02:25,989 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-15 23:02:25,989 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1694818945120.da9a5cd60743ee48f6eddb97a5ea010b. 2023-09-15 23:02:25,989 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for da9a5cd60743ee48f6eddb97a5ea010b: 2023-09-15 23:02:25,990 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=73, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=54c5bf13d3468c7b6979d92de59ce64b, UNASSIGN in 208 msec 2023-09-15 23:02:25,991 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed da9a5cd60743ee48f6eddb97a5ea010b 2023-09-15 23:02:25,991 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=da9a5cd60743ee48f6eddb97a5ea010b, regionState=CLOSED 2023-09-15 23:02:25,991 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1694818945120.da9a5cd60743ee48f6eddb97a5ea010b.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1694818945991"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694818945991"}]},"ts":"1694818945991"} 2023-09-15 23:02:25,994 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=74, resume processing ppid=72 2023-09-15 23:02:25,994 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=74, ppid=72, state=SUCCESS; CloseRegionProcedure da9a5cd60743ee48f6eddb97a5ea010b, server=jenkins-hbase4.apache.org,41413,1694818872288 in 206 msec 2023-09-15 23:02:25,995 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=72, resume processing ppid=71 2023-09-15 23:02:25,995 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=da9a5cd60743ee48f6eddb97a5ea010b, UNASSIGN in 216 msec 2023-09-15 23:02:26,033 DEBUG [PEWorker-2] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f1fb8384cd11d5844180d2e1808d10c1/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=-1 2023-09-15 23:02:26,035 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1694818945120.da9a5cd60743ee48f6eddb97a5ea010b.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-09-15 23:02:26,035 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1694818945120.54c5bf13d3468c7b6979d92de59ce64b.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-09-15 23:02:26,035 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":7,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1694818945121.f1fb8384cd11d5844180d2e1808d10c1.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0000","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0001","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-09-15 23:02:26,063 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-09-15 23:02:26,082 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=f1fb8384cd11d5844180d2e1808d10c1, ASSIGN}] 2023-09-15 23:02:26,083 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=f1fb8384cd11d5844180d2e1808d10c1, ASSIGN 2023-09-15 23:02:26,084 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=f1fb8384cd11d5844180d2e1808d10c1, ASSIGN; state=MERGED, location=jenkins-hbase4.apache.org,41413,1694818872288; forceNewPlan=false, retain=false 2023-09-15 23:02:26,234 INFO [jenkins-hbase4:44427] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-09-15 23:02:26,236 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=f1fb8384cd11d5844180d2e1808d10c1, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:02:26,236 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1694818945121.f1fb8384cd11d5844180d2e1808d10c1.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1694818946236"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694818946236"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694818946236"}]},"ts":"1694818946236"} 2023-09-15 23:02:26,238 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; OpenRegionProcedure f1fb8384cd11d5844180d2e1808d10c1, server=jenkins-hbase4.apache.org,41413,1694818872288}] 2023-09-15 23:02:26,364 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-09-15 23:02:26,392 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1694818945121.f1fb8384cd11d5844180d2e1808d10c1. 2023-09-15 23:02:26,392 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => f1fb8384cd11d5844180d2e1808d10c1, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1694818945121.f1fb8384cd11d5844180d2e1808d10c1.', STARTKEY => '', ENDKEY => ''} 2023-09-15 23:02:26,393 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1694818945121.f1fb8384cd11d5844180d2e1808d10c1. service=AccessControlService 2023-09-15 23:02:26,393 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-15 23:02:26,393 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 f1fb8384cd11d5844180d2e1808d10c1 2023-09-15 23:02:26,393 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1694818945121.f1fb8384cd11d5844180d2e1808d10c1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-15 23:02:26,393 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for f1fb8384cd11d5844180d2e1808d10c1 2023-09-15 23:02:26,393 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for f1fb8384cd11d5844180d2e1808d10c1 2023-09-15 23:02:26,394 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(950): Rewriting .regioninfo file at: hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f1fb8384cd11d5844180d2e1808d10c1/.regioninfo 2023-09-15 23:02:26,402 INFO [StoreOpener-f1fb8384cd11d5844180d2e1808d10c1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region f1fb8384cd11d5844180d2e1808d10c1 2023-09-15 23:02:26,403 DEBUG [StoreOpener-f1fb8384cd11d5844180d2e1808d10c1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f1fb8384cd11d5844180d2e1808d10c1/cf 2023-09-15 23:02:26,403 DEBUG [StoreOpener-f1fb8384cd11d5844180d2e1808d10c1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f1fb8384cd11d5844180d2e1808d10c1/cf 2023-09-15 23:02:26,403 INFO [StoreOpener-f1fb8384cd11d5844180d2e1808d10c1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f1fb8384cd11d5844180d2e1808d10c1 columnFamilyName cf 2023-09-15 23:02:26,430 DEBUG [StoreOpener-f1fb8384cd11d5844180d2e1808d10c1-1] regionserver.HStore(539): loaded hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f1fb8384cd11d5844180d2e1808d10c1/cf/44cf62d4448043dd8afccfd6d73122fa.54c5bf13d3468c7b6979d92de59ce64b->hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/54c5bf13d3468c7b6979d92de59ce64b/cf/44cf62d4448043dd8afccfd6d73122fa-top 2023-09-15 23:02:26,435 DEBUG [StoreOpener-f1fb8384cd11d5844180d2e1808d10c1-1] regionserver.HStore(539): loaded hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f1fb8384cd11d5844180d2e1808d10c1/cf/7b1207655d764e1582b2582f043dbd84.da9a5cd60743ee48f6eddb97a5ea010b->hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/da9a5cd60743ee48f6eddb97a5ea010b/cf/7b1207655d764e1582b2582f043dbd84-top 2023-09-15 23:02:26,436 INFO [StoreOpener-f1fb8384cd11d5844180d2e1808d10c1-1] regionserver.HStore(310): Store=f1fb8384cd11d5844180d2e1808d10c1/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-15 23:02:26,436 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f1fb8384cd11d5844180d2e1808d10c1 2023-09-15 23:02:26,437 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f1fb8384cd11d5844180d2e1808d10c1 2023-09-15 23:02:26,440 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for f1fb8384cd11d5844180d2e1808d10c1 2023-09-15 23:02:26,440 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened f1fb8384cd11d5844180d2e1808d10c1; next sequenceid=9; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65163035, jitterRate=-0.02899511158466339}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-15 23:02:26,440 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for f1fb8384cd11d5844180d2e1808d10c1: 2023-09-15 23:02:26,441 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1694818945121.f1fb8384cd11d5844180d2e1808d10c1., pid=77, masterSystemTime=1694818946389 2023-09-15 23:02:26,442 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(328): Ignoring compaction request for testtb-testExportFileSystemStateWithMergeRegion-1,,1694818945121.f1fb8384cd11d5844180d2e1808d10c1.,because compaction is disabled. 2023-09-15 23:02:26,443 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1694818945121.f1fb8384cd11d5844180d2e1808d10c1. 2023-09-15 23:02:26,443 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1694818945121.f1fb8384cd11d5844180d2e1808d10c1. 2023-09-15 23:02:26,443 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=f1fb8384cd11d5844180d2e1808d10c1, regionState=OPEN, openSeqNum=9, regionLocation=jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:02:26,444 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1694818945121.f1fb8384cd11d5844180d2e1808d10c1.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1694818946443"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1694818946443"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1694818946443"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1694818946443"}]},"ts":"1694818946443"} 2023-09-15 23:02:26,447 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=77, resume processing ppid=76 2023-09-15 23:02:26,447 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=77, ppid=76, state=SUCCESS; OpenRegionProcedure f1fb8384cd11d5844180d2e1808d10c1, server=jenkins-hbase4.apache.org,41413,1694818872288 in 207 msec 2023-09-15 23:02:26,448 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=76, resume processing ppid=71 2023-09-15 23:02:26,448 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=76, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=f1fb8384cd11d5844180d2e1808d10c1, ASSIGN in 365 msec 2023-09-15 23:02:26,450 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=71, state=SUCCESS; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[da9a5cd60743ee48f6eddb97a5ea010b, 54c5bf13d3468c7b6979d92de59ce64b], force=true in 696 msec 2023-09-15 23:02:26,865 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-09-15 23:02:26,866 INFO [Listener at jenkins-hbase4.apache.org/46629] client.HBaseAdmin$TableFuture(3541): Operation: MERGE_REGIONS, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 71 completed 2023-09-15 23:02:26,866 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-09-15 23:02:26,866 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1694818946866 (current time:1694818946866). 2023-09-15 23:02:26,866 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-15 23:02:26,867 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] zookeeper.ReadOnlyZKClient(139): Connect 0x71f540be to 127.0.0.1:51149 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-15 23:02:26,873 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@141be66, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-15 23:02:26,874 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-15 23:02:26,877 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44154, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-15 23:02:26,878 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x71f540be to 127.0.0.1:51149 2023-09-15 23:02:26,878 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-15 23:02:26,879 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] zookeeper.ReadOnlyZKClient(139): Connect 0x1551ec17 to 127.0.0.1:51149 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-15 23:02:26,884 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4e7aaeb3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-15 23:02:26,885 DEBUG [hconnection-0x42c48b94-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-15 23:02:26,886 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44164, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-15 23:02:26,890 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1551ec17 to 127.0.0.1:51149 2023-09-15 23:02:26,890 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-15 23:02:26,890 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-09-15 23:02:26,891 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-15 23:02:26,891 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-09-15 23:02:26,892 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] procedure2.ProcedureExecutor(1028): Stored pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-09-15 23:02:26,893 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-09-15 23:02:26,894 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=78, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE; timeout=600000, timestamp=1694819546894 2023-09-15 23:02:26,894 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-15 23:02:26,894 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-09-15 23:02:26,898 DEBUG [Listener at jenkins-hbase4.apache.org/46629] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-15 23:02:26,898 DEBUG [Listener at jenkins-hbase4.apache.org/46629] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-15 23:02:26,898 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-09-15 23:02:26,899 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=78, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-09-15 23:02:26,900 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=78, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE in 7 msec 2023-09-15 23:02:26,900 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-09-15 23:02:26,901 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=79, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED; timeout=600000, timestamp=1694819546901 2023-09-15 23:02:26,910 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-15 23:02:26,910 INFO [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' 2023-09-15 23:02:26,910 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-15 23:02:26,911 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' 2023-09-15 23:02:26,911 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1', kicking off acquire phase on members. 2023-09-15 23:02:26,911 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-15 23:02:26,911 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-15 23:02:26,913 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:34705-0x100b1d2daa90002, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 23:02:26,913 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:41413-0x100b1d2daa90003, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 23:02:26,913 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 23:02:26,913 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 23:02:26,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 23:02:26,913 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:02:26,913 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:33655-0x100b1d2daa90001, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 23:02:26,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 23:02:26,913 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 23:02:26,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 23:02:26,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-15 23:02:26,913 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:02:26,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-15 23:02:26,913 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-15 23:02:26,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-15 23:02:26,914 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41413-0x100b1d2daa90003, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-15 23:02:26,914 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34705-0x100b1d2daa90002, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-15 23:02:26,914 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33655-0x100b1d2daa90001, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-15 23:02:26,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-09-15 23:02:26,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-15 23:02:26,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-09-15 23:02:26,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-15 23:02:26,914 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-09-15 23:02:26,914 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-09-15 23:02:26,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-09-15 23:02:26,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-15 23:02:26,914 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-15 23:02:26,914 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-09-15 23:02:26,914 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-09-15 23:02:26,914 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-15 23:02:26,915 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-15 23:02:26,915 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-15 23:02:26,915 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-09-15 23:02:26,916 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-09-15 23:02:26,915 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-09-15 23:02:26,916 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-15 23:02:26,916 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41413,1694818872288' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-09-15 23:02:26,916 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-09-15 23:02:26,916 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-09-15 23:02:26,916 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34705,1694818872254' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-09-15 23:02:26,916 DEBUG [member: 'jenkins-hbase4.apache.org,33655,1694818872204' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-09-15 23:02:26,916 DEBUG [member: 'jenkins-hbase4.apache.org,33655,1694818872204' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-15 23:02:26,917 DEBUG [member: 'jenkins-hbase4.apache.org,33655,1694818872204' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-09-15 23:02:26,917 DEBUG [member: 'jenkins-hbase4.apache.org,33655,1694818872204' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-09-15 23:02:26,917 DEBUG [member: 'jenkins-hbase4.apache.org,33655,1694818872204' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33655,1694818872204' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-09-15 23:02:26,919 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:02:26,919 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-15 23:02:26,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:02:26,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-15 23:02:26,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-15 23:02:26,919 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-15 23:02:26,920 DEBUG [member: 'jenkins-hbase4.apache.org,33655,1694818872204' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-15 23:02:26,920 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41413-0x100b1d2daa90003, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-15 23:02:26,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-15 23:02:26,920 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-15 23:02:26,920 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34705-0x100b1d2daa90002, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-15 23:02:26,920 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-15 23:02:26,920 DEBUG [member: 'jenkins-hbase4.apache.org,33655,1694818872204' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33655-0x100b1d2daa90001, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-15 23:02:26,920 DEBUG [member: 'jenkins-hbase4.apache.org,33655,1694818872204' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-15 23:02:26,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-15 23:02:26,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-15 23:02:26,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:02:26,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:02:26,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33655,1694818872204 2023-09-15 23:02:26,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-15 23:02:26,922 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41413,1694818872288' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' on coordinator 2023-09-15 23:02:26,922 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@47386e08[Count = 0] remaining members to acquire global barrier 2023-09-15 23:02:26,922 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'in-barrier' execution. 2023-09-15 23:02:26,922 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-15 23:02:26,923 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:34705-0x100b1d2daa90002, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-15 23:02:26,923 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:41413-0x100b1d2daa90003, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-15 23:02:26,923 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-15 23:02:26,923 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-15 23:02:26,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-15 23:02:26,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-15 23:02:26,924 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-09-15 23:02:26,924 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-09-15 23:02:26,924 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-09-15 23:02:26,924 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:02:26,924 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-15 23:02:26,923 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:33655-0x100b1d2daa90001, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-15 23:02:26,924 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-15 23:02:26,924 DEBUG [rs(jenkins-hbase4.apache.org,41413,1694818872288)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1694818945121.f1fb8384cd11d5844180d2e1808d10c1. 2023-09-15 23:02:26,924 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,34705,1694818872254' in zk 2023-09-15 23:02:26,924 DEBUG [rs(jenkins-hbase4.apache.org,41413,1694818872288)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1694818945121.f1fb8384cd11d5844180d2e1808d10c1. started... 2023-09-15 23:02:26,924 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-15 23:02:26,924 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-15 23:02:26,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-15 23:02:26,925 DEBUG [member: 'jenkins-hbase4.apache.org,33655,1694818872204' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-09-15 23:02:26,925 DEBUG [rs(jenkins-hbase4.apache.org,41413,1694818872288)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for f1fb8384cd11d5844180d2e1808d10c1: 2023-09-15 23:02:26,925 DEBUG [member: 'jenkins-hbase4.apache.org,33655,1694818872204' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-09-15 23:02:26,925 DEBUG [member: 'jenkins-hbase4.apache.org,33655,1694818872204' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,33655,1694818872204' in zk 2023-09-15 23:02:26,925 DEBUG [rs(jenkins-hbase4.apache.org,41413,1694818872288)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion-1,,1694818945121.f1fb8384cd11d5844180d2e1808d10c1.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-15 23:02:26,925 DEBUG [rs(jenkins-hbase4.apache.org,41413,1694818872288)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-15 23:02:26,925 DEBUG [rs(jenkins-hbase4.apache.org,41413,1694818872288)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f1fb8384cd11d5844180d2e1808d10c1/cf/44cf62d4448043dd8afccfd6d73122fa.54c5bf13d3468c7b6979d92de59ce64b->hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/54c5bf13d3468c7b6979d92de59ce64b/cf/44cf62d4448043dd8afccfd6d73122fa-top, hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f1fb8384cd11d5844180d2e1808d10c1/cf/7b1207655d764e1582b2582f043dbd84.da9a5cd60743ee48f6eddb97a5ea010b->hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/da9a5cd60743ee48f6eddb97a5ea010b/cf/7b1207655d764e1582b2582f043dbd84-top] hfiles 2023-09-15 23:02:26,925 DEBUG [rs(jenkins-hbase4.apache.org,41413,1694818872288)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/2): hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f1fb8384cd11d5844180d2e1808d10c1/cf/44cf62d4448043dd8afccfd6d73122fa.54c5bf13d3468c7b6979d92de59ce64b for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-15 23:02:26,926 DEBUG [rs(jenkins-hbase4.apache.org,41413,1694818872288)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/2): hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f1fb8384cd11d5844180d2e1808d10c1/cf/7b1207655d764e1582b2582f043dbd84.da9a5cd60743ee48f6eddb97a5ea010b for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-15 23:02:26,926 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-09-15 23:02:26,926 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-15 23:02:26,926 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-09-15 23:02:26,929 DEBUG [member: 'jenkins-hbase4.apache.org,33655,1694818872204' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-09-15 23:02:26,929 DEBUG [member: 'jenkins-hbase4.apache.org,33655,1694818872204' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-15 23:02:26,929 DEBUG [member: 'jenkins-hbase4.apache.org,33655,1694818872204' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-09-15 23:02:26,938 DEBUG [rs(jenkins-hbase4.apache.org,41413,1694818872288)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1694818945121.f1fb8384cd11d5844180d2e1808d10c1. completed. 2023-09-15 23:02:26,938 DEBUG [rs(jenkins-hbase4.apache.org,41413,1694818872288)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1694818945121.f1fb8384cd11d5844180d2e1808d10c1. 2023-09-15 23:02:26,938 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-15 23:02:26,938 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-15 23:02:26,938 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:02:26,938 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-09-15 23:02:26,939 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,41413,1694818872288' in zk 2023-09-15 23:02:26,942 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:02:26,942 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-09-15 23:02:26,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:02:26,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-15 23:02:26,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-15 23:02:26,943 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-15 23:02:26,943 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-09-15 23:02:26,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-15 23:02:26,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-15 23:02:26,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-15 23:02:26,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:02:26,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:02:26,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33655,1694818872204 2023-09-15 23:02:26,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-15 23:02:26,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-15 23:02:26,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:02:26,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:02:26,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33655,1694818872204 2023-09-15 23:02:26,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' member 'jenkins-hbase4.apache.org,41413,1694818872288': 2023-09-15 23:02:26,946 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41413,1694818872288' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion-1', counting down latch. Waiting for 0 more 2023-09-15 23:02:26,946 INFO [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' execution completed 2023-09-15 23:02:26,946 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-15 23:02:26,946 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-15 23:02:26,946 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-15 23:02:26,946 INFO [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegion-1including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-15 23:02:26,948 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:33655-0x100b1d2daa90001, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-15 23:02:26,948 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:41413-0x100b1d2daa90003, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-15 23:02:26,948 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-15 23:02:26,948 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-15 23:02:26,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-15 23:02:26,948 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:41413-0x100b1d2daa90003, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 23:02:26,948 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:33655-0x100b1d2daa90001, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 23:02:26,948 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:34705-0x100b1d2daa90002, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-15 23:02:26,948 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-15 23:02:26,948 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-15 23:02:26,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-15 23:02:26,948 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 23:02:26,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-15 23:02:26,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-15 23:02:26,948 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:34705-0x100b1d2daa90002, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 23:02:26,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-15 23:02:26,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 23:02:26,948 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:02:26,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-15 23:02:26,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-15 23:02:26,949 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 23:02:26,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 23:02:26,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-15 23:02:26,949 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 23:02:26,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 23:02:26,949 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:02:26,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-15 23:02:26,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-15 23:02:26,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-15 23:02:26,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-15 23:02:26,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-15 23:02:26,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:02:26,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:02:26,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33655,1694818872204 2023-09-15 23:02:26,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-15 23:02:26,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-15 23:02:26,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:02:26,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:02:26,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33655,1694818872204 2023-09-15 23:02:26,953 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,33655,1694818872204 2023-09-15 23:02:26,954 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:02:26,954 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:02:26,954 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,33655,1694818872204 2023-09-15 23:02:26,958 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,33655,1694818872204 2023-09-15 23:02:26,958 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:34705-0x100b1d2daa90002, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 23:02:26,958 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:33655-0x100b1d2daa90001, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 23:02:26,958 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-15 23:02:26,958 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-15 23:02:26,958 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:02:26,958 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:02:26,958 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-15 23:02:26,958 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,33655,1694818872204 2023-09-15 23:02:26,958 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-15 23:02:26,958 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-15 23:02:26,958 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 23:02:26,959 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-15 23:02:26,958 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:33655-0x100b1d2daa90001, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 23:02:26,958 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:34705-0x100b1d2daa90002, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 23:02:26,958 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 23:02:26,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 23:02:26,958 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:41413-0x100b1d2daa90003, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 23:02:26,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 23:02:26,958 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:02:26,959 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 23:02:26,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 23:02:26,959 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:41413-0x100b1d2daa90003, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 23:02:26,959 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 23:02:26,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 23:02:26,959 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 23:02:26,959 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-15 23:02:26,959 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 23:02:26,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 23:02:26,959 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:02:26,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 23:02:26,960 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-15 23:02:26,960 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-15 23:02:26,978 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-15 23:02:26,979 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed 2023-09-15 23:02:26,979 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-15 23:02:26,979 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-15 23:02:26,980 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 at 1694818946894Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1694818946959 (+65 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1694818946959Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1694818946962 (+3 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1694818946972 (+10 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed at 1694818946979 (+7 ms) 2023-09-15 23:02:26,982 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=79, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-09-15 23:02:26,984 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=79, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED in 85 msec 2023-09-15 23:02:26,998 DEBUG [Listener at jenkins-hbase4.apache.org/46629] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-15 23:02:26,999 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-09-15 23:02:26,999 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-15 23:02:26,999 INFO [Listener at jenkins-hbase4.apache.org/46629] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/export-test/export-1694818946999 2023-09-15 23:02:26,999 INFO [Listener at jenkins-hbase4.apache.org/46629] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:44545, tgtDir=hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/export-test/export-1694818946999, rawTgtDir=hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/export-test/export-1694818946999, srcFsUri=hdfs://localhost:44545, srcDir=hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64 2023-09-15 23:02:27,021 DEBUG [Listener at jenkins-hbase4.apache.org/46629] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:44545, inputRoot=hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64 2023-09-15 23:02:27,021 DEBUG [Listener at jenkins-hbase4.apache.org/46629] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-362108321_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/export-test/export-1694818946999, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/export-test/export-1694818946999/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-15 23:02:27,021 INFO [Listener at jenkins-hbase4.apache.org/46629] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:44545, inputRoot=hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64, snapshotDir=hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1. 2023-09-15 23:02:27,031 INFO [Listener at jenkins-hbase4.apache.org/46629] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/export-test/export-1694818946999/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-15 23:02:27,048 DEBUG [Listener at jenkins-hbase4.apache.org/46629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-15 23:02:27,049 DEBUG [Listener at jenkins-hbase4.apache.org/46629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-15 23:02:27,049 DEBUG [Listener at jenkins-hbase4.apache.org/46629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-15 23:02:27,049 DEBUG [Listener at jenkins-hbase4.apache.org/46629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-15 23:02:27,571 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694818878578_0004_000001 (auth:SIMPLE) 2023-09-15 23:02:27,972 DEBUG [Listener at jenkins-hbase4.apache.org/46629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c5e9ebbf-ce0f-c6b3-3dce-6299f7b47f51/hadoop-6415525407312230115.jar 2023-09-15 23:02:27,972 DEBUG [Listener at jenkins-hbase4.apache.org/46629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-15 23:02:27,973 DEBUG [Listener at jenkins-hbase4.apache.org/46629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-15 23:02:28,039 DEBUG [Listener at jenkins-hbase4.apache.org/46629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c5e9ebbf-ce0f-c6b3-3dce-6299f7b47f51/hadoop-6357643148892844202.jar 2023-09-15 23:02:28,039 DEBUG [Listener at jenkins-hbase4.apache.org/46629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-15 23:02:28,039 DEBUG [Listener at jenkins-hbase4.apache.org/46629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-15 23:02:28,040 DEBUG [Listener at jenkins-hbase4.apache.org/46629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-15 23:02:28,040 DEBUG [Listener at jenkins-hbase4.apache.org/46629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-15 23:02:28,041 DEBUG [Listener at jenkins-hbase4.apache.org/46629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-15 23:02:28,041 DEBUG [Listener at jenkins-hbase4.apache.org/46629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-15 23:02:28,041 DEBUG [Listener at jenkins-hbase4.apache.org/46629] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-15 23:02:28,042 DEBUG [Listener at jenkins-hbase4.apache.org/46629] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-15 23:02:28,042 DEBUG [Listener at jenkins-hbase4.apache.org/46629] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-15 23:02:28,042 DEBUG [Listener at jenkins-hbase4.apache.org/46629] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-15 23:02:28,043 DEBUG [Listener at jenkins-hbase4.apache.org/46629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-15 23:02:28,043 DEBUG [Listener at jenkins-hbase4.apache.org/46629] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-15 23:02:28,044 DEBUG [Listener at jenkins-hbase4.apache.org/46629] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-15 23:02:28,044 DEBUG [Listener at jenkins-hbase4.apache.org/46629] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-15 23:02:28,044 DEBUG [Listener at jenkins-hbase4.apache.org/46629] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-15 23:02:28,045 DEBUG [Listener at jenkins-hbase4.apache.org/46629] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-15 23:02:28,046 DEBUG [Listener at jenkins-hbase4.apache.org/46629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-15 23:02:28,046 DEBUG [Listener at jenkins-hbase4.apache.org/46629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-15 23:02:28,047 DEBUG [Listener at jenkins-hbase4.apache.org/46629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-15 23:02:28,047 DEBUG [Listener at jenkins-hbase4.apache.org/46629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-15 23:02:28,047 DEBUG [Listener at jenkins-hbase4.apache.org/46629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-15 23:02:28,047 DEBUG [Listener at jenkins-hbase4.apache.org/46629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-15 23:02:28,048 DEBUG [Listener at jenkins-hbase4.apache.org/46629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-15 23:02:28,378 WARN [Listener at jenkins-hbase4.apache.org/46629] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-15 23:02:28,380 INFO [Listener at jenkins-hbase4.apache.org/46629] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithMergeRegion-1' hfile list 2023-09-15 23:02:28,382 DEBUG [Listener at jenkins-hbase4.apache.org/46629] snapshot.ExportSnapshot(671): export split=0 size=9.5 K 2023-09-15 23:02:28,442 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-15 23:02:28,442 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-15 23:02:28,570 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694818878578_0005_000001 (auth:SIMPLE) 2023-09-15 23:02:29,027 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-15 23:02:32,218 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694818878578_0005_000001 (auth:SIMPLE) 2023-09-15 23:02:34,424 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694818878578_0005_000001 (auth:SIMPLE) 2023-09-15 23:02:37,288 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694818878578_0005_000001 (auth:SIMPLE) 2023-09-15 23:02:38,551 INFO [Listener at jenkins-hbase4.apache.org/46629] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-15 23:02:38,553 INFO [Listener at jenkins-hbase4.apache.org/46629] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-15 23:02:38,562 INFO [Listener at jenkins-hbase4.apache.org/46629] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-15 23:02:38,562 INFO [Listener at jenkins-hbase4.apache.org/46629] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-15 23:02:38,563 INFO [Listener at jenkins-hbase4.apache.org/46629] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-15 23:02:38,563 DEBUG [Listener at jenkins-hbase4.apache.org/46629] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1896422628_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-15 23:02:38,563 DEBUG [Listener at jenkins-hbase4.apache.org/46629] snapshot.TestExportSnapshot(367): hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-09-15 23:02:38,563 DEBUG [Listener at jenkins-hbase4.apache.org/46629] snapshot.TestExportSnapshot(367): hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-09-15 23:02:38,563 DEBUG [Listener at jenkins-hbase4.apache.org/46629] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1896422628_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/export-test/export-1694818946999/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/export-test/export-1694818946999/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-15 23:02:38,564 DEBUG [Listener at jenkins-hbase4.apache.org/46629] snapshot.TestExportSnapshot(367): hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/export-test/export-1694818946999/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-09-15 23:02:38,564 DEBUG [Listener at jenkins-hbase4.apache.org/46629] snapshot.TestExportSnapshot(367): hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/export-test/export-1694818946999/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-09-15 23:02:38,570 INFO [Listener at jenkins-hbase4.apache.org/46629] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-15 23:02:38,570 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-15 23:02:38,571 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] procedure2.ProcedureExecutor(1028): Stored pid=80, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-15 23:02:38,574 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-09-15 23:02:38,574 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694818958574"}]},"ts":"1694818958574"} 2023-09-15 23:02:38,576 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLING in hbase:meta 2023-09-15 23:02:38,577 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLING 2023-09-15 23:02:38,578 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=f1fb8384cd11d5844180d2e1808d10c1, UNASSIGN}] 2023-09-15 23:02:38,579 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=f1fb8384cd11d5844180d2e1808d10c1, UNASSIGN 2023-09-15 23:02:38,580 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=f1fb8384cd11d5844180d2e1808d10c1, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:02:38,580 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1694818945121.f1fb8384cd11d5844180d2e1808d10c1.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1694818958580"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694818958580"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694818958580"}]},"ts":"1694818958580"} 2023-09-15 23:02:38,581 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=82, ppid=81, state=RUNNABLE; CloseRegionProcedure f1fb8384cd11d5844180d2e1808d10c1, server=jenkins-hbase4.apache.org,41413,1694818872288}] 2023-09-15 23:02:38,675 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-09-15 23:02:38,733 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close f1fb8384cd11d5844180d2e1808d10c1 2023-09-15 23:02:38,733 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing f1fb8384cd11d5844180d2e1808d10c1, disabling compactions & flushes 2023-09-15 23:02:38,733 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1694818945121.f1fb8384cd11d5844180d2e1808d10c1. 2023-09-15 23:02:38,733 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1694818945121.f1fb8384cd11d5844180d2e1808d10c1. 2023-09-15 23:02:38,733 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1694818945121.f1fb8384cd11d5844180d2e1808d10c1. after waiting 0 ms 2023-09-15 23:02:38,733 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1694818945121.f1fb8384cd11d5844180d2e1808d10c1. 2023-09-15 23:02:38,746 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f1fb8384cd11d5844180d2e1808d10c1/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=8 2023-09-15 23:02:38,747 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-15 23:02:38,748 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1694818945121.f1fb8384cd11d5844180d2e1808d10c1. 2023-09-15 23:02:38,748 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for f1fb8384cd11d5844180d2e1808d10c1: 2023-09-15 23:02:38,749 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed f1fb8384cd11d5844180d2e1808d10c1 2023-09-15 23:02:38,749 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=f1fb8384cd11d5844180d2e1808d10c1, regionState=CLOSED 2023-09-15 23:02:38,749 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1694818945121.f1fb8384cd11d5844180d2e1808d10c1.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1694818958749"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694818958749"}]},"ts":"1694818958749"} 2023-09-15 23:02:38,752 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=82, resume processing ppid=81 2023-09-15 23:02:38,752 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=82, ppid=81, state=SUCCESS; CloseRegionProcedure f1fb8384cd11d5844180d2e1808d10c1, server=jenkins-hbase4.apache.org,41413,1694818872288 in 170 msec 2023-09-15 23:02:38,754 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=81, resume processing ppid=80 2023-09-15 23:02:38,754 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=81, ppid=80, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=f1fb8384cd11d5844180d2e1808d10c1, UNASSIGN in 174 msec 2023-09-15 23:02:38,754 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694818958754"}]},"ts":"1694818958754"} 2023-09-15 23:02:38,755 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLED in hbase:meta 2023-09-15 23:02:38,757 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLED 2023-09-15 23:02:38,759 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=80, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 187 msec 2023-09-15 23:02:38,876 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-09-15 23:02:38,876 INFO [Listener at jenkins-hbase4.apache.org/46629] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 80 completed 2023-09-15 23:02:38,877 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-15 23:02:38,878 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] procedure2.ProcedureExecutor(1028): Stored pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-15 23:02:38,880 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-15 23:02:38,880 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-15 23:02:38,881 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=83, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-15 23:02:38,882 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41413] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-15 23:02:38,885 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/54c5bf13d3468c7b6979d92de59ce64b 2023-09-15 23:02:38,885 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/da9a5cd60743ee48f6eddb97a5ea010b 2023-09-15 23:02:38,885 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f1fb8384cd11d5844180d2e1808d10c1 2023-09-15 23:02:38,887 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/54c5bf13d3468c7b6979d92de59ce64b/cf, FileablePath, hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/54c5bf13d3468c7b6979d92de59ce64b/recovered.edits] 2023-09-15 23:02:38,887 DEBUG [HFileArchiver-19] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f1fb8384cd11d5844180d2e1808d10c1/cf, FileablePath, hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f1fb8384cd11d5844180d2e1808d10c1/recovered.edits] 2023-09-15 23:02:38,887 DEBUG [HFileArchiver-20] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/da9a5cd60743ee48f6eddb97a5ea010b/cf, FileablePath, hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/da9a5cd60743ee48f6eddb97a5ea010b/recovered.edits] 2023-09-15 23:02:38,889 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-15 23:02:38,889 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:34705-0x100b1d2daa90002, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-15 23:02:38,889 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:41413-0x100b1d2daa90003, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-15 23:02:38,889 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:33655-0x100b1d2daa90001, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-15 23:02:38,890 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-09-15 23:02:38,890 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-09-15 23:02:38,890 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-09-15 23:02:38,890 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-09-15 23:02:38,891 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:33655-0x100b1d2daa90001, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-15 23:02:38,891 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:33655-0x100b1d2daa90001, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-15 23:02:38,891 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:41413-0x100b1d2daa90003, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-15 23:02:38,891 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:41413-0x100b1d2daa90003, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-15 23:02:38,891 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-15 23:02:38,891 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-15 23:02:38,891 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:34705-0x100b1d2daa90002, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-15 23:02:38,891 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:34705-0x100b1d2daa90002, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-15 23:02:38,892 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-15 23:02:38,892 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-09-15 23:02:38,892 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-15 23:02:38,892 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-15 23:02:38,892 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-15 23:02:38,893 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/54c5bf13d3468c7b6979d92de59ce64b/cf/44cf62d4448043dd8afccfd6d73122fa to hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/54c5bf13d3468c7b6979d92de59ce64b/cf/44cf62d4448043dd8afccfd6d73122fa 2023-09-15 23:02:38,893 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/da9a5cd60743ee48f6eddb97a5ea010b/cf/7b1207655d764e1582b2582f043dbd84 to hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/da9a5cd60743ee48f6eddb97a5ea010b/cf/7b1207655d764e1582b2582f043dbd84 2023-09-15 23:02:38,893 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f1fb8384cd11d5844180d2e1808d10c1/cf/44cf62d4448043dd8afccfd6d73122fa.54c5bf13d3468c7b6979d92de59ce64b to hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f1fb8384cd11d5844180d2e1808d10c1/cf/44cf62d4448043dd8afccfd6d73122fa.54c5bf13d3468c7b6979d92de59ce64b 2023-09-15 23:02:38,895 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f1fb8384cd11d5844180d2e1808d10c1/cf/7b1207655d764e1582b2582f043dbd84.da9a5cd60743ee48f6eddb97a5ea010b to hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f1fb8384cd11d5844180d2e1808d10c1/cf/7b1207655d764e1582b2582f043dbd84.da9a5cd60743ee48f6eddb97a5ea010b 2023-09-15 23:02:38,896 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/54c5bf13d3468c7b6979d92de59ce64b/recovered.edits/8.seqid to hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/54c5bf13d3468c7b6979d92de59ce64b/recovered.edits/8.seqid 2023-09-15 23:02:38,896 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/da9a5cd60743ee48f6eddb97a5ea010b/recovered.edits/8.seqid to hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/da9a5cd60743ee48f6eddb97a5ea010b/recovered.edits/8.seqid 2023-09-15 23:02:38,896 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/54c5bf13d3468c7b6979d92de59ce64b 2023-09-15 23:02:38,897 DEBUG [HFileArchiver-20] backup.HFileArchiver(596): Deleted hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/da9a5cd60743ee48f6eddb97a5ea010b 2023-09-15 23:02:38,898 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f1fb8384cd11d5844180d2e1808d10c1/recovered.edits/12.seqid to hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f1fb8384cd11d5844180d2e1808d10c1/recovered.edits/12.seqid 2023-09-15 23:02:38,898 DEBUG [HFileArchiver-19] backup.HFileArchiver(596): Deleted hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f1fb8384cd11d5844180d2e1808d10c1 2023-09-15 23:02:38,898 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-09-15 23:02:38,900 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=83, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-15 23:02:38,903 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testtb-testExportFileSystemStateWithMergeRegion-1 from hbase:meta 2023-09-15 23:02:38,905 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' descriptor. 2023-09-15 23:02:38,905 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=83, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-15 23:02:38,906 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' from region states. 2023-09-15 23:02:38,906 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1694818945121.f1fb8384cd11d5844180d2e1808d10c1.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1694818958906"}]},"ts":"9223372036854775807"} 2023-09-15 23:02:38,907 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-09-15 23:02:38,907 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => f1fb8384cd11d5844180d2e1808d10c1, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1694818945121.f1fb8384cd11d5844180d2e1808d10c1.', STARTKEY => '', ENDKEY => ''}] 2023-09-15 23:02:38,907 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion-1' as deleted. 2023-09-15 23:02:38,907 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1694818958907"}]},"ts":"9223372036854775807"} 2023-09-15 23:02:38,909 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion-1 state from META 2023-09-15 23:02:38,910 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=83, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-15 23:02:38,911 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=83, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 33 msec 2023-09-15 23:02:38,993 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-09-15 23:02:38,993 INFO [Listener at jenkins-hbase4.apache.org/46629] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 83 completed 2023-09-15 23:02:38,994 INFO [Listener at jenkins-hbase4.apache.org/46629] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion 2023-09-15 23:02:38,994 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion 2023-09-15 23:02:38,995 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] procedure2.ProcedureExecutor(1028): Stored pid=84, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-15 23:02:38,998 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-09-15 23:02:38,998 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694818958998"}]},"ts":"1694818958998"} 2023-09-15 23:02:39,000 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLING in hbase:meta 2023-09-15 23:02:39,001 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLING 2023-09-15 23:02:39,002 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=aa5581efb16c18499914b11aedd5365f, UNASSIGN}, {pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=3d7d5328b03e7580532dc45552cc1dc1, UNASSIGN}] 2023-09-15 23:02:39,004 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=aa5581efb16c18499914b11aedd5365f, UNASSIGN 2023-09-15 23:02:39,004 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=3d7d5328b03e7580532dc45552cc1dc1, UNASSIGN 2023-09-15 23:02:39,004 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=aa5581efb16c18499914b11aedd5365f, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:02:39,004 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=3d7d5328b03e7580532dc45552cc1dc1, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:02:39,005 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1694818943756.3d7d5328b03e7580532dc45552cc1dc1.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1694818959004"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694818959004"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694818959004"}]},"ts":"1694818959004"} 2023-09-15 23:02:39,005 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1694818943756.aa5581efb16c18499914b11aedd5365f.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1694818959004"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694818959004"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694818959004"}]},"ts":"1694818959004"} 2023-09-15 23:02:39,006 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=87, ppid=86, state=RUNNABLE; CloseRegionProcedure 3d7d5328b03e7580532dc45552cc1dc1, server=jenkins-hbase4.apache.org,34705,1694818872254}] 2023-09-15 23:02:39,007 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=88, ppid=85, state=RUNNABLE; CloseRegionProcedure aa5581efb16c18499914b11aedd5365f, server=jenkins-hbase4.apache.org,41413,1694818872288}] 2023-09-15 23:02:39,099 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-09-15 23:02:39,158 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close aa5581efb16c18499914b11aedd5365f 2023-09-15 23:02:39,158 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 3d7d5328b03e7580532dc45552cc1dc1 2023-09-15 23:02:39,158 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing aa5581efb16c18499914b11aedd5365f, disabling compactions & flushes 2023-09-15 23:02:39,158 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 3d7d5328b03e7580532dc45552cc1dc1, disabling compactions & flushes 2023-09-15 23:02:39,158 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1694818943756.aa5581efb16c18499914b11aedd5365f. 2023-09-15 23:02:39,158 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1694818943756.3d7d5328b03e7580532dc45552cc1dc1. 2023-09-15 23:02:39,158 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1694818943756.3d7d5328b03e7580532dc45552cc1dc1. 2023-09-15 23:02:39,158 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1694818943756.aa5581efb16c18499914b11aedd5365f. 2023-09-15 23:02:39,159 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1694818943756.3d7d5328b03e7580532dc45552cc1dc1. after waiting 0 ms 2023-09-15 23:02:39,159 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1694818943756.3d7d5328b03e7580532dc45552cc1dc1. 2023-09-15 23:02:39,159 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1694818943756.aa5581efb16c18499914b11aedd5365f. after waiting 0 ms 2023-09-15 23:02:39,159 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1694818943756.aa5581efb16c18499914b11aedd5365f. 2023-09-15 23:02:39,171 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/default/testtb-testExportFileSystemStateWithMergeRegion/aa5581efb16c18499914b11aedd5365f/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-15 23:02:39,171 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/default/testtb-testExportFileSystemStateWithMergeRegion/3d7d5328b03e7580532dc45552cc1dc1/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-15 23:02:39,171 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-15 23:02:39,172 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-15 23:02:39,172 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1694818943756.aa5581efb16c18499914b11aedd5365f. 2023-09-15 23:02:39,173 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1694818943756.3d7d5328b03e7580532dc45552cc1dc1. 2023-09-15 23:02:39,173 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for aa5581efb16c18499914b11aedd5365f: 2023-09-15 23:02:39,173 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 3d7d5328b03e7580532dc45552cc1dc1: 2023-09-15 23:02:39,174 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed aa5581efb16c18499914b11aedd5365f 2023-09-15 23:02:39,175 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=aa5581efb16c18499914b11aedd5365f, regionState=CLOSED 2023-09-15 23:02:39,175 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 3d7d5328b03e7580532dc45552cc1dc1 2023-09-15 23:02:39,175 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1694818943756.aa5581efb16c18499914b11aedd5365f.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1694818959175"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694818959175"}]},"ts":"1694818959175"} 2023-09-15 23:02:39,175 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=3d7d5328b03e7580532dc45552cc1dc1, regionState=CLOSED 2023-09-15 23:02:39,175 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1694818943756.3d7d5328b03e7580532dc45552cc1dc1.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1694818959175"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694818959175"}]},"ts":"1694818959175"} 2023-09-15 23:02:39,178 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=88, resume processing ppid=85 2023-09-15 23:02:39,178 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=88, ppid=85, state=SUCCESS; CloseRegionProcedure aa5581efb16c18499914b11aedd5365f, server=jenkins-hbase4.apache.org,41413,1694818872288 in 169 msec 2023-09-15 23:02:39,179 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=87, resume processing ppid=86 2023-09-15 23:02:39,179 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=87, ppid=86, state=SUCCESS; CloseRegionProcedure 3d7d5328b03e7580532dc45552cc1dc1, server=jenkins-hbase4.apache.org,34705,1694818872254 in 171 msec 2023-09-15 23:02:39,179 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=85, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=aa5581efb16c18499914b11aedd5365f, UNASSIGN in 176 msec 2023-09-15 23:02:39,180 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=86, resume processing ppid=84 2023-09-15 23:02:39,180 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=86, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=3d7d5328b03e7580532dc45552cc1dc1, UNASSIGN in 177 msec 2023-09-15 23:02:39,181 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694818959181"}]},"ts":"1694818959181"} 2023-09-15 23:02:39,182 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLED in hbase:meta 2023-09-15 23:02:39,184 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLED 2023-09-15 23:02:39,186 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=84, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 191 msec 2023-09-15 23:02:39,300 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-09-15 23:02:39,300 INFO [Listener at jenkins-hbase4.apache.org/46629] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 84 completed 2023-09-15 23:02:39,301 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion 2023-09-15 23:02:39,302 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] procedure2.ProcedureExecutor(1028): Stored pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-15 23:02:39,304 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-15 23:02:39,304 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion 2023-09-15 23:02:39,305 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=89, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-15 23:02:39,306 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41413] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion 2023-09-15 23:02:39,309 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/3d7d5328b03e7580532dc45552cc1dc1 2023-09-15 23:02:39,309 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:33655-0x100b1d2daa90001, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-15 23:02:39,309 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-15 23:02:39,309 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/aa5581efb16c18499914b11aedd5365f 2023-09-15 23:02:39,309 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:41413-0x100b1d2daa90003, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-15 23:02:39,309 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:34705-0x100b1d2daa90002, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-15 23:02:39,309 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-09-15 23:02:39,310 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-09-15 23:02:39,310 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-09-15 23:02:39,310 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-09-15 23:02:39,311 DEBUG [HFileArchiver-15] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/3d7d5328b03e7580532dc45552cc1dc1/cf, FileablePath, hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/3d7d5328b03e7580532dc45552cc1dc1/recovered.edits] 2023-09-15 23:02:39,311 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/aa5581efb16c18499914b11aedd5365f/cf, FileablePath, hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/aa5581efb16c18499914b11aedd5365f/recovered.edits] 2023-09-15 23:02:39,311 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-15 23:02:39,311 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:33655-0x100b1d2daa90001, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-15 23:02:39,311 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-15 23:02:39,311 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:41413-0x100b1d2daa90003, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-15 23:02:39,311 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:33655-0x100b1d2daa90001, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-15 23:02:39,311 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:34705-0x100b1d2daa90002, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-15 23:02:39,312 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:34705-0x100b1d2daa90002, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-15 23:02:39,312 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:41413-0x100b1d2daa90003, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-15 23:02:39,312 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-09-15 23:02:39,315 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/3d7d5328b03e7580532dc45552cc1dc1/cf/c16e02d34f7c4ab19c6d3682bce2f4c1 to hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/3d7d5328b03e7580532dc45552cc1dc1/cf/c16e02d34f7c4ab19c6d3682bce2f4c1 2023-09-15 23:02:39,315 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/aa5581efb16c18499914b11aedd5365f/cf/09937954a71441e4b3624d0261519a04 to hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aa5581efb16c18499914b11aedd5365f/cf/09937954a71441e4b3624d0261519a04 2023-09-15 23:02:39,318 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/3d7d5328b03e7580532dc45552cc1dc1/recovered.edits/9.seqid to hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/3d7d5328b03e7580532dc45552cc1dc1/recovered.edits/9.seqid 2023-09-15 23:02:39,318 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/aa5581efb16c18499914b11aedd5365f/recovered.edits/9.seqid to hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aa5581efb16c18499914b11aedd5365f/recovered.edits/9.seqid 2023-09-15 23:02:39,318 DEBUG [HFileArchiver-15] backup.HFileArchiver(596): Deleted hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/3d7d5328b03e7580532dc45552cc1dc1 2023-09-15 23:02:39,319 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/aa5581efb16c18499914b11aedd5365f 2023-09-15 23:02:39,319 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-09-15 23:02:39,319 DEBUG [PEWorker-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-09-15 23:02:39,320 DEBUG [PEWorker-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf] 2023-09-15 23:02:39,323 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b202309156a5829417bd247e5b5e2a57f4307915c to hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b202309156a5829417bd247e5b5e2a57f4307915c 2023-09-15 23:02:39,324 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230915a92eda2910de4b80929241357debc368 to hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230915a92eda2910de4b80929241357debc368 2023-09-15 23:02:39,324 DEBUG [PEWorker-2] backup.HFileArchiver(596): Deleted hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-09-15 23:02:39,326 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=89, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-15 23:02:39,328 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithMergeRegion from hbase:meta 2023-09-15 23:02:39,329 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion' descriptor. 2023-09-15 23:02:39,330 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=89, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-15 23:02:39,330 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion' from region states. 2023-09-15 23:02:39,331 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1694818943756.aa5581efb16c18499914b11aedd5365f.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1694818959330"}]},"ts":"9223372036854775807"} 2023-09-15 23:02:39,331 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1694818943756.3d7d5328b03e7580532dc45552cc1dc1.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1694818959330"}]},"ts":"9223372036854775807"} 2023-09-15 23:02:39,332 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-15 23:02:39,332 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => aa5581efb16c18499914b11aedd5365f, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1694818943756.aa5581efb16c18499914b11aedd5365f.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 3d7d5328b03e7580532dc45552cc1dc1, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1694818943756.3d7d5328b03e7580532dc45552cc1dc1.', STARTKEY => '1', ENDKEY => ''}] 2023-09-15 23:02:39,332 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion' as deleted. 2023-09-15 23:02:39,332 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1694818959332"}]},"ts":"9223372036854775807"} 2023-09-15 23:02:39,333 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion state from META 2023-09-15 23:02:39,336 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=89, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-15 23:02:39,337 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=89, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 35 msec 2023-09-15 23:02:39,414 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-09-15 23:02:39,414 INFO [Listener at jenkins-hbase4.apache.org/46629] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 89 completed 2023-09-15 23:02:39,423 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithMergeRegion" 2023-09-15 23:02:39,424 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 23:02:39,426 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion" 2023-09-15 23:02:39,427 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 23:02:39,429 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion-1" 2023-09-15 23:02:39,430 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-15 23:02:39,454 INFO [Listener at jenkins-hbase4.apache.org/46629] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=760 (was 748) Potentially hanging thread: IPC Client (1629749639) connection to jenkins-hbase4.apache.org/172.31.14.131:34549 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Parameter Sending Thread #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x78d29e78-shared-pool-27 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x78d29e78-shared-pool-29 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x78d29e78-shared-pool-30 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x78d29e78-shared-pool-31 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1896422628_17 at /127.0.0.1:44322 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_2046247413_1 at /127.0.0.1:44306 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-19 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1896422628_17 at /127.0.0.1:52066 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-3954 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1896422628_17 at /127.0.0.1:35794 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-20 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x78d29e78-shared-pool-32 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x78d29e78-shared-pool-28 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=914 (was 902) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=196 (was 200), ProcessCount=166 (was 166), AvailableMemoryMB=5008 (was 5139) 2023-09-15 23:02:39,454 WARN [Listener at jenkins-hbase4.apache.org/46629] hbase.ResourceChecker(130): Thread=760 is superior to 500 2023-09-15 23:02:39,473 INFO [Listener at jenkins-hbase4.apache.org/46629] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=760, OpenFileDescriptor=914, MaxFileDescriptor=60000, SystemLoadAverage=196, ProcessCount=166, AvailableMemoryMB=5007 2023-09-15 23:02:39,473 WARN [Listener at jenkins-hbase4.apache.org/46629] hbase.ResourceChecker(130): Thread=760 is superior to 500 2023-09-15 23:02:39,475 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-15 23:02:39,476 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] procedure2.ProcedureExecutor(1028): Stored pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-15 23:02:39,478 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-09-15 23:02:39,478 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testEmptyExportFileSystemState" procId is: 90 2023-09-15 23:02:39,478 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-15 23:02:39,478 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-09-15 23:02:39,480 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.tmp/data/default/testtb-testEmptyExportFileSystemState/2407fc8de1924ce04e963b0ea0c2b4da 2023-09-15 23:02:39,480 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.tmp/data/default/testtb-testEmptyExportFileSystemState/f676f9b73608fabf2316bb32fb4bee0a 2023-09-15 23:02:39,481 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.tmp/data/default/testtb-testEmptyExportFileSystemState/2407fc8de1924ce04e963b0ea0c2b4da empty. 2023-09-15 23:02:39,481 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.tmp/data/default/testtb-testEmptyExportFileSystemState/f676f9b73608fabf2316bb32fb4bee0a empty. 2023-09-15 23:02:39,481 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.tmp/data/default/testtb-testEmptyExportFileSystemState/2407fc8de1924ce04e963b0ea0c2b4da 2023-09-15 23:02:39,481 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.tmp/data/default/testtb-testEmptyExportFileSystemState/f676f9b73608fabf2316bb32fb4bee0a 2023-09-15 23:02:39,481 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-09-15 23:02:39,490 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.tmp/data/default/testtb-testEmptyExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-09-15 23:02:39,491 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 2407fc8de1924ce04e963b0ea0c2b4da, NAME => 'testtb-testEmptyExportFileSystemState,,1694818959474.2407fc8de1924ce04e963b0ea0c2b4da.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.tmp 2023-09-15 23:02:39,491 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => f676f9b73608fabf2316bb32fb4bee0a, NAME => 'testtb-testEmptyExportFileSystemState,1,1694818959474.f676f9b73608fabf2316bb32fb4bee0a.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.tmp 2023-09-15 23:02:39,503 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1694818959474.2407fc8de1924ce04e963b0ea0c2b4da.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-15 23:02:39,503 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 2407fc8de1924ce04e963b0ea0c2b4da, disabling compactions & flushes 2023-09-15 23:02:39,503 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1694818959474.f676f9b73608fabf2316bb32fb4bee0a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-15 23:02:39,503 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1694818959474.2407fc8de1924ce04e963b0ea0c2b4da. 2023-09-15 23:02:39,503 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing f676f9b73608fabf2316bb32fb4bee0a, disabling compactions & flushes 2023-09-15 23:02:39,503 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1694818959474.2407fc8de1924ce04e963b0ea0c2b4da. 2023-09-15 23:02:39,503 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1694818959474.f676f9b73608fabf2316bb32fb4bee0a. 2023-09-15 23:02:39,503 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1694818959474.f676f9b73608fabf2316bb32fb4bee0a. 2023-09-15 23:02:39,503 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1694818959474.2407fc8de1924ce04e963b0ea0c2b4da. after waiting 0 ms 2023-09-15 23:02:39,504 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1694818959474.2407fc8de1924ce04e963b0ea0c2b4da. 2023-09-15 23:02:39,503 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1694818959474.f676f9b73608fabf2316bb32fb4bee0a. after waiting 0 ms 2023-09-15 23:02:39,504 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1694818959474.f676f9b73608fabf2316bb32fb4bee0a. 2023-09-15 23:02:39,504 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1694818959474.2407fc8de1924ce04e963b0ea0c2b4da. 2023-09-15 23:02:39,504 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1694818959474.f676f9b73608fabf2316bb32fb4bee0a. 2023-09-15 23:02:39,504 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 2407fc8de1924ce04e963b0ea0c2b4da: 2023-09-15 23:02:39,504 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for f676f9b73608fabf2316bb32fb4bee0a: 2023-09-15 23:02:39,506 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-09-15 23:02:39,506 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1694818959474.2407fc8de1924ce04e963b0ea0c2b4da.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1694818959506"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694818959506"}]},"ts":"1694818959506"} 2023-09-15 23:02:39,506 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1694818959474.f676f9b73608fabf2316bb32fb4bee0a.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1694818959506"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694818959506"}]},"ts":"1694818959506"} 2023-09-15 23:02:39,508 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-15 23:02:39,509 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-15 23:02:39,509 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694818959509"}]},"ts":"1694818959509"} 2023-09-15 23:02:39,510 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLING in hbase:meta 2023-09-15 23:02:39,513 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-15 23:02:39,514 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-15 23:02:39,514 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-15 23:02:39,514 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-15 23:02:39,514 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-15 23:02:39,515 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=2407fc8de1924ce04e963b0ea0c2b4da, ASSIGN}, {pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=f676f9b73608fabf2316bb32fb4bee0a, ASSIGN}] 2023-09-15 23:02:39,516 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=2407fc8de1924ce04e963b0ea0c2b4da, ASSIGN 2023-09-15 23:02:39,517 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=f676f9b73608fabf2316bb32fb4bee0a, ASSIGN 2023-09-15 23:02:39,517 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=2407fc8de1924ce04e963b0ea0c2b4da, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34705,1694818872254; forceNewPlan=false, retain=false 2023-09-15 23:02:39,517 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=f676f9b73608fabf2316bb32fb4bee0a, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41413,1694818872288; forceNewPlan=false, retain=false 2023-09-15 23:02:39,579 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-09-15 23:02:39,668 INFO [jenkins-hbase4:44427] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-15 23:02:39,670 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=2407fc8de1924ce04e963b0ea0c2b4da, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:02:39,670 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=f676f9b73608fabf2316bb32fb4bee0a, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:02:39,670 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1694818959474.2407fc8de1924ce04e963b0ea0c2b4da.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1694818959670"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694818959670"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694818959670"}]},"ts":"1694818959670"} 2023-09-15 23:02:39,670 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1694818959474.f676f9b73608fabf2316bb32fb4bee0a.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1694818959670"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694818959670"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694818959670"}]},"ts":"1694818959670"} 2023-09-15 23:02:39,672 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=93, ppid=92, state=RUNNABLE; OpenRegionProcedure f676f9b73608fabf2316bb32fb4bee0a, server=jenkins-hbase4.apache.org,41413,1694818872288}] 2023-09-15 23:02:39,673 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=94, ppid=91, state=RUNNABLE; OpenRegionProcedure 2407fc8de1924ce04e963b0ea0c2b4da, server=jenkins-hbase4.apache.org,34705,1694818872254}] 2023-09-15 23:02:39,780 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-09-15 23:02:39,830 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,1,1694818959474.f676f9b73608fabf2316bb32fb4bee0a. 2023-09-15 23:02:39,830 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => f676f9b73608fabf2316bb32fb4bee0a, NAME => 'testtb-testEmptyExportFileSystemState,1,1694818959474.f676f9b73608fabf2316bb32fb4bee0a.', STARTKEY => '1', ENDKEY => ''} 2023-09-15 23:02:39,831 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,1,1694818959474.f676f9b73608fabf2316bb32fb4bee0a. service=AccessControlService 2023-09-15 23:02:39,831 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-15 23:02:39,831 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,,1694818959474.2407fc8de1924ce04e963b0ea0c2b4da. 2023-09-15 23:02:39,831 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState f676f9b73608fabf2316bb32fb4bee0a 2023-09-15 23:02:39,831 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 2407fc8de1924ce04e963b0ea0c2b4da, NAME => 'testtb-testEmptyExportFileSystemState,,1694818959474.2407fc8de1924ce04e963b0ea0c2b4da.', STARTKEY => '', ENDKEY => '1'} 2023-09-15 23:02:39,831 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1694818959474.f676f9b73608fabf2316bb32fb4bee0a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-15 23:02:39,831 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for f676f9b73608fabf2316bb32fb4bee0a 2023-09-15 23:02:39,831 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for f676f9b73608fabf2316bb32fb4bee0a 2023-09-15 23:02:39,831 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,,1694818959474.2407fc8de1924ce04e963b0ea0c2b4da. service=AccessControlService 2023-09-15 23:02:39,831 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-15 23:02:39,832 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 2407fc8de1924ce04e963b0ea0c2b4da 2023-09-15 23:02:39,832 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1694818959474.2407fc8de1924ce04e963b0ea0c2b4da.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-15 23:02:39,832 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 2407fc8de1924ce04e963b0ea0c2b4da 2023-09-15 23:02:39,832 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 2407fc8de1924ce04e963b0ea0c2b4da 2023-09-15 23:02:39,832 INFO [StoreOpener-f676f9b73608fabf2316bb32fb4bee0a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region f676f9b73608fabf2316bb32fb4bee0a 2023-09-15 23:02:39,844 INFO [StoreOpener-2407fc8de1924ce04e963b0ea0c2b4da-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 2407fc8de1924ce04e963b0ea0c2b4da 2023-09-15 23:02:39,845 DEBUG [StoreOpener-f676f9b73608fabf2316bb32fb4bee0a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/default/testtb-testEmptyExportFileSystemState/f676f9b73608fabf2316bb32fb4bee0a/cf 2023-09-15 23:02:39,845 DEBUG [StoreOpener-f676f9b73608fabf2316bb32fb4bee0a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/default/testtb-testEmptyExportFileSystemState/f676f9b73608fabf2316bb32fb4bee0a/cf 2023-09-15 23:02:39,845 INFO [StoreOpener-f676f9b73608fabf2316bb32fb4bee0a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f676f9b73608fabf2316bb32fb4bee0a columnFamilyName cf 2023-09-15 23:02:39,845 DEBUG [StoreOpener-2407fc8de1924ce04e963b0ea0c2b4da-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/default/testtb-testEmptyExportFileSystemState/2407fc8de1924ce04e963b0ea0c2b4da/cf 2023-09-15 23:02:39,845 DEBUG [StoreOpener-2407fc8de1924ce04e963b0ea0c2b4da-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/default/testtb-testEmptyExportFileSystemState/2407fc8de1924ce04e963b0ea0c2b4da/cf 2023-09-15 23:02:39,846 INFO [StoreOpener-2407fc8de1924ce04e963b0ea0c2b4da-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2407fc8de1924ce04e963b0ea0c2b4da columnFamilyName cf 2023-09-15 23:02:39,846 INFO [StoreOpener-f676f9b73608fabf2316bb32fb4bee0a-1] regionserver.HStore(310): Store=f676f9b73608fabf2316bb32fb4bee0a/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-15 23:02:39,847 INFO [StoreOpener-2407fc8de1924ce04e963b0ea0c2b4da-1] regionserver.HStore(310): Store=2407fc8de1924ce04e963b0ea0c2b4da/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-15 23:02:39,847 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/default/testtb-testEmptyExportFileSystemState/f676f9b73608fabf2316bb32fb4bee0a 2023-09-15 23:02:39,848 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/default/testtb-testEmptyExportFileSystemState/2407fc8de1924ce04e963b0ea0c2b4da 2023-09-15 23:02:39,848 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/default/testtb-testEmptyExportFileSystemState/f676f9b73608fabf2316bb32fb4bee0a 2023-09-15 23:02:39,848 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/default/testtb-testEmptyExportFileSystemState/2407fc8de1924ce04e963b0ea0c2b4da 2023-09-15 23:02:39,850 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for f676f9b73608fabf2316bb32fb4bee0a 2023-09-15 23:02:39,850 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 2407fc8de1924ce04e963b0ea0c2b4da 2023-09-15 23:02:39,852 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/default/testtb-testEmptyExportFileSystemState/f676f9b73608fabf2316bb32fb4bee0a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-15 23:02:39,852 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/default/testtb-testEmptyExportFileSystemState/2407fc8de1924ce04e963b0ea0c2b4da/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-15 23:02:39,852 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened f676f9b73608fabf2316bb32fb4bee0a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64383014, jitterRate=-0.040618330240249634}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-15 23:02:39,853 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for f676f9b73608fabf2316bb32fb4bee0a: 2023-09-15 23:02:39,853 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 2407fc8de1924ce04e963b0ea0c2b4da; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64570219, jitterRate=-0.03782875835895538}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-15 23:02:39,853 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 2407fc8de1924ce04e963b0ea0c2b4da: 2023-09-15 23:02:39,853 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,1,1694818959474.f676f9b73608fabf2316bb32fb4bee0a., pid=93, masterSystemTime=1694818959827 2023-09-15 23:02:39,853 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,,1694818959474.2407fc8de1924ce04e963b0ea0c2b4da., pid=94, masterSystemTime=1694818959827 2023-09-15 23:02:39,855 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,,1694818959474.2407fc8de1924ce04e963b0ea0c2b4da. 2023-09-15 23:02:39,855 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,,1694818959474.2407fc8de1924ce04e963b0ea0c2b4da. 2023-09-15 23:02:39,856 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=2407fc8de1924ce04e963b0ea0c2b4da, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:02:39,856 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,,1694818959474.2407fc8de1924ce04e963b0ea0c2b4da.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1694818959856"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1694818959856"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1694818959856"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1694818959856"}]},"ts":"1694818959856"} 2023-09-15 23:02:39,856 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,1,1694818959474.f676f9b73608fabf2316bb32fb4bee0a. 2023-09-15 23:02:39,856 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,1,1694818959474.f676f9b73608fabf2316bb32fb4bee0a. 2023-09-15 23:02:39,856 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=f676f9b73608fabf2316bb32fb4bee0a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:02:39,857 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,1,1694818959474.f676f9b73608fabf2316bb32fb4bee0a.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1694818959856"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1694818959856"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1694818959856"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1694818959856"}]},"ts":"1694818959856"} 2023-09-15 23:02:39,859 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=94, resume processing ppid=91 2023-09-15 23:02:39,859 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=94, ppid=91, state=SUCCESS; OpenRegionProcedure 2407fc8de1924ce04e963b0ea0c2b4da, server=jenkins-hbase4.apache.org,34705,1694818872254 in 184 msec 2023-09-15 23:02:39,860 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=93, resume processing ppid=92 2023-09-15 23:02:39,860 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=93, ppid=92, state=SUCCESS; OpenRegionProcedure f676f9b73608fabf2316bb32fb4bee0a, server=jenkins-hbase4.apache.org,41413,1694818872288 in 186 msec 2023-09-15 23:02:39,860 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=91, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=2407fc8de1924ce04e963b0ea0c2b4da, ASSIGN in 344 msec 2023-09-15 23:02:39,861 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=92, resume processing ppid=90 2023-09-15 23:02:39,862 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=92, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=f676f9b73608fabf2316bb32fb4bee0a, ASSIGN in 345 msec 2023-09-15 23:02:39,862 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-15 23:02:39,862 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694818959862"}]},"ts":"1694818959862"} 2023-09-15 23:02:39,863 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLED in hbase:meta 2023-09-15 23:02:39,866 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-09-15 23:02:39,866 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testEmptyExportFileSystemState jenkins: RWXCA 2023-09-15 23:02:39,867 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41413] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-09-15 23:02:39,869 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:34705-0x100b1d2daa90002, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-15 23:02:39,869 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-15 23:02:39,869 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:33655-0x100b1d2daa90001, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-15 23:02:39,869 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:41413-0x100b1d2daa90003, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-15 23:02:39,870 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-15 23:02:39,870 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-15 23:02:39,870 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-15 23:02:39,870 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-15 23:02:39,871 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=90, state=SUCCESS; CreateTableProcedure table=testtb-testEmptyExportFileSystemState in 395 msec 2023-09-15 23:02:40,081 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-09-15 23:02:40,082 INFO [Listener at jenkins-hbase4.apache.org/46629] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 90 completed 2023-09-15 23:02:40,084 DEBUG [Listener at jenkins-hbase4.apache.org/46629] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-09-15 23:02:40,084 DEBUG [Listener at jenkins-hbase4.apache.org/46629] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1694818959474.2407fc8de1924ce04e963b0ea0c2b4da. 2023-09-15 23:02:40,085 INFO [Listener at jenkins-hbase4.apache.org/46629] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-15 23:02:40,095 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-15 23:02:40,096 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1694818960096 (current time:1694818960096). 2023-09-15 23:02:40,096 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-15 23:02:40,096 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] zookeeper.ReadOnlyZKClient(139): Connect 0x7a183d77 to 127.0.0.1:51149 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-15 23:02:40,104 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4459fd10, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-15 23:02:40,108 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-15 23:02:40,110 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35022, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-15 23:02:40,111 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7a183d77 to 127.0.0.1:51149 2023-09-15 23:02:40,111 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-15 23:02:40,112 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] zookeeper.ReadOnlyZKClient(139): Connect 0x4c0a1aef to 127.0.0.1:51149 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-15 23:02:40,116 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7742759c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-15 23:02:40,118 DEBUG [hconnection-0x7c78b719-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-15 23:02:40,120 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35034, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-15 23:02:40,124 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4c0a1aef to 127.0.0.1:51149 2023-09-15 23:02:40,124 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-15 23:02:40,124 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-09-15 23:02:40,125 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-15 23:02:40,125 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-15 23:02:40,127 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] procedure2.ProcedureExecutor(1028): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-15 23:02:40,128 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-15 23:02:40,128 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1694819560128 2023-09-15 23:02:40,128 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-09-15 23:02:40,128 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-15 23:02:40,129 DEBUG [Listener at jenkins-hbase4.apache.org/46629] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-15 23:02:40,129 DEBUG [Listener at jenkins-hbase4.apache.org/46629] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-15 23:02:40,130 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-15 23:02:40,130 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-15 23:02:40,131 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 4 msec 2023-09-15 23:02:40,134 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-15 23:02:40,134 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=96, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1694819560134 2023-09-15 23:02:40,146 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testEmptyExportFileSystemState 2023-09-15 23:02:40,146 INFO [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState' 2023-09-15 23:02:40,146 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-15 23:02:40,147 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-09-15 23:02:40,147 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-09-15 23:02:40,148 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-15 23:02:40,148 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-15 23:02:40,157 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:34705-0x100b1d2daa90002, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 23:02:40,158 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:02:40,158 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 23:02:40,157 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:41413-0x100b1d2daa90003, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 23:02:40,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 23:02:40,158 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 23:02:40,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 23:02:40,157 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:33655-0x100b1d2daa90001, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 23:02:40,158 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 23:02:40,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 23:02:40,158 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:02:40,158 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:02:40,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-15 23:02:40,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-15 23:02:40,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-15 23:02:40,158 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41413-0x100b1d2daa90003, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-15 23:02:40,158 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:02:40,158 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-15 23:02:40,159 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33655-0x100b1d2daa90001, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-15 23:02:40,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-09-15 23:02:40,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-15 23:02:40,159 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-15 23:02:40,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-09-15 23:02:40,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-15 23:02:40,159 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-09-15 23:02:40,159 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-15 23:02:40,159 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-15 23:02:40,159 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-15 23:02:40,159 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34705-0x100b1d2daa90002, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-15 23:02:40,160 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-15 23:02:40,160 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-15 23:02:40,160 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41413,1694818872288' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-09-15 23:02:40,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-09-15 23:02:40,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-15 23:02:40,161 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-15 23:02:40,161 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-09-15 23:02:40,161 DEBUG [member: 'jenkins-hbase4.apache.org,33655,1694818872204' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-15 23:02:40,161 DEBUG [member: 'jenkins-hbase4.apache.org,33655,1694818872204' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-15 23:02:40,162 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:02:40,162 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-15 23:02:40,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:02:40,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-15 23:02:40,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-15 23:02:40,162 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41413-0x100b1d2daa90003, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-15 23:02:40,162 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-15 23:02:40,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-15 23:02:40,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-15 23:02:40,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-15 23:02:40,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:02:40,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-15 23:02:40,163 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41413,1694818872288' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-09-15 23:02:40,164 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6f3d88e4[Count = 1] remaining members to acquire global barrier 2023-09-15 23:02:40,164 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-09-15 23:02:40,165 DEBUG [member: 'jenkins-hbase4.apache.org,33655,1694818872204' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-15 23:02:40,165 DEBUG [member: 'jenkins-hbase4.apache.org,33655,1694818872204' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-15 23:02:40,165 DEBUG [member: 'jenkins-hbase4.apache.org,33655,1694818872204' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33655,1694818872204' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-09-15 23:02:40,165 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-15 23:02:40,165 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-15 23:02:40,166 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-15 23:02:40,166 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-15 23:02:40,166 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34705,1694818872254' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-09-15 23:02:40,167 DEBUG [member: 'jenkins-hbase4.apache.org,33655,1694818872204' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-15 23:02:40,168 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-15 23:02:40,168 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:02:40,168 DEBUG [member: 'jenkins-hbase4.apache.org,33655,1694818872204' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33655-0x100b1d2daa90001, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-15 23:02:40,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:02:40,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-15 23:02:40,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-15 23:02:40,168 DEBUG [member: 'jenkins-hbase4.apache.org,33655,1694818872204' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-15 23:02:40,168 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34705-0x100b1d2daa90002, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-15 23:02:40,168 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-15 23:02:40,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-15 23:02:40,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-15 23:02:40,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-15 23:02:40,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:02:40,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:02:40,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33655,1694818872204 2023-09-15 23:02:40,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-15 23:02:40,171 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34705,1694818872254' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-09-15 23:02:40,171 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6f3d88e4[Count = 0] remaining members to acquire global barrier 2023-09-15 23:02:40,171 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-09-15 23:02:40,171 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-15 23:02:40,173 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:34705-0x100b1d2daa90002, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-15 23:02:40,173 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:41413-0x100b1d2daa90003, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-15 23:02:40,173 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-15 23:02:40,173 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:33655-0x100b1d2daa90001, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-15 23:02:40,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-15 23:02:40,173 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-15 23:02:40,174 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-15 23:02:40,174 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-15 23:02:40,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-15 23:02:40,174 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-15 23:02:40,174 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:02:40,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-15 23:02:40,174 DEBUG [rs(jenkins-hbase4.apache.org,34705,1694818872254)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1694818959474.2407fc8de1924ce04e963b0ea0c2b4da. 2023-09-15 23:02:40,174 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-15 23:02:40,174 DEBUG [rs(jenkins-hbase4.apache.org,34705,1694818872254)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1694818959474.2407fc8de1924ce04e963b0ea0c2b4da. started... 2023-09-15 23:02:40,174 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-15 23:02:40,174 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:02:40,174 DEBUG [member: 'jenkins-hbase4.apache.org,33655,1694818872204' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-15 23:02:40,174 DEBUG [rs(jenkins-hbase4.apache.org,34705,1694818872254)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 2407fc8de1924ce04e963b0ea0c2b4da: 2023-09-15 23:02:40,174 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-15 23:02:40,174 DEBUG [rs(jenkins-hbase4.apache.org,41413,1694818872288)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1694818959474.f676f9b73608fabf2316bb32fb4bee0a. 2023-09-15 23:02:40,174 DEBUG [rs(jenkins-hbase4.apache.org,34705,1694818872254)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1694818959474.2407fc8de1924ce04e963b0ea0c2b4da.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-09-15 23:02:40,174 DEBUG [member: 'jenkins-hbase4.apache.org,33655,1694818872204' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-09-15 23:02:40,175 DEBUG [member: 'jenkins-hbase4.apache.org,33655,1694818872204' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,33655,1694818872204' in zk 2023-09-15 23:02:40,174 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-15 23:02:40,175 DEBUG [rs(jenkins-hbase4.apache.org,34705,1694818872254)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-15 23:02:40,174 DEBUG [rs(jenkins-hbase4.apache.org,41413,1694818872288)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1694818959474.f676f9b73608fabf2316bb32fb4bee0a. started... 2023-09-15 23:02:40,174 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-15 23:02:40,175 DEBUG [rs(jenkins-hbase4.apache.org,34705,1694818872254)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-15 23:02:40,176 DEBUG [rs(jenkins-hbase4.apache.org,41413,1694818872288)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for f676f9b73608fabf2316bb32fb4bee0a: 2023-09-15 23:02:40,176 DEBUG [rs(jenkins-hbase4.apache.org,41413,1694818872288)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1694818959474.f676f9b73608fabf2316bb32fb4bee0a.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-09-15 23:02:40,176 DEBUG [rs(jenkins-hbase4.apache.org,41413,1694818872288)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-15 23:02:40,176 DEBUG [rs(jenkins-hbase4.apache.org,41413,1694818872288)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-15 23:02:40,178 DEBUG [member: 'jenkins-hbase4.apache.org,33655,1694818872204' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-15 23:02:40,178 DEBUG [member: 'jenkins-hbase4.apache.org,33655,1694818872204' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-15 23:02:40,178 DEBUG [member: 'jenkins-hbase4.apache.org,33655,1694818872204' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-09-15 23:02:40,192 DEBUG [rs(jenkins-hbase4.apache.org,34705,1694818872254)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1694818959474.2407fc8de1924ce04e963b0ea0c2b4da. completed. 2023-09-15 23:02:40,192 DEBUG [rs(jenkins-hbase4.apache.org,34705,1694818872254)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1694818959474.2407fc8de1924ce04e963b0ea0c2b4da. 2023-09-15 23:02:40,192 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-15 23:02:40,192 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-15 23:02:40,192 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:02:40,192 DEBUG [rs(jenkins-hbase4.apache.org,41413,1694818872288)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1694818959474.f676f9b73608fabf2316bb32fb4bee0a. completed. 2023-09-15 23:02:40,192 DEBUG [rs(jenkins-hbase4.apache.org,41413,1694818872288)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1694818959474.f676f9b73608fabf2316bb32fb4bee0a. 2023-09-15 23:02:40,192 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-09-15 23:02:40,192 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,34705,1694818872254' in zk 2023-09-15 23:02:40,192 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-15 23:02:40,192 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-15 23:02:40,192 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:02:40,192 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-09-15 23:02:40,192 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,41413,1694818872288' in zk 2023-09-15 23:02:40,194 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:02:40,194 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-15 23:02:40,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:02:40,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-15 23:02:40,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-15 23:02:40,194 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-15 23:02:40,194 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-09-15 23:02:40,195 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:02:40,195 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-15 23:02:40,195 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-15 23:02:40,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-15 23:02:40,195 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-09-15 23:02:40,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-15 23:02:40,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-15 23:02:40,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:02:40,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:02:40,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33655,1694818872204 2023-09-15 23:02:40,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-15 23:02:40,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-15 23:02:40,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:02:40,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:02:40,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33655,1694818872204 2023-09-15 23:02:40,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,34705,1694818872254': 2023-09-15 23:02:40,198 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34705,1694818872254' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-09-15 23:02:40,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:02:40,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-15 23:02:40,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-15 23:02:40,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-15 23:02:40,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-15 23:02:40,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-15 23:02:40,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:02:40,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:02:40,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33655,1694818872204 2023-09-15 23:02:40,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-15 23:02:40,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-15 23:02:40,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:02:40,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:02:40,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33655,1694818872204 2023-09-15 23:02:40,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,41413,1694818872288': 2023-09-15 23:02:40,201 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41413,1694818872288' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-09-15 23:02:40,201 INFO [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' execution completed 2023-09-15 23:02:40,201 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-15 23:02:40,201 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-15 23:02:40,201 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testEmptyExportFileSystemState 2023-09-15 23:02:40,201 INFO [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-15 23:02:40,204 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:33655-0x100b1d2daa90001, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-15 23:02:40,204 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:41413-0x100b1d2daa90003, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-15 23:02:40,204 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-15 23:02:40,204 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-15 23:02:40,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-15 23:02:40,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-15 23:02:40,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-15 23:02:40,204 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:41413-0x100b1d2daa90003, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 23:02:40,204 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-15 23:02:40,204 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:33655-0x100b1d2daa90001, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 23:02:40,204 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:34705-0x100b1d2daa90002, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-15 23:02:40,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-15 23:02:40,204 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-15 23:02:40,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-15 23:02:40,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-15 23:02:40,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-15 23:02:40,204 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:34705-0x100b1d2daa90002, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 23:02:40,204 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:02:40,204 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 23:02:40,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 23:02:40,205 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 23:02:40,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 23:02:40,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-15 23:02:40,205 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 23:02:40,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 23:02:40,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-15 23:02:40,205 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:02:40,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-15 23:02:40,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-15 23:02:40,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-15 23:02:40,206 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33655,1694818872204 2023-09-15 23:02:40,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-15 23:02:40,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:02:40,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:02:40,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33655,1694818872204 2023-09-15 23:02:40,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-15 23:02:40,207 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:02:40,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-15 23:02:40,207 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:02:40,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:02:40,208 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33655,1694818872204 2023-09-15 23:02:40,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:02:40,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33655,1694818872204 2023-09-15 23:02:40,210 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33655,1694818872204 2023-09-15 23:02:40,210 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-15 23:02:40,210 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:33655-0x100b1d2daa90001, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 23:02:40,210 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:02:40,210 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:34705-0x100b1d2daa90002, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 23:02:40,210 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:02:40,210 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 23:02:40,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 23:02:40,210 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:41413-0x100b1d2daa90003, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 23:02:40,210 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-15 23:02:40,210 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 23:02:40,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 23:02:40,210 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:34705-0x100b1d2daa90002, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 23:02:40,210 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testEmptyExportFileSystemState 2023-09-15 23:02:40,210 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-15 23:02:40,210 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:33655-0x100b1d2daa90001, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 23:02:40,210 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 23:02:40,211 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 23:02:40,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 23:02:40,211 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-09-15 23:02:40,210 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33655,1694818872204 2023-09-15 23:02:40,210 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:41413-0x100b1d2daa90003, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 23:02:40,212 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-15 23:02:40,212 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 23:02:40,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 23:02:40,212 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:02:40,212 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-09-15 23:02:40,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 23:02:40,212 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-15 23:02:40,212 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:02:40,212 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-15 23:02:40,212 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-15 23:02:40,212 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 23:02:40,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 23:02:40,212 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-15 23:02:40,221 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testEmptyExportFileSystemState 2023-09-15 23:02:40,221 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-09-15 23:02:40,230 DEBUG [Listener at jenkins-hbase4.apache.org/46629] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-15 23:02:40,231 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-15 23:02:40,231 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-09-15 23:02:40,232 DEBUG [Listener at jenkins-hbase4.apache.org/46629] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-15 23:02:40,238 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-09-15 23:02:40,238 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-09-15 23:02:40,238 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-09-15 23:02:40,239 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-09-15 23:02:40,239 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1694818960128Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1694818960221 (+93 ms)Consolidate snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1694818960221Loading Region manifests for emptySnaptb0-testEmptyExportFileSystemState at 1694818960221Writing data manifest for emptySnaptb0-testEmptyExportFileSystemState at 1694818960224 (+3 ms)Verifying snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1694818960233 (+9 ms)Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1694818960238 (+5 ms) 2023-09-15 23:02:40,242 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=96, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-15 23:02:40,243 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=96, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 113 msec 2023-09-15 23:02:40,432 DEBUG [Listener at jenkins-hbase4.apache.org/46629] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-15 23:02:40,433 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-15 23:02:40,433 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-15 23:02:40,435 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34705] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,,1694818959474.2407fc8de1924ce04e963b0ea0c2b4da. with WAL disabled. Data may be lost in the event of a crash. 2023-09-15 23:02:40,436 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41413] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,1,1694818959474.f676f9b73608fabf2316bb32fb4bee0a. with WAL disabled. Data may be lost in the event of a crash. 2023-09-15 23:02:40,439 DEBUG [Listener at jenkins-hbase4.apache.org/46629] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-09-15 23:02:40,439 DEBUG [Listener at jenkins-hbase4.apache.org/46629] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1694818959474.2407fc8de1924ce04e963b0ea0c2b4da. 2023-09-15 23:02:40,439 INFO [Listener at jenkins-hbase4.apache.org/46629] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-15 23:02:40,448 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-15 23:02:40,448 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1694818960448 (current time:1694818960448). 2023-09-15 23:02:40,448 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-15 23:02:40,449 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] zookeeper.ReadOnlyZKClient(139): Connect 0x161507bd to 127.0.0.1:51149 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-15 23:02:40,455 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2fecba19, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-15 23:02:40,456 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-15 23:02:40,457 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35048, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-15 23:02:40,458 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x161507bd to 127.0.0.1:51149 2023-09-15 23:02:40,458 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-15 23:02:40,459 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] zookeeper.ReadOnlyZKClient(139): Connect 0x3e2ef855 to 127.0.0.1:51149 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-15 23:02:40,466 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@b828c2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-15 23:02:40,467 DEBUG [hconnection-0x4ace66be-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-15 23:02:40,470 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35058, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-15 23:02:40,474 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3e2ef855 to 127.0.0.1:51149 2023-09-15 23:02:40,474 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-15 23:02:40,474 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-09-15 23:02:40,475 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-15 23:02:40,475 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-15 23:02:40,476 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] procedure2.ProcedureExecutor(1028): Stored pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-15 23:02:40,477 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-15 23:02:40,478 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=97, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1694819560478 2023-09-15 23:02:40,478 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-09-15 23:02:40,478 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-15 23:02:40,479 DEBUG [Listener at jenkins-hbase4.apache.org/46629] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-15 23:02:40,479 DEBUG [Listener at jenkins-hbase4.apache.org/46629] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-15 23:02:40,479 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-15 23:02:40,482 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=97, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-15 23:02:40,483 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=97, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 6 msec 2023-09-15 23:02:40,484 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-15 23:02:40,485 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=98, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1694819560485 2023-09-15 23:02:40,495 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testEmptyExportFileSystemState 2023-09-15 23:02:40,495 INFO [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testEmptyExportFileSystemState' 2023-09-15 23:02:40,495 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-15 23:02:40,496 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-09-15 23:02:40,496 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-09-15 23:02:40,497 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-15 23:02:40,497 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-15 23:02:40,498 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:34705-0x100b1d2daa90002, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 23:02:40,498 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:33655-0x100b1d2daa90001, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 23:02:40,498 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 23:02:40,498 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 23:02:40,498 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:41413-0x100b1d2daa90003, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 23:02:40,498 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:02:40,498 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 23:02:40,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 23:02:40,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 23:02:40,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 23:02:40,499 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:02:40,499 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:02:40,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-15 23:02:40,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-15 23:02:40,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-15 23:02:40,500 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33655-0x100b1d2daa90001, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-15 23:02:40,500 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:02:40,500 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-15 23:02:40,500 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34705-0x100b1d2daa90002, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-15 23:02:40,500 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41413-0x100b1d2daa90003, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-15 23:02:40,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-09-15 23:02:40,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-15 23:02:40,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-09-15 23:02:40,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-09-15 23:02:40,500 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-15 23:02:40,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-15 23:02:40,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-15 23:02:40,500 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-15 23:02:40,500 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-09-15 23:02:40,501 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-15 23:02:40,501 DEBUG [member: 'jenkins-hbase4.apache.org,33655,1694818872204' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-15 23:02:40,501 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-09-15 23:02:40,501 DEBUG [member: 'jenkins-hbase4.apache.org,33655,1694818872204' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-15 23:02:40,501 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-15 23:02:40,502 DEBUG [member: 'jenkins-hbase4.apache.org,33655,1694818872204' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-15 23:02:40,502 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-15 23:02:40,502 DEBUG [member: 'jenkins-hbase4.apache.org,33655,1694818872204' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-15 23:02:40,503 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-15 23:02:40,503 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-15 23:02:40,503 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34705,1694818872254' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-09-15 23:02:40,501 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-09-15 23:02:40,503 DEBUG [member: 'jenkins-hbase4.apache.org,33655,1694818872204' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33655,1694818872204' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-09-15 23:02:40,503 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-15 23:02:40,503 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-15 23:02:40,506 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-15 23:02:40,506 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-15 23:02:40,506 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41413,1694818872288' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-09-15 23:02:40,507 DEBUG [member: 'jenkins-hbase4.apache.org,33655,1694818872204' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-15 23:02:40,509 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:02:40,509 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-15 23:02:40,509 DEBUG [member: 'jenkins-hbase4.apache.org,33655,1694818872204' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33655-0x100b1d2daa90001, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-15 23:02:40,509 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:02:40,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:02:40,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-15 23:02:40,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-15 23:02:40,509 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-15 23:02:40,509 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34705-0x100b1d2daa90002, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-15 23:02:40,509 DEBUG [member: 'jenkins-hbase4.apache.org,33655,1694818872204' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-15 23:02:40,509 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-15 23:02:40,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-15 23:02:40,509 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41413-0x100b1d2daa90003, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-15 23:02:40,509 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-15 23:02:40,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-15 23:02:40,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-15 23:02:40,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:02:40,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:02:40,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33655,1694818872204 2023-09-15 23:02:40,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-15 23:02:40,511 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34705,1694818872254' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-09-15 23:02:40,511 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@14e1fb2d[Count = 1] remaining members to acquire global barrier 2023-09-15 23:02:40,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:02:40,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-15 23:02:40,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-15 23:02:40,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-15 23:02:40,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-15 23:02:40,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-15 23:02:40,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:02:40,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:02:40,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33655,1694818872204 2023-09-15 23:02:40,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-15 23:02:40,512 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41413,1694818872288' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-09-15 23:02:40,512 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@14e1fb2d[Count = 0] remaining members to acquire global barrier 2023-09-15 23:02:40,512 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-09-15 23:02:40,513 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-15 23:02:40,519 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:33655-0x100b1d2daa90001, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-15 23:02:40,519 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:41413-0x100b1d2daa90003, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-15 23:02:40,519 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-15 23:02:40,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-15 23:02:40,519 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-15 23:02:40,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-15 23:02:40,520 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:02:40,519 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:34705-0x100b1d2daa90002, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-15 23:02:40,520 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-15 23:02:40,519 DEBUG [member: 'jenkins-hbase4.apache.org,33655,1694818872204' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-15 23:02:40,520 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-15 23:02:40,520 DEBUG [member: 'jenkins-hbase4.apache.org,33655,1694818872204' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-09-15 23:02:40,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-15 23:02:40,520 DEBUG [member: 'jenkins-hbase4.apache.org,33655,1694818872204' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,33655,1694818872204' in zk 2023-09-15 23:02:40,520 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-15 23:02:40,520 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-15 23:02:40,520 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-15 23:02:40,520 DEBUG [rs(jenkins-hbase4.apache.org,41413,1694818872288)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1694818959474.f676f9b73608fabf2316bb32fb4bee0a. 2023-09-15 23:02:40,520 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:02:40,520 DEBUG [rs(jenkins-hbase4.apache.org,34705,1694818872254)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1694818959474.2407fc8de1924ce04e963b0ea0c2b4da. 2023-09-15 23:02:40,520 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-15 23:02:40,520 DEBUG [rs(jenkins-hbase4.apache.org,34705,1694818872254)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1694818959474.2407fc8de1924ce04e963b0ea0c2b4da. started... 2023-09-15 23:02:40,520 DEBUG [rs(jenkins-hbase4.apache.org,41413,1694818872288)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1694818959474.f676f9b73608fabf2316bb32fb4bee0a. started... 2023-09-15 23:02:40,520 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-15 23:02:40,520 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-15 23:02:40,520 INFO [rs(jenkins-hbase4.apache.org,34705,1694818872254)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 2407fc8de1924ce04e963b0ea0c2b4da 1/1 column families, dataSize=199 B heapSize=688 B 2023-09-15 23:02:40,520 INFO [rs(jenkins-hbase4.apache.org,41413,1694818872288)-snapshot-pool-0] regionserver.HRegion(2745): Flushing f676f9b73608fabf2316bb32fb4bee0a 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-09-15 23:02:40,521 DEBUG [member: 'jenkins-hbase4.apache.org,33655,1694818872204' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-15 23:02:40,521 DEBUG [member: 'jenkins-hbase4.apache.org,33655,1694818872204' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-15 23:02:40,521 DEBUG [member: 'jenkins-hbase4.apache.org,33655,1694818872204' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-09-15 23:02:40,539 INFO [rs(jenkins-hbase4.apache.org,34705,1694818872254)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230915310d6c0d8eaa439b8706292d1172aee3 to hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230915310d6c0d8eaa439b8706292d1172aee3 2023-09-15 23:02:40,539 INFO [rs(jenkins-hbase4.apache.org,41413,1694818872288)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202309151a0c420cf90a4ccfa17f8377f13d274e to hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b202309151a0c420cf90a4ccfa17f8377f13d274e 2023-09-15 23:02:40,552 INFO [rs(jenkins-hbase4.apache.org,34705,1694818872254)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=199, hasBloomFilter=true, into tmp file hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/default/testtb-testEmptyExportFileSystemState/2407fc8de1924ce04e963b0ea0c2b4da/.tmp/cf/9c9eb83a275f4a11a1170d1c4d17c12c 2023-09-15 23:02:40,552 INFO [rs(jenkins-hbase4.apache.org,41413,1694818872288)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/default/testtb-testEmptyExportFileSystemState/f676f9b73608fabf2316bb32fb4bee0a/.tmp/cf/9080e460312f4946bc9754c8e7c39526 2023-09-15 23:02:40,557 DEBUG [rs(jenkins-hbase4.apache.org,34705,1694818872254)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/default/testtb-testEmptyExportFileSystemState/2407fc8de1924ce04e963b0ea0c2b4da/.tmp/cf/9c9eb83a275f4a11a1170d1c4d17c12c as hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/default/testtb-testEmptyExportFileSystemState/2407fc8de1924ce04e963b0ea0c2b4da/cf/9c9eb83a275f4a11a1170d1c4d17c12c 2023-09-15 23:02:40,557 DEBUG [rs(jenkins-hbase4.apache.org,41413,1694818872288)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/default/testtb-testEmptyExportFileSystemState/f676f9b73608fabf2316bb32fb4bee0a/.tmp/cf/9080e460312f4946bc9754c8e7c39526 as hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/default/testtb-testEmptyExportFileSystemState/f676f9b73608fabf2316bb32fb4bee0a/cf/9080e460312f4946bc9754c8e7c39526 2023-09-15 23:02:40,563 INFO [rs(jenkins-hbase4.apache.org,34705,1694818872254)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/default/testtb-testEmptyExportFileSystemState/2407fc8de1924ce04e963b0ea0c2b4da/cf/9c9eb83a275f4a11a1170d1c4d17c12c, entries=3, sequenceid=6, filesize=5.4 K 2023-09-15 23:02:40,563 INFO [rs(jenkins-hbase4.apache.org,41413,1694818872288)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/default/testtb-testEmptyExportFileSystemState/f676f9b73608fabf2316bb32fb4bee0a/cf/9080e460312f4946bc9754c8e7c39526, entries=47, sequenceid=6, filesize=13.1 K 2023-09-15 23:02:40,564 INFO [rs(jenkins-hbase4.apache.org,34705,1694818872254)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for 2407fc8de1924ce04e963b0ea0c2b4da in 44ms, sequenceid=6, compaction requested=false 2023-09-15 23:02:40,564 INFO [rs(jenkins-hbase4.apache.org,41413,1694818872288)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for f676f9b73608fabf2316bb32fb4bee0a in 44ms, sequenceid=6, compaction requested=false 2023-09-15 23:02:40,564 DEBUG [rs(jenkins-hbase4.apache.org,34705,1694818872254)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testEmptyExportFileSystemState' 2023-09-15 23:02:40,564 DEBUG [rs(jenkins-hbase4.apache.org,41413,1694818872288)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testEmptyExportFileSystemState' 2023-09-15 23:02:40,567 DEBUG [rs(jenkins-hbase4.apache.org,34705,1694818872254)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 2407fc8de1924ce04e963b0ea0c2b4da: 2023-09-15 23:02:40,567 DEBUG [rs(jenkins-hbase4.apache.org,41413,1694818872288)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for f676f9b73608fabf2316bb32fb4bee0a: 2023-09-15 23:02:40,567 DEBUG [rs(jenkins-hbase4.apache.org,34705,1694818872254)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1694818959474.2407fc8de1924ce04e963b0ea0c2b4da.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-09-15 23:02:40,567 DEBUG [rs(jenkins-hbase4.apache.org,34705,1694818872254)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-15 23:02:40,567 DEBUG [rs(jenkins-hbase4.apache.org,41413,1694818872288)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1694818959474.f676f9b73608fabf2316bb32fb4bee0a.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-09-15 23:02:40,567 DEBUG [rs(jenkins-hbase4.apache.org,34705,1694818872254)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/default/testtb-testEmptyExportFileSystemState/2407fc8de1924ce04e963b0ea0c2b4da/cf/9c9eb83a275f4a11a1170d1c4d17c12c] hfiles 2023-09-15 23:02:40,567 DEBUG [rs(jenkins-hbase4.apache.org,34705,1694818872254)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/default/testtb-testEmptyExportFileSystemState/2407fc8de1924ce04e963b0ea0c2b4da/cf/9c9eb83a275f4a11a1170d1c4d17c12c for snapshot=snaptb0-testEmptyExportFileSystemState 2023-09-15 23:02:40,568 DEBUG [rs(jenkins-hbase4.apache.org,41413,1694818872288)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-15 23:02:40,568 DEBUG [rs(jenkins-hbase4.apache.org,41413,1694818872288)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/default/testtb-testEmptyExportFileSystemState/f676f9b73608fabf2316bb32fb4bee0a/cf/9080e460312f4946bc9754c8e7c39526] hfiles 2023-09-15 23:02:40,568 DEBUG [rs(jenkins-hbase4.apache.org,41413,1694818872288)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/default/testtb-testEmptyExportFileSystemState/f676f9b73608fabf2316bb32fb4bee0a/cf/9080e460312f4946bc9754c8e7c39526 for snapshot=snaptb0-testEmptyExportFileSystemState 2023-09-15 23:02:40,579 DEBUG [Listener at jenkins-hbase4.apache.org/46629] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-15 23:02:40,583 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-15 23:02:40,584 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-09-15 23:02:40,584 DEBUG [Listener at jenkins-hbase4.apache.org/46629] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-15 23:02:40,586 DEBUG [rs(jenkins-hbase4.apache.org,34705,1694818872254)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1694818959474.2407fc8de1924ce04e963b0ea0c2b4da. completed. 2023-09-15 23:02:40,586 DEBUG [rs(jenkins-hbase4.apache.org,34705,1694818872254)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1694818959474.2407fc8de1924ce04e963b0ea0c2b4da. 2023-09-15 23:02:40,586 DEBUG [rs(jenkins-hbase4.apache.org,41413,1694818872288)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1694818959474.f676f9b73608fabf2316bb32fb4bee0a. completed. 2023-09-15 23:02:40,586 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-15 23:02:40,586 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-15 23:02:40,586 DEBUG [rs(jenkins-hbase4.apache.org,41413,1694818872288)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1694818959474.f676f9b73608fabf2316bb32fb4bee0a. 2023-09-15 23:02:40,586 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:02:40,586 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-15 23:02:40,586 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-09-15 23:02:40,586 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,34705,1694818872254' in zk 2023-09-15 23:02:40,586 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-15 23:02:40,586 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:02:40,586 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-09-15 23:02:40,586 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,41413,1694818872288' in zk 2023-09-15 23:02:40,588 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:02:40,588 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-15 23:02:40,588 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-15 23:02:40,588 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-15 23:02:40,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:02:40,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-15 23:02:40,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-15 23:02:40,588 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:02:40,588 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-09-15 23:02:40,588 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-15 23:02:40,589 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-09-15 23:02:40,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-15 23:02:40,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-15 23:02:40,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-15 23:02:40,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:02:40,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:02:40,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33655,1694818872204 2023-09-15 23:02:40,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-15 23:02:40,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-15 23:02:40,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:02:40,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:02:40,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33655,1694818872204 2023-09-15 23:02:40,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,34705,1694818872254': 2023-09-15 23:02:40,592 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34705,1694818872254' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-09-15 23:02:40,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:02:40,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-15 23:02:40,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-15 23:02:40,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-15 23:02:40,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-15 23:02:40,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-15 23:02:40,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:02:40,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:02:40,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33655,1694818872204 2023-09-15 23:02:40,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-15 23:02:40,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-15 23:02:40,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:02:40,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:02:40,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33655,1694818872204 2023-09-15 23:02:40,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,41413,1694818872288': 2023-09-15 23:02:40,595 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41413,1694818872288' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-09-15 23:02:40,595 INFO [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testEmptyExportFileSystemState' execution completed 2023-09-15 23:02:40,595 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-15 23:02:40,595 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-15 23:02:40,595 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testEmptyExportFileSystemState 2023-09-15 23:02:40,595 INFO [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-15 23:02:40,598 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:33655-0x100b1d2daa90001, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-15 23:02:40,598 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:34705-0x100b1d2daa90002, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-15 23:02:40,598 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-15 23:02:40,598 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-15 23:02:40,598 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:34705-0x100b1d2daa90002, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 23:02:40,598 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:33655-0x100b1d2daa90001, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 23:02:40,598 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:41413-0x100b1d2daa90003, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-15 23:02:40,598 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-15 23:02:40,598 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-15 23:02:40,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-15 23:02:40,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-15 23:02:40,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-15 23:02:40,598 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:02:40,598 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:41413-0x100b1d2daa90003, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 23:02:40,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-15 23:02:40,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-15 23:02:40,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-15 23:02:40,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-15 23:02:40,599 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:02:40,599 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 23:02:40,599 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 23:02:40,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 23:02:40,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-15 23:02:40,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 23:02:40,599 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 23:02:40,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 23:02:40,599 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33655,1694818872204 2023-09-15 23:02:40,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-15 23:02:40,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-15 23:02:40,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-15 23:02:40,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-15 23:02:40,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-15 23:02:40,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:02:40,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:02:40,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33655,1694818872204 2023-09-15 23:02:40,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-15 23:02:40,601 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:02:40,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-15 23:02:40,601 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:02:40,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:02:40,601 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33655,1694818872204 2023-09-15 23:02:40,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:02:40,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33655,1694818872204 2023-09-15 23:02:40,604 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33655,1694818872204 2023-09-15 23:02:40,604 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-15 23:02:40,604 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:02:40,604 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:33655-0x100b1d2daa90001, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 23:02:40,604 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:34705-0x100b1d2daa90002, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 23:02:40,604 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:41413-0x100b1d2daa90003, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 23:02:40,604 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 23:02:40,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 23:02:40,604 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:02:40,604 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 23:02:40,604 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:41413-0x100b1d2daa90003, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 23:02:40,604 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testEmptyExportFileSystemState 2023-09-15 23:02:40,604 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:34705-0x100b1d2daa90002, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 23:02:40,604 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-15 23:02:40,604 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 23:02:40,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 23:02:40,604 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 23:02:40,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 23:02:40,604 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:33655-0x100b1d2daa90001, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 23:02:40,604 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-09-15 23:02:40,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 23:02:40,604 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-15 23:02:40,605 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-09-15 23:02:40,606 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33655,1694818872204 2023-09-15 23:02:40,606 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-15 23:02:40,606 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-15 23:02:40,606 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 23:02:40,606 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 23:02:40,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 23:02:40,606 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:02:40,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 23:02:40,606 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:02:40,606 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-15 23:02:40,606 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-15 23:02:40,606 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b202309151a0c420cf90a4ccfa17f8377f13d274e, hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230915310d6c0d8eaa439b8706292d1172aee3] mob files 2023-09-15 23:02:40,606 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b202309151a0c420cf90a4ccfa17f8377f13d274e 2023-09-15 23:02:40,606 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230915310d6c0d8eaa439b8706292d1172aee3 2023-09-15 23:02:40,612 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testEmptyExportFileSystemState 2023-09-15 23:02:40,613 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-09-15 23:02:40,627 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState to hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.hbase-snapshot/snaptb0-testEmptyExportFileSystemState 2023-09-15 23:02:40,628 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-09-15 23:02:40,628 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-09-15 23:02:40,628 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-09-15 23:02:40,628 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1694818960478Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1694818960612 (+134 ms)Consolidate snapshot: snaptb0-testEmptyExportFileSystemState at 1694818960612Loading Region manifests for snaptb0-testEmptyExportFileSystemState at 1694818960612Writing data manifest for snaptb0-testEmptyExportFileSystemState at 1694818960615 (+3 ms)Verifying snapshot: snaptb0-testEmptyExportFileSystemState at 1694818960622 (+7 ms)Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1694818960628 (+6 ms) 2023-09-15 23:02:40,631 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=98, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-15 23:02:40,632 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=98, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 152 msec 2023-09-15 23:02:40,784 DEBUG [Listener at jenkins-hbase4.apache.org/46629] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-15 23:02:40,785 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-15 23:02:40,785 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-15 23:02:40,785 INFO [Listener at jenkins-hbase4.apache.org/46629] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/export-test/export-1694818960785 2023-09-15 23:02:40,785 INFO [Listener at jenkins-hbase4.apache.org/46629] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:44545, tgtDir=hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/export-test/export-1694818960785, rawTgtDir=hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/export-test/export-1694818960785, srcFsUri=hdfs://localhost:44545, srcDir=hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64 2023-09-15 23:02:40,807 DEBUG [Listener at jenkins-hbase4.apache.org/46629] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:44545, inputRoot=hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64 2023-09-15 23:02:40,807 DEBUG [Listener at jenkins-hbase4.apache.org/46629] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-81469762_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/export-test/export-1694818960785, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/export-test/export-1694818960785/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-09-15 23:02:40,808 INFO [Listener at jenkins-hbase4.apache.org/46629] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:44545, inputRoot=hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64, snapshotDir=hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState. 2023-09-15 23:02:40,812 INFO [Listener at jenkins-hbase4.apache.org/46629] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/export-test/export-1694818960785/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-09-15 23:02:40,827 DEBUG [Listener at jenkins-hbase4.apache.org/46629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-15 23:02:40,827 DEBUG [Listener at jenkins-hbase4.apache.org/46629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-15 23:02:40,828 DEBUG [Listener at jenkins-hbase4.apache.org/46629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-15 23:02:40,828 DEBUG [Listener at jenkins-hbase4.apache.org/46629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-15 23:02:41,692 DEBUG [Listener at jenkins-hbase4.apache.org/46629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c5e9ebbf-ce0f-c6b3-3dce-6299f7b47f51/hadoop-5617081625432268570.jar 2023-09-15 23:02:41,693 DEBUG [Listener at jenkins-hbase4.apache.org/46629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-15 23:02:41,693 DEBUG [Listener at jenkins-hbase4.apache.org/46629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-15 23:02:41,759 DEBUG [Listener at jenkins-hbase4.apache.org/46629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c5e9ebbf-ce0f-c6b3-3dce-6299f7b47f51/hadoop-8255585273396045513.jar 2023-09-15 23:02:41,759 DEBUG [Listener at jenkins-hbase4.apache.org/46629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-15 23:02:41,760 DEBUG [Listener at jenkins-hbase4.apache.org/46629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-15 23:02:41,760 DEBUG [Listener at jenkins-hbase4.apache.org/46629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-15 23:02:41,760 DEBUG [Listener at jenkins-hbase4.apache.org/46629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-15 23:02:41,761 DEBUG [Listener at jenkins-hbase4.apache.org/46629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-15 23:02:41,761 DEBUG [Listener at jenkins-hbase4.apache.org/46629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-15 23:02:41,761 DEBUG [Listener at jenkins-hbase4.apache.org/46629] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-15 23:02:41,762 DEBUG [Listener at jenkins-hbase4.apache.org/46629] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-15 23:02:41,762 DEBUG [Listener at jenkins-hbase4.apache.org/46629] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-15 23:02:41,762 DEBUG [Listener at jenkins-hbase4.apache.org/46629] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-15 23:02:41,763 DEBUG [Listener at jenkins-hbase4.apache.org/46629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-15 23:02:41,763 DEBUG [Listener at jenkins-hbase4.apache.org/46629] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-15 23:02:41,763 DEBUG [Listener at jenkins-hbase4.apache.org/46629] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-15 23:02:41,764 DEBUG [Listener at jenkins-hbase4.apache.org/46629] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-15 23:02:41,764 DEBUG [Listener at jenkins-hbase4.apache.org/46629] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-15 23:02:41,764 DEBUG [Listener at jenkins-hbase4.apache.org/46629] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-15 23:02:41,765 DEBUG [Listener at jenkins-hbase4.apache.org/46629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-15 23:02:41,765 DEBUG [Listener at jenkins-hbase4.apache.org/46629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-15 23:02:41,766 DEBUG [Listener at jenkins-hbase4.apache.org/46629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-15 23:02:41,766 DEBUG [Listener at jenkins-hbase4.apache.org/46629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-15 23:02:41,766 DEBUG [Listener at jenkins-hbase4.apache.org/46629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-15 23:02:41,767 DEBUG [Listener at jenkins-hbase4.apache.org/46629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-15 23:02:41,767 DEBUG [Listener at jenkins-hbase4.apache.org/46629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-15 23:02:42,108 WARN [Listener at jenkins-hbase4.apache.org/46629] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-15 23:02:42,109 INFO [Listener at jenkins-hbase4.apache.org/46629] snapshot.ExportSnapshot(578): Loading Snapshot 'emptySnaptb0-testEmptyExportFileSystemState' hfile list 2023-09-15 23:02:43,467 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-15 23:02:43,467 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-15 23:02:43,469 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694818878578_0005_000001 (auth:SIMPLE) 2023-09-15 23:02:44,269 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694818878578_0006_000001 (auth:SIMPLE) 2023-09-15 23:02:44,324 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-15 23:02:48,027 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694818878578_0006_000001 (auth:SIMPLE) 2023-09-15 23:02:50,447 INFO [Listener at jenkins-hbase4.apache.org/46629] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-15 23:02:50,448 INFO [Listener at jenkins-hbase4.apache.org/46629] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-15 23:02:50,453 INFO [Listener at jenkins-hbase4.apache.org/46629] snapshot.ExportSnapshot(1127): Export Completed: emptySnaptb0-testEmptyExportFileSystemState 2023-09-15 23:02:50,453 INFO [Listener at jenkins-hbase4.apache.org/46629] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-15 23:02:50,453 INFO [Listener at jenkins-hbase4.apache.org/46629] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-15 23:02:50,454 DEBUG [Listener at jenkins-hbase4.apache.org/46629] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1896422628_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-09-15 23:02:50,454 DEBUG [Listener at jenkins-hbase4.apache.org/46629] snapshot.TestExportSnapshot(367): hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-09-15 23:02:50,454 DEBUG [Listener at jenkins-hbase4.apache.org/46629] snapshot.TestExportSnapshot(367): hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-09-15 23:02:50,454 DEBUG [Listener at jenkins-hbase4.apache.org/46629] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1896422628_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/export-test/export-1694818960785/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/export-test/export-1694818960785/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-09-15 23:02:50,454 DEBUG [Listener at jenkins-hbase4.apache.org/46629] snapshot.TestExportSnapshot(367): hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/export-test/export-1694818960785/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-09-15 23:02:50,454 DEBUG [Listener at jenkins-hbase4.apache.org/46629] snapshot.TestExportSnapshot(367): hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/export-test/export-1694818960785/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-09-15 23:02:50,458 INFO [Listener at jenkins-hbase4.apache.org/46629] client.HBaseAdmin$15(890): Started disable of testtb-testEmptyExportFileSystemState 2023-09-15 23:02:50,459 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testEmptyExportFileSystemState 2023-09-15 23:02:50,459 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] procedure2.ProcedureExecutor(1028): Stored pid=99, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-15 23:02:50,462 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-09-15 23:02:50,463 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694818970462"}]},"ts":"1694818970462"} 2023-09-15 23:02:50,464 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLING in hbase:meta 2023-09-15 23:02:50,465 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testEmptyExportFileSystemState to state=DISABLING 2023-09-15 23:02:50,466 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=2407fc8de1924ce04e963b0ea0c2b4da, UNASSIGN}, {pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=f676f9b73608fabf2316bb32fb4bee0a, UNASSIGN}] 2023-09-15 23:02:50,468 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=2407fc8de1924ce04e963b0ea0c2b4da, UNASSIGN 2023-09-15 23:02:50,468 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=f676f9b73608fabf2316bb32fb4bee0a, UNASSIGN 2023-09-15 23:02:50,468 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=2407fc8de1924ce04e963b0ea0c2b4da, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:02:50,468 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=f676f9b73608fabf2316bb32fb4bee0a, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:02:50,468 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1694818959474.2407fc8de1924ce04e963b0ea0c2b4da.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1694818970468"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694818970468"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694818970468"}]},"ts":"1694818970468"} 2023-09-15 23:02:50,468 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1694818959474.f676f9b73608fabf2316bb32fb4bee0a.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1694818970468"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694818970468"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694818970468"}]},"ts":"1694818970468"} 2023-09-15 23:02:50,470 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=102, ppid=100, state=RUNNABLE; CloseRegionProcedure 2407fc8de1924ce04e963b0ea0c2b4da, server=jenkins-hbase4.apache.org,34705,1694818872254}] 2023-09-15 23:02:50,470 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=103, ppid=101, state=RUNNABLE; CloseRegionProcedure f676f9b73608fabf2316bb32fb4bee0a, server=jenkins-hbase4.apache.org,41413,1694818872288}] 2023-09-15 23:02:50,563 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-09-15 23:02:50,621 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 2407fc8de1924ce04e963b0ea0c2b4da 2023-09-15 23:02:50,621 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close f676f9b73608fabf2316bb32fb4bee0a 2023-09-15 23:02:50,622 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 2407fc8de1924ce04e963b0ea0c2b4da, disabling compactions & flushes 2023-09-15 23:02:50,622 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing f676f9b73608fabf2316bb32fb4bee0a, disabling compactions & flushes 2023-09-15 23:02:50,622 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1694818959474.2407fc8de1924ce04e963b0ea0c2b4da. 2023-09-15 23:02:50,622 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1694818959474.f676f9b73608fabf2316bb32fb4bee0a. 2023-09-15 23:02:50,622 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1694818959474.f676f9b73608fabf2316bb32fb4bee0a. 2023-09-15 23:02:50,622 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1694818959474.2407fc8de1924ce04e963b0ea0c2b4da. 2023-09-15 23:02:50,622 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1694818959474.f676f9b73608fabf2316bb32fb4bee0a. after waiting 0 ms 2023-09-15 23:02:50,622 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1694818959474.f676f9b73608fabf2316bb32fb4bee0a. 2023-09-15 23:02:50,622 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1694818959474.2407fc8de1924ce04e963b0ea0c2b4da. after waiting 0 ms 2023-09-15 23:02:50,622 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1694818959474.2407fc8de1924ce04e963b0ea0c2b4da. 2023-09-15 23:02:50,630 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/default/testtb-testEmptyExportFileSystemState/f676f9b73608fabf2316bb32fb4bee0a/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-15 23:02:50,630 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/default/testtb-testEmptyExportFileSystemState/2407fc8de1924ce04e963b0ea0c2b4da/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-15 23:02:50,630 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-15 23:02:50,631 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1694818959474.f676f9b73608fabf2316bb32fb4bee0a. 2023-09-15 23:02:50,631 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for f676f9b73608fabf2316bb32fb4bee0a: 2023-09-15 23:02:50,632 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-15 23:02:50,632 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1694818959474.2407fc8de1924ce04e963b0ea0c2b4da. 2023-09-15 23:02:50,632 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 2407fc8de1924ce04e963b0ea0c2b4da: 2023-09-15 23:02:50,633 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed f676f9b73608fabf2316bb32fb4bee0a 2023-09-15 23:02:50,634 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=f676f9b73608fabf2316bb32fb4bee0a, regionState=CLOSED 2023-09-15 23:02:50,634 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 2407fc8de1924ce04e963b0ea0c2b4da 2023-09-15 23:02:50,634 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1694818959474.f676f9b73608fabf2316bb32fb4bee0a.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1694818970634"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694818970634"}]},"ts":"1694818970634"} 2023-09-15 23:02:50,634 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=2407fc8de1924ce04e963b0ea0c2b4da, regionState=CLOSED 2023-09-15 23:02:50,634 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1694818959474.2407fc8de1924ce04e963b0ea0c2b4da.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1694818970634"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694818970634"}]},"ts":"1694818970634"} 2023-09-15 23:02:50,637 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=103, resume processing ppid=101 2023-09-15 23:02:50,637 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=103, ppid=101, state=SUCCESS; CloseRegionProcedure f676f9b73608fabf2316bb32fb4bee0a, server=jenkins-hbase4.apache.org,41413,1694818872288 in 165 msec 2023-09-15 23:02:50,637 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=102, resume processing ppid=100 2023-09-15 23:02:50,637 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=102, ppid=100, state=SUCCESS; CloseRegionProcedure 2407fc8de1924ce04e963b0ea0c2b4da, server=jenkins-hbase4.apache.org,34705,1694818872254 in 166 msec 2023-09-15 23:02:50,638 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=101, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=f676f9b73608fabf2316bb32fb4bee0a, UNASSIGN in 171 msec 2023-09-15 23:02:50,639 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=100, resume processing ppid=99 2023-09-15 23:02:50,639 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=100, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=2407fc8de1924ce04e963b0ea0c2b4da, UNASSIGN in 171 msec 2023-09-15 23:02:50,639 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694818970639"}]},"ts":"1694818970639"} 2023-09-15 23:02:50,640 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLED in hbase:meta 2023-09-15 23:02:50,641 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testEmptyExportFileSystemState to state=DISABLED 2023-09-15 23:02:50,643 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=99, state=SUCCESS; DisableTableProcedure table=testtb-testEmptyExportFileSystemState in 183 msec 2023-09-15 23:02:50,764 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-09-15 23:02:50,765 INFO [Listener at jenkins-hbase4.apache.org/46629] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 99 completed 2023-09-15 23:02:50,765 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testEmptyExportFileSystemState 2023-09-15 23:02:50,766 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] procedure2.ProcedureExecutor(1028): Stored pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-15 23:02:50,768 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-15 23:02:50,769 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] access.PermissionStorage(259): Removing permissions of removed table testtb-testEmptyExportFileSystemState 2023-09-15 23:02:50,769 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=104, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-15 23:02:50,770 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41413] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testEmptyExportFileSystemState 2023-09-15 23:02:50,773 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.tmp/data/default/testtb-testEmptyExportFileSystemState/2407fc8de1924ce04e963b0ea0c2b4da 2023-09-15 23:02:50,773 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.tmp/data/default/testtb-testEmptyExportFileSystemState/f676f9b73608fabf2316bb32fb4bee0a 2023-09-15 23:02:50,774 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-15 23:02:50,774 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:33655-0x100b1d2daa90001, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-15 23:02:50,774 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:34705-0x100b1d2daa90002, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-15 23:02:50,774 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:41413-0x100b1d2daa90003, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-15 23:02:50,775 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-09-15 23:02:50,775 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-09-15 23:02:50,775 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-09-15 23:02:50,775 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.tmp/data/default/testtb-testEmptyExportFileSystemState/f676f9b73608fabf2316bb32fb4bee0a/cf, FileablePath, hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.tmp/data/default/testtb-testEmptyExportFileSystemState/f676f9b73608fabf2316bb32fb4bee0a/recovered.edits] 2023-09-15 23:02:50,775 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-09-15 23:02:50,775 DEBUG [HFileArchiver-18] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.tmp/data/default/testtb-testEmptyExportFileSystemState/2407fc8de1924ce04e963b0ea0c2b4da/cf, FileablePath, hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.tmp/data/default/testtb-testEmptyExportFileSystemState/2407fc8de1924ce04e963b0ea0c2b4da/recovered.edits] 2023-09-15 23:02:50,776 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:41413-0x100b1d2daa90003, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-15 23:02:50,776 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-15 23:02:50,776 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:34705-0x100b1d2daa90002, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-15 23:02:50,776 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:33655-0x100b1d2daa90001, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-15 23:02:50,776 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:34705-0x100b1d2daa90002, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-15 23:02:50,776 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-15 23:02:50,776 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:41413-0x100b1d2daa90003, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-15 23:02:50,776 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:33655-0x100b1d2daa90001, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-15 23:02:50,777 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-09-15 23:02:50,779 DEBUG [HFileArchiver-18] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.tmp/data/default/testtb-testEmptyExportFileSystemState/2407fc8de1924ce04e963b0ea0c2b4da/cf/9c9eb83a275f4a11a1170d1c4d17c12c to hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/archive/data/default/testtb-testEmptyExportFileSystemState/2407fc8de1924ce04e963b0ea0c2b4da/cf/9c9eb83a275f4a11a1170d1c4d17c12c 2023-09-15 23:02:50,779 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.tmp/data/default/testtb-testEmptyExportFileSystemState/f676f9b73608fabf2316bb32fb4bee0a/cf/9080e460312f4946bc9754c8e7c39526 to hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/archive/data/default/testtb-testEmptyExportFileSystemState/f676f9b73608fabf2316bb32fb4bee0a/cf/9080e460312f4946bc9754c8e7c39526 2023-09-15 23:02:50,782 DEBUG [HFileArchiver-18] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.tmp/data/default/testtb-testEmptyExportFileSystemState/2407fc8de1924ce04e963b0ea0c2b4da/recovered.edits/9.seqid to hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/archive/data/default/testtb-testEmptyExportFileSystemState/2407fc8de1924ce04e963b0ea0c2b4da/recovered.edits/9.seqid 2023-09-15 23:02:50,782 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.tmp/data/default/testtb-testEmptyExportFileSystemState/f676f9b73608fabf2316bb32fb4bee0a/recovered.edits/9.seqid to hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/archive/data/default/testtb-testEmptyExportFileSystemState/f676f9b73608fabf2316bb32fb4bee0a/recovered.edits/9.seqid 2023-09-15 23:02:50,783 DEBUG [HFileArchiver-18] backup.HFileArchiver(596): Deleted hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.tmp/data/default/testtb-testEmptyExportFileSystemState/2407fc8de1924ce04e963b0ea0c2b4da 2023-09-15 23:02:50,783 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.tmp/data/default/testtb-testEmptyExportFileSystemState/f676f9b73608fabf2316bb32fb4bee0a 2023-09-15 23:02:50,783 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-09-15 23:02:50,783 DEBUG [PEWorker-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-09-15 23:02:50,784 DEBUG [PEWorker-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf] 2023-09-15 23:02:50,787 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b202309151a0c420cf90a4ccfa17f8377f13d274e to hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b202309151a0c420cf90a4ccfa17f8377f13d274e 2023-09-15 23:02:50,788 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230915310d6c0d8eaa439b8706292d1172aee3 to hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230915310d6c0d8eaa439b8706292d1172aee3 2023-09-15 23:02:50,788 DEBUG [PEWorker-2] backup.HFileArchiver(596): Deleted hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-09-15 23:02:50,791 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=104, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-15 23:02:50,792 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testEmptyExportFileSystemState from hbase:meta 2023-09-15 23:02:50,794 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testEmptyExportFileSystemState' descriptor. 2023-09-15 23:02:50,795 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=104, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-15 23:02:50,795 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testEmptyExportFileSystemState' from region states. 2023-09-15 23:02:50,795 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,,1694818959474.2407fc8de1924ce04e963b0ea0c2b4da.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1694818970795"}]},"ts":"9223372036854775807"} 2023-09-15 23:02:50,795 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,1,1694818959474.f676f9b73608fabf2316bb32fb4bee0a.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1694818970795"}]},"ts":"9223372036854775807"} 2023-09-15 23:02:50,797 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-15 23:02:50,797 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 2407fc8de1924ce04e963b0ea0c2b4da, NAME => 'testtb-testEmptyExportFileSystemState,,1694818959474.2407fc8de1924ce04e963b0ea0c2b4da.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => f676f9b73608fabf2316bb32fb4bee0a, NAME => 'testtb-testEmptyExportFileSystemState,1,1694818959474.f676f9b73608fabf2316bb32fb4bee0a.', STARTKEY => '1', ENDKEY => ''}] 2023-09-15 23:02:50,797 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testEmptyExportFileSystemState' as deleted. 2023-09-15 23:02:50,797 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1694818970797"}]},"ts":"9223372036854775807"} 2023-09-15 23:02:50,798 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testEmptyExportFileSystemState state from META 2023-09-15 23:02:50,800 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=104, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-15 23:02:50,800 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=104, state=SUCCESS; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState in 34 msec 2023-09-15 23:02:50,878 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-09-15 23:02:50,878 INFO [Listener at jenkins-hbase4.apache.org/46629] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 104 completed 2023-09-15 23:02:50,889 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testEmptyExportFileSystemState" 2023-09-15 23:02:50,891 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testEmptyExportFileSystemState 2023-09-15 23:02:50,892 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testEmptyExportFileSystemState" 2023-09-15 23:02:50,894 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testEmptyExportFileSystemState 2023-09-15 23:02:50,916 INFO [Listener at jenkins-hbase4.apache.org/46629] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=767 (was 760) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1896422628_17 at /127.0.0.1:50784 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1629749639) connection to jenkins-hbase4.apache.org/172.31.14.131:36935 from appattempt_1694818878578_0006_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x78d29e78-shared-pool-36 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x78d29e78-shared-pool-34 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1896422628_17 at /127.0.0.1:52828 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-88793059_1 at /127.0.0.1:57816 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1896422628_17 at /127.0.0.1:57872 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-4725 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: IPC Client (1629749639) connection to jenkins-hbase4.apache.org/172.31.14.131:33967 from appattempt_1694818878578_0005_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: IPC Client (1629749639) connection to jenkins-hbase4.apache.org/172.31.14.131:39279 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x78d29e78-shared-pool-35 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x78d29e78-shared-pool-33 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-88793059_1 at /127.0.0.1:52808 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=928 (was 914) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=196 (was 196), ProcessCount=166 (was 166), AvailableMemoryMB=4925 (was 5007) 2023-09-15 23:02:50,916 WARN [Listener at jenkins-hbase4.apache.org/46629] hbase.ResourceChecker(130): Thread=767 is superior to 500 2023-09-15 23:02:50,936 INFO [Listener at jenkins-hbase4.apache.org/46629] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=767, OpenFileDescriptor=928, MaxFileDescriptor=60000, SystemLoadAverage=196, ProcessCount=166, AvailableMemoryMB=4924 2023-09-15 23:02:50,936 WARN [Listener at jenkins-hbase4.apache.org/46629] hbase.ResourceChecker(130): Thread=767 is superior to 500 2023-09-15 23:02:50,938 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-15 23:02:50,939 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] procedure2.ProcedureExecutor(1028): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-15 23:02:50,940 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_PRE_OPERATION 2023-09-15 23:02:50,941 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithSkipTmp" procId is: 105 2023-09-15 23:02:50,941 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-15 23:02:50,941 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-09-15 23:02:50,943 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/5b6923290cc0dbe584c094916ff81886 2023-09-15 23:02:50,943 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/d822a57dcbc31b3d0545cf66f9deb083 2023-09-15 23:02:50,944 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/d822a57dcbc31b3d0545cf66f9deb083 empty. 2023-09-15 23:02:50,944 DEBUG [HFileArchiver-20] backup.HFileArchiver(153): Directory hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/5b6923290cc0dbe584c094916ff81886 empty. 2023-09-15 23:02:50,944 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/d822a57dcbc31b3d0545cf66f9deb083 2023-09-15 23:02:50,945 DEBUG [HFileArchiver-20] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/5b6923290cc0dbe584c094916ff81886 2023-09-15 23:02:50,945 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-09-15 23:02:50,954 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/.tabledesc/.tableinfo.0000000001 2023-09-15 23:02:50,956 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(7675): creating {ENCODED => 5b6923290cc0dbe584c094916ff81886, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1694818970938.5b6923290cc0dbe584c094916ff81886.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.tmp 2023-09-15 23:02:50,956 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(7675): creating {ENCODED => d822a57dcbc31b3d0545cf66f9deb083, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1694818970938.d822a57dcbc31b3d0545cf66f9deb083.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.tmp 2023-09-15 23:02:50,965 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1694818970938.5b6923290cc0dbe584c094916ff81886.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-15 23:02:50,965 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1694818970938.d822a57dcbc31b3d0545cf66f9deb083.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-15 23:02:50,966 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1604): Closing 5b6923290cc0dbe584c094916ff81886, disabling compactions & flushes 2023-09-15 23:02:50,966 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1694818970938.5b6923290cc0dbe584c094916ff81886. 2023-09-15 23:02:50,966 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1604): Closing d822a57dcbc31b3d0545cf66f9deb083, disabling compactions & flushes 2023-09-15 23:02:50,966 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1694818970938.5b6923290cc0dbe584c094916ff81886. 2023-09-15 23:02:50,966 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1694818970938.d822a57dcbc31b3d0545cf66f9deb083. 2023-09-15 23:02:50,966 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1694818970938.d822a57dcbc31b3d0545cf66f9deb083. 2023-09-15 23:02:50,966 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1694818970938.5b6923290cc0dbe584c094916ff81886. after waiting 0 ms 2023-09-15 23:02:50,966 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1694818970938.5b6923290cc0dbe584c094916ff81886. 2023-09-15 23:02:50,966 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1694818970938.d822a57dcbc31b3d0545cf66f9deb083. after waiting 0 ms 2023-09-15 23:02:50,966 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1694818970938.d822a57dcbc31b3d0545cf66f9deb083. 2023-09-15 23:02:50,966 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1694818970938.5b6923290cc0dbe584c094916ff81886. 2023-09-15 23:02:50,966 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1694818970938.d822a57dcbc31b3d0545cf66f9deb083. 2023-09-15 23:02:50,966 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1558): Region close journal for 5b6923290cc0dbe584c094916ff81886: 2023-09-15 23:02:50,966 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1558): Region close journal for d822a57dcbc31b3d0545cf66f9deb083: 2023-09-15 23:02:50,968 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ADD_TO_META 2023-09-15 23:02:50,969 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1694818970938.5b6923290cc0dbe584c094916ff81886.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1694818970969"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694818970969"}]},"ts":"1694818970969"} 2023-09-15 23:02:50,969 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1694818970938.d822a57dcbc31b3d0545cf66f9deb083.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1694818970969"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694818970969"}]},"ts":"1694818970969"} 2023-09-15 23:02:50,970 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-15 23:02:50,971 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-15 23:02:50,971 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694818970971"}]},"ts":"1694818970971"} 2023-09-15 23:02:50,972 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLING in hbase:meta 2023-09-15 23:02:50,977 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-15 23:02:50,978 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-15 23:02:50,978 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-15 23:02:50,978 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-15 23:02:50,978 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-15 23:02:50,978 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=5b6923290cc0dbe584c094916ff81886, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=d822a57dcbc31b3d0545cf66f9deb083, ASSIGN}] 2023-09-15 23:02:50,980 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=d822a57dcbc31b3d0545cf66f9deb083, ASSIGN 2023-09-15 23:02:50,980 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=5b6923290cc0dbe584c094916ff81886, ASSIGN 2023-09-15 23:02:50,981 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=d822a57dcbc31b3d0545cf66f9deb083, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33655,1694818872204; forceNewPlan=false, retain=false 2023-09-15 23:02:50,981 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=5b6923290cc0dbe584c094916ff81886, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41413,1694818872288; forceNewPlan=false, retain=false 2023-09-15 23:02:51,042 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-09-15 23:02:51,131 INFO [jenkins-hbase4:44427] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-15 23:02:51,134 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=5b6923290cc0dbe584c094916ff81886, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:02:51,134 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=d822a57dcbc31b3d0545cf66f9deb083, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33655,1694818872204 2023-09-15 23:02:51,134 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1694818970938.5b6923290cc0dbe584c094916ff81886.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1694818971133"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694818971133"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694818971133"}]},"ts":"1694818971133"} 2023-09-15 23:02:51,134 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1694818970938.d822a57dcbc31b3d0545cf66f9deb083.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1694818971133"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694818971133"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694818971133"}]},"ts":"1694818971133"} 2023-09-15 23:02:51,135 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=108, ppid=106, state=RUNNABLE; OpenRegionProcedure 5b6923290cc0dbe584c094916ff81886, server=jenkins-hbase4.apache.org,41413,1694818872288}] 2023-09-15 23:02:51,136 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=109, ppid=107, state=RUNNABLE; OpenRegionProcedure d822a57dcbc31b3d0545cf66f9deb083, server=jenkins-hbase4.apache.org,33655,1694818872204}] 2023-09-15 23:02:51,244 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-09-15 23:02:51,291 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,1,1694818970938.d822a57dcbc31b3d0545cf66f9deb083. 2023-09-15 23:02:51,291 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,,1694818970938.5b6923290cc0dbe584c094916ff81886. 2023-09-15 23:02:51,291 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => d822a57dcbc31b3d0545cf66f9deb083, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1694818970938.d822a57dcbc31b3d0545cf66f9deb083.', STARTKEY => '1', ENDKEY => ''} 2023-09-15 23:02:51,291 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 5b6923290cc0dbe584c094916ff81886, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1694818970938.5b6923290cc0dbe584c094916ff81886.', STARTKEY => '', ENDKEY => '1'} 2023-09-15 23:02:51,292 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,1,1694818970938.d822a57dcbc31b3d0545cf66f9deb083. service=AccessControlService 2023-09-15 23:02:51,292 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,,1694818970938.5b6923290cc0dbe584c094916ff81886. service=AccessControlService 2023-09-15 23:02:51,292 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-15 23:02:51,292 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp d822a57dcbc31b3d0545cf66f9deb083 2023-09-15 23:02:51,292 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-15 23:02:51,292 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1694818970938.d822a57dcbc31b3d0545cf66f9deb083.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-15 23:02:51,292 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for d822a57dcbc31b3d0545cf66f9deb083 2023-09-15 23:02:51,292 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp 5b6923290cc0dbe584c094916ff81886 2023-09-15 23:02:51,292 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for d822a57dcbc31b3d0545cf66f9deb083 2023-09-15 23:02:51,292 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1694818970938.5b6923290cc0dbe584c094916ff81886.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-15 23:02:51,292 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 5b6923290cc0dbe584c094916ff81886 2023-09-15 23:02:51,292 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 5b6923290cc0dbe584c094916ff81886 2023-09-15 23:02:51,293 INFO [StoreOpener-d822a57dcbc31b3d0545cf66f9deb083-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region d822a57dcbc31b3d0545cf66f9deb083 2023-09-15 23:02:51,293 INFO [StoreOpener-5b6923290cc0dbe584c094916ff81886-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 5b6923290cc0dbe584c094916ff81886 2023-09-15 23:02:51,295 DEBUG [StoreOpener-d822a57dcbc31b3d0545cf66f9deb083-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/default/testtb-testExportFileSystemStateWithSkipTmp/d822a57dcbc31b3d0545cf66f9deb083/cf 2023-09-15 23:02:51,295 DEBUG [StoreOpener-d822a57dcbc31b3d0545cf66f9deb083-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/default/testtb-testExportFileSystemStateWithSkipTmp/d822a57dcbc31b3d0545cf66f9deb083/cf 2023-09-15 23:02:51,295 DEBUG [StoreOpener-5b6923290cc0dbe584c094916ff81886-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/default/testtb-testExportFileSystemStateWithSkipTmp/5b6923290cc0dbe584c094916ff81886/cf 2023-09-15 23:02:51,295 DEBUG [StoreOpener-5b6923290cc0dbe584c094916ff81886-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/default/testtb-testExportFileSystemStateWithSkipTmp/5b6923290cc0dbe584c094916ff81886/cf 2023-09-15 23:02:51,295 INFO [StoreOpener-d822a57dcbc31b3d0545cf66f9deb083-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d822a57dcbc31b3d0545cf66f9deb083 columnFamilyName cf 2023-09-15 23:02:51,295 INFO [StoreOpener-5b6923290cc0dbe584c094916ff81886-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5b6923290cc0dbe584c094916ff81886 columnFamilyName cf 2023-09-15 23:02:51,296 INFO [StoreOpener-5b6923290cc0dbe584c094916ff81886-1] regionserver.HStore(310): Store=5b6923290cc0dbe584c094916ff81886/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-15 23:02:51,296 INFO [StoreOpener-d822a57dcbc31b3d0545cf66f9deb083-1] regionserver.HStore(310): Store=d822a57dcbc31b3d0545cf66f9deb083/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-15 23:02:51,297 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/default/testtb-testExportFileSystemStateWithSkipTmp/5b6923290cc0dbe584c094916ff81886 2023-09-15 23:02:51,297 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/default/testtb-testExportFileSystemStateWithSkipTmp/d822a57dcbc31b3d0545cf66f9deb083 2023-09-15 23:02:51,298 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/default/testtb-testExportFileSystemStateWithSkipTmp/5b6923290cc0dbe584c094916ff81886 2023-09-15 23:02:51,298 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/default/testtb-testExportFileSystemStateWithSkipTmp/d822a57dcbc31b3d0545cf66f9deb083 2023-09-15 23:02:51,300 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for d822a57dcbc31b3d0545cf66f9deb083 2023-09-15 23:02:51,300 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 5b6923290cc0dbe584c094916ff81886 2023-09-15 23:02:51,302 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/default/testtb-testExportFileSystemStateWithSkipTmp/d822a57dcbc31b3d0545cf66f9deb083/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-15 23:02:51,302 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/default/testtb-testExportFileSystemStateWithSkipTmp/5b6923290cc0dbe584c094916ff81886/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-15 23:02:51,303 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened d822a57dcbc31b3d0545cf66f9deb083; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75107411, jitterRate=0.11918763816356659}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-15 23:02:51,303 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for d822a57dcbc31b3d0545cf66f9deb083: 2023-09-15 23:02:51,303 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 5b6923290cc0dbe584c094916ff81886; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72085357, jitterRate=0.0741555243730545}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-15 23:02:51,303 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 5b6923290cc0dbe584c094916ff81886: 2023-09-15 23:02:51,303 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,1,1694818970938.d822a57dcbc31b3d0545cf66f9deb083., pid=109, masterSystemTime=1694818971287 2023-09-15 23:02:51,304 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,,1694818970938.5b6923290cc0dbe584c094916ff81886., pid=108, masterSystemTime=1694818971287 2023-09-15 23:02:51,305 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,1,1694818970938.d822a57dcbc31b3d0545cf66f9deb083. 2023-09-15 23:02:51,305 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,1,1694818970938.d822a57dcbc31b3d0545cf66f9deb083. 2023-09-15 23:02:51,305 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=d822a57dcbc31b3d0545cf66f9deb083, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33655,1694818872204 2023-09-15 23:02:51,306 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,,1694818970938.5b6923290cc0dbe584c094916ff81886. 2023-09-15 23:02:51,306 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,,1694818970938.5b6923290cc0dbe584c094916ff81886. 2023-09-15 23:02:51,306 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1694818970938.d822a57dcbc31b3d0545cf66f9deb083.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1694818971305"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1694818971305"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1694818971305"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1694818971305"}]},"ts":"1694818971305"} 2023-09-15 23:02:51,306 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=5b6923290cc0dbe584c094916ff81886, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:02:51,306 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1694818970938.5b6923290cc0dbe584c094916ff81886.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1694818971306"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1694818971306"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1694818971306"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1694818971306"}]},"ts":"1694818971306"} 2023-09-15 23:02:51,308 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=109, resume processing ppid=107 2023-09-15 23:02:51,308 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=109, ppid=107, state=SUCCESS; OpenRegionProcedure d822a57dcbc31b3d0545cf66f9deb083, server=jenkins-hbase4.apache.org,33655,1694818872204 in 171 msec 2023-09-15 23:02:51,309 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=108, resume processing ppid=106 2023-09-15 23:02:51,309 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=108, ppid=106, state=SUCCESS; OpenRegionProcedure 5b6923290cc0dbe584c094916ff81886, server=jenkins-hbase4.apache.org,41413,1694818872288 in 173 msec 2023-09-15 23:02:51,310 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=d822a57dcbc31b3d0545cf66f9deb083, ASSIGN in 330 msec 2023-09-15 23:02:51,311 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=106, resume processing ppid=105 2023-09-15 23:02:51,311 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=5b6923290cc0dbe584c094916ff81886, ASSIGN in 331 msec 2023-09-15 23:02:51,311 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-15 23:02:51,311 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694818971311"}]},"ts":"1694818971311"} 2023-09-15 23:02:51,312 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLED in hbase:meta 2023-09-15 23:02:51,314 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_POST_OPERATION 2023-09-15 23:02:51,314 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithSkipTmp jenkins: RWXCA 2023-09-15 23:02:51,316 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41413] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-09-15 23:02:51,317 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:33655-0x100b1d2daa90001, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-15 23:02:51,317 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-15 23:02:51,317 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:41413-0x100b1d2daa90003, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-15 23:02:51,317 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:34705-0x100b1d2daa90002, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-15 23:02:51,319 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-09-15 23:02:51,319 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-09-15 23:02:51,319 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-09-15 23:02:51,319 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-09-15 23:02:51,320 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=105, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 381 msec 2023-09-15 23:02:51,545 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-09-15 23:02:51,545 INFO [Listener at jenkins-hbase4.apache.org/46629] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 105 completed 2023-09-15 23:02:51,547 DEBUG [Listener at jenkins-hbase4.apache.org/46629] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-09-15 23:02:51,547 DEBUG [Listener at jenkins-hbase4.apache.org/46629] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1694818970938.5b6923290cc0dbe584c094916ff81886. 2023-09-15 23:02:51,549 INFO [Listener at jenkins-hbase4.apache.org/46629] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-15 23:02:51,559 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-15 23:02:51,559 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1694818971559 (current time:1694818971559). 2023-09-15 23:02:51,559 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-15 23:02:51,560 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] zookeeper.ReadOnlyZKClient(139): Connect 0x5b752453 to 127.0.0.1:51149 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-15 23:02:51,566 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4b84e7de, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-15 23:02:51,567 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-15 23:02:51,570 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58874, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-15 23:02:51,571 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5b752453 to 127.0.0.1:51149 2023-09-15 23:02:51,571 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-15 23:02:51,571 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] zookeeper.ReadOnlyZKClient(139): Connect 0x2d4bd308 to 127.0.0.1:51149 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-15 23:02:51,576 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5fee3d4e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-15 23:02:51,577 DEBUG [hconnection-0x33388b7a-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-15 23:02:51,578 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58886, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-15 23:02:51,582 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2d4bd308 to 127.0.0.1:51149 2023-09-15 23:02:51,582 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-15 23:02:51,582 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-09-15 23:02:51,583 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-15 23:02:51,583 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-15 23:02:51,585 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] procedure2.ProcedureExecutor(1028): Stored pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-15 23:02:51,586 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-15 23:02:51,586 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=110, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1694819571586 2023-09-15 23:02:51,586 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-15 23:02:51,586 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-09-15 23:02:51,587 DEBUG [Listener at jenkins-hbase4.apache.org/46629] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-15 23:02:51,587 DEBUG [Listener at jenkins-hbase4.apache.org/46629] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-15 23:02:51,588 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=110, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-15 23:02:51,588 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-15 23:02:51,589 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=110, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 4 msec 2023-09-15 23:02:51,590 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-15 23:02:51,591 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=111, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1694819571591 2023-09-15 23:02:51,598 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 23:02:51,599 INFO [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' 2023-09-15 23:02:51,599 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-15 23:02:51,600 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-09-15 23:02:51,600 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-09-15 23:02:51,600 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 23:02:51,600 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 23:02:51,602 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:34705-0x100b1d2daa90002, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 23:02:51,602 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:02:51,602 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:33655-0x100b1d2daa90001, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 23:02:51,602 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 23:02:51,603 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 23:02:51,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 23:02:51,602 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:41413-0x100b1d2daa90003, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 23:02:51,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 23:02:51,603 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 23:02:51,603 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:02:51,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 23:02:51,603 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33655,1694818872204 2023-09-15 23:02:51,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 23:02:51,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 23:02:51,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 23:02:51,603 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33655-0x100b1d2daa90001, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 23:02:51,603 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33655,1694818872204 2023-09-15 23:02:51,603 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-15 23:02:51,604 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34705-0x100b1d2daa90002, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 23:02:51,604 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41413-0x100b1d2daa90003, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 23:02:51,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-09-15 23:02:51,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 23:02:51,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-09-15 23:02:51,604 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-15 23:02:51,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-09-15 23:02:51,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 23:02:51,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 23:02:51,604 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-15 23:02:51,604 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-15 23:02:51,604 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 23:02:51,605 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 23:02:51,605 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 23:02:51,605 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-15 23:02:51,605 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-15 23:02:51,605 DEBUG [member: 'jenkins-hbase4.apache.org,33655,1694818872204' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-15 23:02:51,606 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-15 23:02:51,606 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-15 23:02:51,606 DEBUG [member: 'jenkins-hbase4.apache.org,33655,1694818872204' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-15 23:02:51,605 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-15 23:02:51,606 DEBUG [member: 'jenkins-hbase4.apache.org,33655,1694818872204' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-15 23:02:51,607 DEBUG [member: 'jenkins-hbase4.apache.org,33655,1694818872204' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-15 23:02:51,607 DEBUG [member: 'jenkins-hbase4.apache.org,33655,1694818872204' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33655,1694818872204' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-15 23:02:51,606 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34705,1694818872254' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-15 23:02:51,606 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-15 23:02:51,607 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-15 23:02:51,607 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-15 23:02:51,607 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41413,1694818872288' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-15 23:02:51,613 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 23:02:51,613 DEBUG [member: 'jenkins-hbase4.apache.org,33655,1694818872204' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 23:02:51,613 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33655,1694818872204 2023-09-15 23:02:51,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33655,1694818872204 2023-09-15 23:02:51,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-15 23:02:51,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-15 23:02:51,614 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:02:51,614 DEBUG [member: 'jenkins-hbase4.apache.org,33655,1694818872204' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33655-0x100b1d2daa90001, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 23:02:51,614 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 23:02:51,614 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34705-0x100b1d2daa90002, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 23:02:51,614 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-15 23:02:51,614 DEBUG [member: 'jenkins-hbase4.apache.org,33655,1694818872204' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-15 23:02:51,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-15 23:02:51,615 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41413-0x100b1d2daa90003, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 23:02:51,615 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-15 23:02:51,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-15 23:02:51,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 23:02:51,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:02:51,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:02:51,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33655,1694818872204 2023-09-15 23:02:51,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-15 23:02:51,616 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33655,1694818872204' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-09-15 23:02:51,616 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5c362181[Count = 1] remaining members to acquire global barrier 2023-09-15 23:02:51,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:02:51,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-15 23:02:51,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-15 23:02:51,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-15 23:02:51,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-15 23:02:51,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 23:02:51,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:02:51,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:02:51,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33655,1694818872204 2023-09-15 23:02:51,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-15 23:02:51,618 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41413,1694818872288' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-09-15 23:02:51,618 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5c362181[Count = 0] remaining members to acquire global barrier 2023-09-15 23:02:51,618 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-09-15 23:02:51,618 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 23:02:51,619 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:34705-0x100b1d2daa90002, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 23:02:51,619 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:33655-0x100b1d2daa90001, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 23:02:51,619 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 23:02:51,619 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 23:02:51,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 23:02:51,619 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:41413-0x100b1d2daa90003, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 23:02:51,619 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33655,1694818872204 2023-09-15 23:02:51,619 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-15 23:02:51,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 23:02:51,619 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-15 23:02:51,619 DEBUG [member: 'jenkins-hbase4.apache.org,33655,1694818872204' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-15 23:02:51,619 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,34705,1694818872254' in zk 2023-09-15 23:02:51,619 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 23:02:51,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 23:02:51,620 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:02:51,620 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-15 23:02:51,620 DEBUG [rs(jenkins-hbase4.apache.org,33655,1694818872204)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1694818970938.d822a57dcbc31b3d0545cf66f9deb083. 2023-09-15 23:02:51,620 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-15 23:02:51,620 DEBUG [rs(jenkins-hbase4.apache.org,33655,1694818872204)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1694818970938.d822a57dcbc31b3d0545cf66f9deb083. started... 2023-09-15 23:02:51,620 DEBUG [member: 'jenkins-hbase4.apache.org,33655,1694818872204' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-15 23:02:51,620 DEBUG [member: 'jenkins-hbase4.apache.org,33655,1694818872204' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-15 23:02:51,620 DEBUG [rs(jenkins-hbase4.apache.org,41413,1694818872288)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1694818970938.5b6923290cc0dbe584c094916ff81886. 2023-09-15 23:02:51,620 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-15 23:02:51,620 DEBUG [rs(jenkins-hbase4.apache.org,41413,1694818872288)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1694818970938.5b6923290cc0dbe584c094916ff81886. started... 2023-09-15 23:02:51,621 DEBUG [rs(jenkins-hbase4.apache.org,33655,1694818872204)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for d822a57dcbc31b3d0545cf66f9deb083: 2023-09-15 23:02:51,621 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-15 23:02:51,621 DEBUG [rs(jenkins-hbase4.apache.org,41413,1694818872288)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 5b6923290cc0dbe584c094916ff81886: 2023-09-15 23:02:51,621 DEBUG [rs(jenkins-hbase4.apache.org,33655,1694818872204)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1694818970938.d822a57dcbc31b3d0545cf66f9deb083.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 23:02:51,621 DEBUG [rs(jenkins-hbase4.apache.org,33655,1694818872204)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-15 23:02:51,621 DEBUG [rs(jenkins-hbase4.apache.org,33655,1694818872204)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-15 23:02:51,621 DEBUG [rs(jenkins-hbase4.apache.org,41413,1694818872288)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1694818970938.5b6923290cc0dbe584c094916ff81886.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 23:02:51,621 DEBUG [rs(jenkins-hbase4.apache.org,41413,1694818872288)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-15 23:02:51,621 DEBUG [rs(jenkins-hbase4.apache.org,41413,1694818872288)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-15 23:02:51,622 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-15 23:02:51,622 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-15 23:02:51,622 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-15 23:02:51,635 DEBUG [rs(jenkins-hbase4.apache.org,41413,1694818872288)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1694818970938.5b6923290cc0dbe584c094916ff81886. completed. 2023-09-15 23:02:51,635 DEBUG [rs(jenkins-hbase4.apache.org,41413,1694818872288)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1694818970938.5b6923290cc0dbe584c094916ff81886. 2023-09-15 23:02:51,635 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-15 23:02:51,635 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-15 23:02:51,635 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:02:51,635 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-15 23:02:51,635 DEBUG [rs(jenkins-hbase4.apache.org,33655,1694818872204)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1694818970938.d822a57dcbc31b3d0545cf66f9deb083. completed. 2023-09-15 23:02:51,635 DEBUG [rs(jenkins-hbase4.apache.org,33655,1694818872204)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1694818970938.d822a57dcbc31b3d0545cf66f9deb083. 2023-09-15 23:02:51,635 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,41413,1694818872288' in zk 2023-09-15 23:02:51,636 DEBUG [member: 'jenkins-hbase4.apache.org,33655,1694818872204' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-15 23:02:51,636 DEBUG [member: 'jenkins-hbase4.apache.org,33655,1694818872204' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-15 23:02:51,636 DEBUG [member: 'jenkins-hbase4.apache.org,33655,1694818872204' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33655,1694818872204 2023-09-15 23:02:51,636 DEBUG [member: 'jenkins-hbase4.apache.org,33655,1694818872204' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-15 23:02:51,636 DEBUG [member: 'jenkins-hbase4.apache.org,33655,1694818872204' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,33655,1694818872204' in zk 2023-09-15 23:02:51,638 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33655,1694818872204 2023-09-15 23:02:51,639 DEBUG [member: 'jenkins-hbase4.apache.org,33655,1694818872204' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-15 23:02:51,639 DEBUG [member: 'jenkins-hbase4.apache.org,33655,1694818872204' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-15 23:02:51,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33655,1694818872204 2023-09-15 23:02:51,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-15 23:02:51,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-15 23:02:51,639 DEBUG [member: 'jenkins-hbase4.apache.org,33655,1694818872204' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-15 23:02:51,640 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:02:51,640 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-15 23:02:51,640 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-15 23:02:51,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-15 23:02:51,640 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-15 23:02:51,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-15 23:02:51,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 23:02:51,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:02:51,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:02:51,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33655,1694818872204 2023-09-15 23:02:51,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-15 23:02:51,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 23:02:51,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:02:51,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:02:51,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33655,1694818872204 2023-09-15 23:02:51,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,33655,1694818872204': 2023-09-15 23:02:51,644 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33655,1694818872204' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-09-15 23:02:51,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:02:51,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-15 23:02:51,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-15 23:02:51,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-15 23:02:51,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-15 23:02:51,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 23:02:51,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:02:51,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:02:51,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33655,1694818872204 2023-09-15 23:02:51,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-15 23:02:51,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 23:02:51,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:02:51,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:02:51,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33655,1694818872204 2023-09-15 23:02:51,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,41413,1694818872288': 2023-09-15 23:02:51,648 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41413,1694818872288' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-09-15 23:02:51,648 INFO [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-09-15 23:02:51,648 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-15 23:02:51,648 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-15 23:02:51,648 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 23:02:51,648 INFO [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-15 23:02:51,649 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:41413-0x100b1d2daa90003, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 23:02:51,649 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 23:02:51,650 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 23:02:51,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 23:02:51,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-15 23:02:51,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-15 23:02:51,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 23:02:51,649 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:41413-0x100b1d2daa90003, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 23:02:51,649 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:33655-0x100b1d2daa90001, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 23:02:51,649 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:34705-0x100b1d2daa90002, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 23:02:51,650 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 23:02:51,650 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 23:02:51,650 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:33655-0x100b1d2daa90001, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 23:02:51,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 23:02:51,650 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:02:51,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-15 23:02:51,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 23:02:51,650 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 23:02:51,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 23:02:51,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 23:02:51,650 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:34705-0x100b1d2daa90002, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 23:02:51,651 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 23:02:51,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 23:02:51,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 23:02:51,651 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:02:51,651 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 23:02:51,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 23:02:51,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 23:02:51,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-15 23:02:51,651 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33655,1694818872204 2023-09-15 23:02:51,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 23:02:51,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 23:02:51,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:02:51,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:02:51,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33655,1694818872204 2023-09-15 23:02:51,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-15 23:02:51,653 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:02:51,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 23:02:51,653 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:02:51,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:02:51,654 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33655,1694818872204 2023-09-15 23:02:51,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:02:51,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33655,1694818872204 2023-09-15 23:02:51,656 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:34705-0x100b1d2daa90002, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 23:02:51,656 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:41413-0x100b1d2daa90003, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 23:02:51,656 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33655,1694818872204 2023-09-15 23:02:51,656 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 23:02:51,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 23:02:51,657 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:41413-0x100b1d2daa90003, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 23:02:51,657 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 23:02:51,657 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 23:02:51,656 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:34705-0x100b1d2daa90002, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 23:02:51,656 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 23:02:51,656 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:33655-0x100b1d2daa90001, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 23:02:51,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 23:02:51,657 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 23:02:51,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 23:02:51,657 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-09-15 23:02:51,657 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 23:02:51,657 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-15 23:02:51,657 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 23:02:51,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 23:02:51,657 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:02:51,658 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:02:51,658 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 23:02:51,658 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33655,1694818872204 2023-09-15 23:02:51,658 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 23:02:51,658 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:02:51,658 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:02:51,658 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 23:02:51,658 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 23:02:51,658 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-15 23:02:51,657 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-15 23:02:51,657 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 23:02:51,657 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:33655-0x100b1d2daa90001, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 23:02:51,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 23:02:51,660 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 23:02:51,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 23:02:51,668 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 23:02:51,669 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 23:02:51,687 DEBUG [Listener at jenkins-hbase4.apache.org/46629] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-15 23:02:51,688 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-09-15 23:02:51,688 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-09-15 23:02:51,688 DEBUG [Listener at jenkins-hbase4.apache.org/46629] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-15 23:02:51,689 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 23:02:51,690 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-09-15 23:02:51,690 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 23:02:51,690 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 23:02:51,690 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1694818971586Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1694818971668 (+82 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1694818971668Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1694818971668Writing data manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1694818971672 (+4 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1694818971684 (+12 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1694818971690 (+6 ms) 2023-09-15 23:02:51,692 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=111, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-15 23:02:51,693 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=111, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 105 msec 2023-09-15 23:02:51,889 DEBUG [Listener at jenkins-hbase4.apache.org/46629] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-15 23:02:51,889 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-09-15 23:02:51,890 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-15 23:02:51,892 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41413] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,,1694818970938.5b6923290cc0dbe584c094916ff81886. with WAL disabled. Data may be lost in the event of a crash. 2023-09-15 23:02:51,892 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33655] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,1,1694818970938.d822a57dcbc31b3d0545cf66f9deb083. with WAL disabled. Data may be lost in the event of a crash. 2023-09-15 23:02:51,895 DEBUG [Listener at jenkins-hbase4.apache.org/46629] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-09-15 23:02:51,895 DEBUG [Listener at jenkins-hbase4.apache.org/46629] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1694818970938.5b6923290cc0dbe584c094916ff81886. 2023-09-15 23:02:51,895 INFO [Listener at jenkins-hbase4.apache.org/46629] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-15 23:02:51,903 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-15 23:02:51,903 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1694818971903 (current time:1694818971903). 2023-09-15 23:02:51,903 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-15 23:02:51,904 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] zookeeper.ReadOnlyZKClient(139): Connect 0x60b30e77 to 127.0.0.1:51149 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-15 23:02:51,911 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@17a73a40, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-15 23:02:51,912 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-15 23:02:51,914 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58900, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-15 23:02:51,915 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x60b30e77 to 127.0.0.1:51149 2023-09-15 23:02:51,915 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-15 23:02:51,916 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] zookeeper.ReadOnlyZKClient(139): Connect 0x66cf1aeb to 127.0.0.1:51149 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-15 23:02:51,920 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1ef760f3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-15 23:02:51,921 DEBUG [hconnection-0x30ac3c57-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-15 23:02:51,924 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58912, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-15 23:02:51,928 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x66cf1aeb to 127.0.0.1:51149 2023-09-15 23:02:51,928 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-15 23:02:51,928 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-09-15 23:02:51,929 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-15 23:02:51,929 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-15 23:02:51,930 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] procedure2.ProcedureExecutor(1028): Stored pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-15 23:02:51,931 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-15 23:02:51,932 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=112, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1694819571932 2023-09-15 23:02:51,932 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-09-15 23:02:51,932 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-15 23:02:51,933 DEBUG [Listener at jenkins-hbase4.apache.org/46629] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-15 23:02:51,933 DEBUG [Listener at jenkins-hbase4.apache.org/46629] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-15 23:02:51,933 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-15 23:02:51,934 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=112, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-15 23:02:51,935 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=112, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 4 msec 2023-09-15 23:02:51,936 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-15 23:02:51,936 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=113, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1694819571936 2023-09-15 23:02:51,948 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 23:02:51,948 INFO [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' 2023-09-15 23:02:51,948 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-15 23:02:51,949 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-09-15 23:02:51,949 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-09-15 23:02:51,949 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 23:02:51,949 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 23:02:51,951 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:34705-0x100b1d2daa90002, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 23:02:51,951 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:33655-0x100b1d2daa90001, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 23:02:51,951 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 23:02:51,951 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 23:02:51,951 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:02:51,951 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:41413-0x100b1d2daa90003, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 23:02:51,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 23:02:51,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 23:02:51,952 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 23:02:51,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 23:02:51,952 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:02:51,952 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33655,1694818872204 2023-09-15 23:02:51,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 23:02:51,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 23:02:51,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 23:02:51,952 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33655,1694818872204 2023-09-15 23:02:51,952 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-15 23:02:51,952 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34705-0x100b1d2daa90002, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 23:02:51,952 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33655-0x100b1d2daa90001, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 23:02:51,952 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41413-0x100b1d2daa90003, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 23:02:51,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-09-15 23:02:51,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 23:02:51,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-09-15 23:02:51,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-09-15 23:02:51,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 23:02:51,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 23:02:51,953 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-15 23:02:51,953 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-15 23:02:51,953 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-15 23:02:51,953 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 23:02:51,953 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 23:02:51,953 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 23:02:51,953 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-15 23:02:51,953 DEBUG [member: 'jenkins-hbase4.apache.org,33655,1694818872204' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-15 23:02:51,953 DEBUG [member: 'jenkins-hbase4.apache.org,33655,1694818872204' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-15 23:02:51,953 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-15 23:02:51,954 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-15 23:02:51,954 DEBUG [member: 'jenkins-hbase4.apache.org,33655,1694818872204' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-15 23:02:51,953 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-15 23:02:51,955 DEBUG [member: 'jenkins-hbase4.apache.org,33655,1694818872204' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-15 23:02:51,956 DEBUG [member: 'jenkins-hbase4.apache.org,33655,1694818872204' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33655,1694818872204' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-15 23:02:51,955 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-15 23:02:51,956 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-15 23:02:51,956 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-15 23:02:51,956 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34705,1694818872254' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-15 23:02:51,956 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-15 23:02:51,956 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41413,1694818872288' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-15 23:02:51,957 DEBUG [member: 'jenkins-hbase4.apache.org,33655,1694818872204' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 23:02:51,957 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33655,1694818872204 2023-09-15 23:02:51,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33655,1694818872204 2023-09-15 23:02:51,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-15 23:02:51,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-15 23:02:51,958 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:02:51,958 DEBUG [member: 'jenkins-hbase4.apache.org,33655,1694818872204' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33655-0x100b1d2daa90001, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 23:02:51,958 DEBUG [member: 'jenkins-hbase4.apache.org,33655,1694818872204' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-15 23:02:51,958 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 23:02:51,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-15 23:02:51,958 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 23:02:51,959 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34705-0x100b1d2daa90002, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 23:02:51,959 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41413-0x100b1d2daa90003, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 23:02:51,959 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-15 23:02:51,959 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-15 23:02:51,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-15 23:02:51,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 23:02:51,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:02:51,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:02:51,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33655,1694818872204 2023-09-15 23:02:51,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-15 23:02:51,960 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33655,1694818872204' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-09-15 23:02:51,960 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@58fa4c21[Count = 1] remaining members to acquire global barrier 2023-09-15 23:02:51,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:02:51,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-15 23:02:51,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-15 23:02:51,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-15 23:02:51,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-15 23:02:51,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 23:02:51,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:02:51,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:02:51,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33655,1694818872204 2023-09-15 23:02:51,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-15 23:02:51,962 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41413,1694818872288' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-09-15 23:02:51,962 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@58fa4c21[Count = 0] remaining members to acquire global barrier 2023-09-15 23:02:51,962 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-09-15 23:02:51,962 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 23:02:51,973 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:34705-0x100b1d2daa90002, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 23:02:51,973 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:33655-0x100b1d2daa90001, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 23:02:51,973 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 23:02:51,973 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 23:02:51,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 23:02:51,973 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:41413-0x100b1d2daa90003, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 23:02:51,973 DEBUG [member: 'jenkins-hbase4.apache.org,33655,1694818872204' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-15 23:02:51,973 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 23:02:51,973 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33655,1694818872204 2023-09-15 23:02:51,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 23:02:51,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 23:02:51,973 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-15 23:02:51,973 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-15 23:02:51,973 DEBUG [member: 'jenkins-hbase4.apache.org,33655,1694818872204' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-15 23:02:51,973 DEBUG [member: 'jenkins-hbase4.apache.org,33655,1694818872204' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-15 23:02:51,973 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-15 23:02:51,973 DEBUG [rs(jenkins-hbase4.apache.org,33655,1694818872204)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1694818970938.d822a57dcbc31b3d0545cf66f9deb083. 2023-09-15 23:02:51,973 DEBUG [rs(jenkins-hbase4.apache.org,41413,1694818872288)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1694818970938.5b6923290cc0dbe584c094916ff81886. 2023-09-15 23:02:51,973 DEBUG [rs(jenkins-hbase4.apache.org,33655,1694818872204)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1694818970938.d822a57dcbc31b3d0545cf66f9deb083. started... 2023-09-15 23:02:51,973 DEBUG [rs(jenkins-hbase4.apache.org,41413,1694818872288)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1694818970938.5b6923290cc0dbe584c094916ff81886. started... 2023-09-15 23:02:51,973 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-15 23:02:51,974 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,34705,1694818872254' in zk 2023-09-15 23:02:51,973 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-15 23:02:51,973 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:02:51,974 INFO [rs(jenkins-hbase4.apache.org,33655,1694818872204)-snapshot-pool-0] regionserver.HRegion(2745): Flushing d822a57dcbc31b3d0545cf66f9deb083 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-09-15 23:02:51,974 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-15 23:02:51,974 INFO [rs(jenkins-hbase4.apache.org,41413,1694818872288)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 5b6923290cc0dbe584c094916ff81886 1/1 column families, dataSize=266 B heapSize=832 B 2023-09-15 23:02:51,975 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-15 23:02:51,975 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-15 23:02:51,975 DEBUG [member: 'jenkins-hbase4.apache.org,34705,1694818872254' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-15 23:02:51,990 INFO [rs(jenkins-hbase4.apache.org,41413,1694818872288)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202309157f26d65e00f8438cbc59c2d104a44b94 to hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e202309157f26d65e00f8438cbc59c2d104a44b94 2023-09-15 23:02:51,990 INFO [rs(jenkins-hbase4.apache.org,33655,1694818872204)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202309154d9286e806834e6fbf3bbda871bd8e60 to hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b202309154d9286e806834e6fbf3bbda871bd8e60 2023-09-15 23:02:52,005 INFO [rs(jenkins-hbase4.apache.org,41413,1694818872288)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=266, hasBloomFilter=true, into tmp file hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/default/testtb-testExportFileSystemStateWithSkipTmp/5b6923290cc0dbe584c094916ff81886/.tmp/cf/f8ed9c2df3e8426b94fe311c97fbdd0d 2023-09-15 23:02:52,005 INFO [rs(jenkins-hbase4.apache.org,33655,1694818872204)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.0 K, hasBloomFilter=true, into tmp file hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/default/testtb-testExportFileSystemStateWithSkipTmp/d822a57dcbc31b3d0545cf66f9deb083/.tmp/cf/6db7472d6e714eb89934712585a61232 2023-09-15 23:02:52,010 DEBUG [rs(jenkins-hbase4.apache.org,41413,1694818872288)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/default/testtb-testExportFileSystemStateWithSkipTmp/5b6923290cc0dbe584c094916ff81886/.tmp/cf/f8ed9c2df3e8426b94fe311c97fbdd0d as hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/default/testtb-testExportFileSystemStateWithSkipTmp/5b6923290cc0dbe584c094916ff81886/cf/f8ed9c2df3e8426b94fe311c97fbdd0d 2023-09-15 23:02:52,010 DEBUG [rs(jenkins-hbase4.apache.org,33655,1694818872204)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/default/testtb-testExportFileSystemStateWithSkipTmp/d822a57dcbc31b3d0545cf66f9deb083/.tmp/cf/6db7472d6e714eb89934712585a61232 as hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/default/testtb-testExportFileSystemStateWithSkipTmp/d822a57dcbc31b3d0545cf66f9deb083/cf/6db7472d6e714eb89934712585a61232 2023-09-15 23:02:52,014 INFO [rs(jenkins-hbase4.apache.org,41413,1694818872288)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/default/testtb-testExportFileSystemStateWithSkipTmp/5b6923290cc0dbe584c094916ff81886/cf/f8ed9c2df3e8426b94fe311c97fbdd0d, entries=4, sequenceid=6, filesize=5.6 K 2023-09-15 23:02:52,014 INFO [rs(jenkins-hbase4.apache.org,33655,1694818872204)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/default/testtb-testExportFileSystemStateWithSkipTmp/d822a57dcbc31b3d0545cf66f9deb083/cf/6db7472d6e714eb89934712585a61232, entries=46, sequenceid=6, filesize=13.2 K 2023-09-15 23:02:52,015 INFO [rs(jenkins-hbase4.apache.org,41413,1694818872288)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for 5b6923290cc0dbe584c094916ff81886 in 41ms, sequenceid=6, compaction requested=false 2023-09-15 23:02:52,015 DEBUG [rs(jenkins-hbase4.apache.org,41413,1694818872288)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithSkipTmp' 2023-09-15 23:02:52,015 INFO [rs(jenkins-hbase4.apache.org,33655,1694818872204)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for d822a57dcbc31b3d0545cf66f9deb083 in 41ms, sequenceid=6, compaction requested=false 2023-09-15 23:02:52,015 DEBUG [rs(jenkins-hbase4.apache.org,33655,1694818872204)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithSkipTmp' 2023-09-15 23:02:52,018 DEBUG [rs(jenkins-hbase4.apache.org,41413,1694818872288)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 5b6923290cc0dbe584c094916ff81886: 2023-09-15 23:02:52,018 DEBUG [rs(jenkins-hbase4.apache.org,33655,1694818872204)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for d822a57dcbc31b3d0545cf66f9deb083: 2023-09-15 23:02:52,019 DEBUG [rs(jenkins-hbase4.apache.org,41413,1694818872288)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1694818970938.5b6923290cc0dbe584c094916ff81886.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 23:02:52,019 DEBUG [rs(jenkins-hbase4.apache.org,33655,1694818872204)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1694818970938.d822a57dcbc31b3d0545cf66f9deb083.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 23:02:52,019 DEBUG [rs(jenkins-hbase4.apache.org,41413,1694818872288)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-15 23:02:52,019 DEBUG [rs(jenkins-hbase4.apache.org,33655,1694818872204)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-15 23:02:52,019 DEBUG [rs(jenkins-hbase4.apache.org,41413,1694818872288)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/default/testtb-testExportFileSystemStateWithSkipTmp/5b6923290cc0dbe584c094916ff81886/cf/f8ed9c2df3e8426b94fe311c97fbdd0d] hfiles 2023-09-15 23:02:52,019 DEBUG [rs(jenkins-hbase4.apache.org,33655,1694818872204)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/default/testtb-testExportFileSystemStateWithSkipTmp/d822a57dcbc31b3d0545cf66f9deb083/cf/6db7472d6e714eb89934712585a61232] hfiles 2023-09-15 23:02:52,019 DEBUG [rs(jenkins-hbase4.apache.org,33655,1694818872204)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/default/testtb-testExportFileSystemStateWithSkipTmp/d822a57dcbc31b3d0545cf66f9deb083/cf/6db7472d6e714eb89934712585a61232 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 23:02:52,019 DEBUG [rs(jenkins-hbase4.apache.org,41413,1694818872288)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/default/testtb-testExportFileSystemStateWithSkipTmp/5b6923290cc0dbe584c094916ff81886/cf/f8ed9c2df3e8426b94fe311c97fbdd0d for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 23:02:52,031 DEBUG [rs(jenkins-hbase4.apache.org,41413,1694818872288)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1694818970938.5b6923290cc0dbe584c094916ff81886. completed. 2023-09-15 23:02:52,031 DEBUG [rs(jenkins-hbase4.apache.org,41413,1694818872288)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1694818970938.5b6923290cc0dbe584c094916ff81886. 2023-09-15 23:02:52,031 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-15 23:02:52,031 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-15 23:02:52,031 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:02:52,031 DEBUG [rs(jenkins-hbase4.apache.org,33655,1694818872204)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1694818970938.d822a57dcbc31b3d0545cf66f9deb083. completed. 2023-09-15 23:02:52,031 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-15 23:02:52,031 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,41413,1694818872288' in zk 2023-09-15 23:02:52,031 DEBUG [rs(jenkins-hbase4.apache.org,33655,1694818872204)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1694818970938.d822a57dcbc31b3d0545cf66f9deb083. 2023-09-15 23:02:52,032 DEBUG [member: 'jenkins-hbase4.apache.org,33655,1694818872204' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-15 23:02:52,032 DEBUG [member: 'jenkins-hbase4.apache.org,33655,1694818872204' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-15 23:02:52,032 DEBUG [member: 'jenkins-hbase4.apache.org,33655,1694818872204' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33655,1694818872204 2023-09-15 23:02:52,032 DEBUG [member: 'jenkins-hbase4.apache.org,33655,1694818872204' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-15 23:02:52,032 DEBUG [member: 'jenkins-hbase4.apache.org,33655,1694818872204' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,33655,1694818872204' in zk 2023-09-15 23:02:52,033 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-15 23:02:52,033 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-15 23:02:52,033 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:02:52,034 DEBUG [Listener at jenkins-hbase4.apache.org/46629] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-15 23:02:52,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:02:52,034 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33655,1694818872204 2023-09-15 23:02:52,033 DEBUG [member: 'jenkins-hbase4.apache.org,41413,1694818872288' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-15 23:02:52,034 DEBUG [member: 'jenkins-hbase4.apache.org,33655,1694818872204' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-15 23:02:52,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-15 23:02:52,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-15 23:02:52,034 DEBUG [member: 'jenkins-hbase4.apache.org,33655,1694818872204' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-15 23:02:52,034 DEBUG [member: 'jenkins-hbase4.apache.org,33655,1694818872204' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-15 23:02:52,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-15 23:02:52,035 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-09-15 23:02:52,035 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-09-15 23:02:52,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-15 23:02:52,036 DEBUG [Listener at jenkins-hbase4.apache.org/46629] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-15 23:02:52,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 23:02:52,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:02:52,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:02:52,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33655,1694818872204 2023-09-15 23:02:52,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-15 23:02:52,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 23:02:52,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:02:52,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:02:52,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33655,1694818872204 2023-09-15 23:02:52,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,41413,1694818872288': 2023-09-15 23:02:52,038 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41413,1694818872288' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-09-15 23:02:52,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33655,1694818872204 2023-09-15 23:02:52,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-15 23:02:52,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-15 23:02:52,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-15 23:02:52,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-15 23:02:52,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 23:02:52,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:02:52,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:02:52,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33655,1694818872204 2023-09-15 23:02:52,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-15 23:02:52,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 23:02:52,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:02:52,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:02:52,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33655,1694818872204 2023-09-15 23:02:52,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,33655,1694818872204': 2023-09-15 23:02:52,041 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33655,1694818872204' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-09-15 23:02:52,041 INFO [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-09-15 23:02:52,041 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-15 23:02:52,041 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-15 23:02:52,041 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 23:02:52,041 INFO [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-15 23:02:52,044 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 23:02:52,044 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:34705-0x100b1d2daa90002, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 23:02:52,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 23:02:52,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-15 23:02:52,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-15 23:02:52,044 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:41413-0x100b1d2daa90003, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 23:02:52,044 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:33655-0x100b1d2daa90001, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 23:02:52,044 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 23:02:52,044 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:41413-0x100b1d2daa90003, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 23:02:52,044 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 23:02:52,044 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:34705-0x100b1d2daa90002, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 23:02:52,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-15 23:02:52,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 23:02:52,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 23:02:52,045 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:02:52,044 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 23:02:52,044 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:33655-0x100b1d2daa90001, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 23:02:52,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 23:02:52,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 23:02:52,045 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 23:02:52,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 23:02:52,045 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 23:02:52,045 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:02:52,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 23:02:52,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-15 23:02:52,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 23:02:52,045 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 23:02:52,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 23:02:52,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 23:02:52,046 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33655,1694818872204 2023-09-15 23:02:52,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 23:02:52,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 23:02:52,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:02:52,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:02:52,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33655,1694818872204 2023-09-15 23:02:52,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-15 23:02:52,047 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:02:52,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 23:02:52,047 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:02:52,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:02:52,048 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33655,1694818872204 2023-09-15 23:02:52,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:02:52,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33655,1694818872204 2023-09-15 23:02:52,050 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33655,1694818872204 2023-09-15 23:02:52,050 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 23:02:52,050 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:33655-0x100b1d2daa90001, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 23:02:52,050 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:02:52,050 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:33655-0x100b1d2daa90001, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 23:02:52,050 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:02:52,050 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:34705-0x100b1d2daa90002, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 23:02:52,050 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:41413-0x100b1d2daa90003, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 23:02:52,050 DEBUG [(jenkins-hbase4.apache.org,44427,1694818870945)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-15 23:02:52,050 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:41413-0x100b1d2daa90003, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 23:02:52,050 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 23:02:52,050 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:34705-0x100b1d2daa90002, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 23:02:52,050 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 23:02:52,050 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 23:02:52,051 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33655,1694818872204 2023-09-15 23:02:52,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 23:02:52,050 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 23:02:52,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 23:02:52,050 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 23:02:52,051 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 23:02:52,052 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-09-15 23:02:52,052 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:02:52,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 23:02:52,052 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 23:02:52,052 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:02:52,052 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-15 23:02:52,052 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 23:02:52,052 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 23:02:52,052 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 23:02:52,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 23:02:52,052 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 23:02:52,052 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 23:02:52,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 23:02:52,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 23:02:52,053 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b202309154d9286e806834e6fbf3bbda871bd8e60, hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e202309157f26d65e00f8438cbc59c2d104a44b94] mob files 2023-09-15 23:02:52,053 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b202309154d9286e806834e6fbf3bbda871bd8e60 2023-09-15 23:02:52,053 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e202309157f26d65e00f8438cbc59c2d104a44b94 2023-09-15 23:02:52,058 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 23:02:52,059 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 23:02:52,073 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 23:02:52,074 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-09-15 23:02:52,074 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 23:02:52,074 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 23:02:52,075 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1694818971932Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1694818972058 (+126 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1694818972058Loading Region manifests for snaptb0-testExportFileSystemStateWithSkipTmp at 1694818972059 (+1 ms)Writing data manifest for snaptb0-testExportFileSystemStateWithSkipTmp at 1694818972061 (+2 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1694818972068 (+7 ms)Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1694818972074 (+6 ms) 2023-09-15 23:02:52,077 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=113, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-15 23:02:52,078 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=113, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 144 msec 2023-09-15 23:02:52,236 DEBUG [Listener at jenkins-hbase4.apache.org/46629] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-15 23:02:52,237 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-09-15 23:02:52,237 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-15 23:02:52,237 INFO [Listener at jenkins-hbase4.apache.org/46629] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/export-test/export-1694818972237 2023-09-15 23:02:52,237 INFO [Listener at jenkins-hbase4.apache.org/46629] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:44545, tgtDir=hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/export-test/export-1694818972237, rawTgtDir=hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/export-test/export-1694818972237, srcFsUri=hdfs://localhost:44545, srcDir=hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64 2023-09-15 23:02:52,259 DEBUG [Listener at jenkins-hbase4.apache.org/46629] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:44545, inputRoot=hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64 2023-09-15 23:02:52,259 DEBUG [Listener at jenkins-hbase4.apache.org/46629] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1805636904_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/export-test/export-1694818972237, skipTmp=true, initialOutputSnapshotDir=hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/export-test/export-1694818972237/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 23:02:52,259 INFO [Listener at jenkins-hbase4.apache.org/46629] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:44545, inputRoot=hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64, snapshotDir=hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp. 2023-09-15 23:02:52,274 INFO [Listener at jenkins-hbase4.apache.org/46629] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/export-test/export-1694818972237/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 23:02:52,286 DEBUG [Listener at jenkins-hbase4.apache.org/46629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-15 23:02:52,286 DEBUG [Listener at jenkins-hbase4.apache.org/46629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-15 23:02:52,287 DEBUG [Listener at jenkins-hbase4.apache.org/46629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-15 23:02:52,287 DEBUG [Listener at jenkins-hbase4.apache.org/46629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-15 23:02:53,154 DEBUG [Listener at jenkins-hbase4.apache.org/46629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c5e9ebbf-ce0f-c6b3-3dce-6299f7b47f51/hadoop-7398058990991125846.jar 2023-09-15 23:02:53,155 DEBUG [Listener at jenkins-hbase4.apache.org/46629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-15 23:02:53,155 DEBUG [Listener at jenkins-hbase4.apache.org/46629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-15 23:02:53,221 DEBUG [Listener at jenkins-hbase4.apache.org/46629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c5e9ebbf-ce0f-c6b3-3dce-6299f7b47f51/hadoop-1057742412008572572.jar 2023-09-15 23:02:53,222 DEBUG [Listener at jenkins-hbase4.apache.org/46629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-15 23:02:53,222 DEBUG [Listener at jenkins-hbase4.apache.org/46629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-15 23:02:53,222 DEBUG [Listener at jenkins-hbase4.apache.org/46629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-15 23:02:53,223 DEBUG [Listener at jenkins-hbase4.apache.org/46629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-15 23:02:53,223 DEBUG [Listener at jenkins-hbase4.apache.org/46629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-15 23:02:53,223 DEBUG [Listener at jenkins-hbase4.apache.org/46629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-15 23:02:53,224 DEBUG [Listener at jenkins-hbase4.apache.org/46629] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-15 23:02:53,224 DEBUG [Listener at jenkins-hbase4.apache.org/46629] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-15 23:02:53,224 DEBUG [Listener at jenkins-hbase4.apache.org/46629] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-15 23:02:53,225 DEBUG [Listener at jenkins-hbase4.apache.org/46629] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-15 23:02:53,225 DEBUG [Listener at jenkins-hbase4.apache.org/46629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-15 23:02:53,225 DEBUG [Listener at jenkins-hbase4.apache.org/46629] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-15 23:02:53,226 DEBUG [Listener at jenkins-hbase4.apache.org/46629] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-15 23:02:53,226 DEBUG [Listener at jenkins-hbase4.apache.org/46629] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-15 23:02:53,226 DEBUG [Listener at jenkins-hbase4.apache.org/46629] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-15 23:02:53,227 DEBUG [Listener at jenkins-hbase4.apache.org/46629] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-15 23:02:53,227 DEBUG [Listener at jenkins-hbase4.apache.org/46629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-15 23:02:53,228 DEBUG [Listener at jenkins-hbase4.apache.org/46629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-15 23:02:53,228 DEBUG [Listener at jenkins-hbase4.apache.org/46629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-15 23:02:53,228 DEBUG [Listener at jenkins-hbase4.apache.org/46629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-15 23:02:53,228 DEBUG [Listener at jenkins-hbase4.apache.org/46629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-15 23:02:53,229 DEBUG [Listener at jenkins-hbase4.apache.org/46629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-15 23:02:53,229 DEBUG [Listener at jenkins-hbase4.apache.org/46629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-15 23:02:53,562 WARN [Listener at jenkins-hbase4.apache.org/46629] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-15 23:02:53,564 INFO [Listener at jenkins-hbase4.apache.org/46629] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithSkipTmp' hfile list 2023-09-15 23:02:53,566 DEBUG [Listener at jenkins-hbase4.apache.org/46629] snapshot.ExportSnapshot(671): export split=0 size=31.5 K 2023-09-15 23:02:55,345 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-15 23:02:55,345 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-15 23:02:55,352 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694818878578_0006_000001 (auth:SIMPLE) 2023-09-15 23:02:55,477 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694818878578_0007_000001 (auth:SIMPLE) 2023-09-15 23:02:56,221 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-15 23:02:59,243 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694818878578_0007_000001 (auth:SIMPLE) 2023-09-15 23:03:01,458 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694818878578_0007_000001 (auth:SIMPLE) 2023-09-15 23:03:04,589 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694818878578_0007_000001 (auth:SIMPLE) 2023-09-15 23:03:05,723 INFO [Listener at jenkins-hbase4.apache.org/46629] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-15 23:03:05,723 INFO [Listener at jenkins-hbase4.apache.org/46629] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-15 23:03:05,733 INFO [Listener at jenkins-hbase4.apache.org/46629] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 23:03:05,734 INFO [Listener at jenkins-hbase4.apache.org/46629] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-15 23:03:05,734 INFO [Listener at jenkins-hbase4.apache.org/46629] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-15 23:03:05,734 DEBUG [Listener at jenkins-hbase4.apache.org/46629] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1896422628_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 23:03:05,735 DEBUG [Listener at jenkins-hbase4.apache.org/46629] snapshot.TestExportSnapshot(367): hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-09-15 23:03:05,735 DEBUG [Listener at jenkins-hbase4.apache.org/46629] snapshot.TestExportSnapshot(367): hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-09-15 23:03:05,735 DEBUG [Listener at jenkins-hbase4.apache.org/46629] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1896422628_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/export-test/export-1694818972237/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/export-test/export-1694818972237/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 23:03:05,735 DEBUG [Listener at jenkins-hbase4.apache.org/46629] snapshot.TestExportSnapshot(367): hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/export-test/export-1694818972237/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-09-15 23:03:05,735 DEBUG [Listener at jenkins-hbase4.apache.org/46629] snapshot.TestExportSnapshot(367): hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/export-test/export-1694818972237/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-09-15 23:03:05,741 INFO [Listener at jenkins-hbase4.apache.org/46629] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithSkipTmp 2023-09-15 23:03:05,741 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithSkipTmp 2023-09-15 23:03:05,742 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] procedure2.ProcedureExecutor(1028): Stored pid=114, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-15 23:03:05,744 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-09-15 23:03:05,745 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694818985745"}]},"ts":"1694818985745"} 2023-09-15 23:03:05,746 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLING in hbase:meta 2023-09-15 23:03:05,748 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLING 2023-09-15 23:03:05,749 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=5b6923290cc0dbe584c094916ff81886, UNASSIGN}, {pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=d822a57dcbc31b3d0545cf66f9deb083, UNASSIGN}] 2023-09-15 23:03:05,751 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=5b6923290cc0dbe584c094916ff81886, UNASSIGN 2023-09-15 23:03:05,751 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=d822a57dcbc31b3d0545cf66f9deb083, UNASSIGN 2023-09-15 23:03:05,751 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=5b6923290cc0dbe584c094916ff81886, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:03:05,751 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=d822a57dcbc31b3d0545cf66f9deb083, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,33655,1694818872204 2023-09-15 23:03:05,751 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1694818970938.5b6923290cc0dbe584c094916ff81886.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1694818985751"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694818985751"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694818985751"}]},"ts":"1694818985751"} 2023-09-15 23:03:05,751 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1694818970938.d822a57dcbc31b3d0545cf66f9deb083.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1694818985751"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694818985751"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694818985751"}]},"ts":"1694818985751"} 2023-09-15 23:03:05,752 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=117, ppid=115, state=RUNNABLE; CloseRegionProcedure 5b6923290cc0dbe584c094916ff81886, server=jenkins-hbase4.apache.org,41413,1694818872288}] 2023-09-15 23:03:05,753 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=118, ppid=116, state=RUNNABLE; CloseRegionProcedure d822a57dcbc31b3d0545cf66f9deb083, server=jenkins-hbase4.apache.org,33655,1694818872204}] 2023-09-15 23:03:05,845 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-09-15 23:03:05,904 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close d822a57dcbc31b3d0545cf66f9deb083 2023-09-15 23:03:05,904 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 5b6923290cc0dbe584c094916ff81886 2023-09-15 23:03:05,904 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing d822a57dcbc31b3d0545cf66f9deb083, disabling compactions & flushes 2023-09-15 23:03:05,904 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 5b6923290cc0dbe584c094916ff81886, disabling compactions & flushes 2023-09-15 23:03:05,904 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1694818970938.d822a57dcbc31b3d0545cf66f9deb083. 2023-09-15 23:03:05,904 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1694818970938.5b6923290cc0dbe584c094916ff81886. 2023-09-15 23:03:05,904 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1694818970938.d822a57dcbc31b3d0545cf66f9deb083. 2023-09-15 23:03:05,904 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1694818970938.5b6923290cc0dbe584c094916ff81886. 2023-09-15 23:03:05,904 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1694818970938.d822a57dcbc31b3d0545cf66f9deb083. after waiting 0 ms 2023-09-15 23:03:05,904 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1694818970938.d822a57dcbc31b3d0545cf66f9deb083. 2023-09-15 23:03:05,904 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1694818970938.5b6923290cc0dbe584c094916ff81886. after waiting 0 ms 2023-09-15 23:03:05,905 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1694818970938.5b6923290cc0dbe584c094916ff81886. 2023-09-15 23:03:05,915 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/default/testtb-testExportFileSystemStateWithSkipTmp/5b6923290cc0dbe584c094916ff81886/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-15 23:03:05,915 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/default/testtb-testExportFileSystemStateWithSkipTmp/d822a57dcbc31b3d0545cf66f9deb083/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-15 23:03:05,916 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-15 23:03:05,917 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1694818970938.5b6923290cc0dbe584c094916ff81886. 2023-09-15 23:03:05,917 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 5b6923290cc0dbe584c094916ff81886: 2023-09-15 23:03:05,917 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-15 23:03:05,918 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1694818970938.d822a57dcbc31b3d0545cf66f9deb083. 2023-09-15 23:03:05,918 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for d822a57dcbc31b3d0545cf66f9deb083: 2023-09-15 23:03:05,919 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 5b6923290cc0dbe584c094916ff81886 2023-09-15 23:03:05,919 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=5b6923290cc0dbe584c094916ff81886, regionState=CLOSED 2023-09-15 23:03:05,919 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed d822a57dcbc31b3d0545cf66f9deb083 2023-09-15 23:03:05,919 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1694818970938.5b6923290cc0dbe584c094916ff81886.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1694818985919"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694818985919"}]},"ts":"1694818985919"} 2023-09-15 23:03:05,920 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=d822a57dcbc31b3d0545cf66f9deb083, regionState=CLOSED 2023-09-15 23:03:05,920 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1694818970938.d822a57dcbc31b3d0545cf66f9deb083.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1694818985920"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694818985920"}]},"ts":"1694818985920"} 2023-09-15 23:03:05,922 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=117, resume processing ppid=115 2023-09-15 23:03:05,922 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=117, ppid=115, state=SUCCESS; CloseRegionProcedure 5b6923290cc0dbe584c094916ff81886, server=jenkins-hbase4.apache.org,41413,1694818872288 in 168 msec 2023-09-15 23:03:05,922 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=118, resume processing ppid=116 2023-09-15 23:03:05,923 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=118, ppid=116, state=SUCCESS; CloseRegionProcedure d822a57dcbc31b3d0545cf66f9deb083, server=jenkins-hbase4.apache.org,33655,1694818872204 in 168 msec 2023-09-15 23:03:05,923 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=115, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=5b6923290cc0dbe584c094916ff81886, UNASSIGN in 173 msec 2023-09-15 23:03:05,924 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=116, resume processing ppid=114 2023-09-15 23:03:05,924 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=116, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=d822a57dcbc31b3d0545cf66f9deb083, UNASSIGN in 174 msec 2023-09-15 23:03:05,924 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694818985924"}]},"ts":"1694818985924"} 2023-09-15 23:03:05,925 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLED in hbase:meta 2023-09-15 23:03:05,927 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLED 2023-09-15 23:03:05,928 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=114, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 187 msec 2023-09-15 23:03:06,046 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-09-15 23:03:06,047 INFO [Listener at jenkins-hbase4.apache.org/46629] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 114 completed 2023-09-15 23:03:06,047 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithSkipTmp 2023-09-15 23:03:06,048 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] procedure2.ProcedureExecutor(1028): Stored pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-15 23:03:06,050 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-15 23:03:06,050 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithSkipTmp 2023-09-15 23:03:06,051 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=119, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-15 23:03:06,052 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41413] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithSkipTmp 2023-09-15 23:03:06,054 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/5b6923290cc0dbe584c094916ff81886 2023-09-15 23:03:06,054 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/d822a57dcbc31b3d0545cf66f9deb083 2023-09-15 23:03:06,055 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:33655-0x100b1d2daa90001, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-15 23:03:06,055 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-15 23:03:06,055 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:41413-0x100b1d2daa90003, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-15 23:03:06,055 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:34705-0x100b1d2daa90002, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-15 23:03:06,055 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-09-15 23:03:06,055 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-09-15 23:03:06,055 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-09-15 23:03:06,055 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-09-15 23:03:06,056 DEBUG [HFileArchiver-15] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/5b6923290cc0dbe584c094916ff81886/cf, FileablePath, hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/5b6923290cc0dbe584c094916ff81886/recovered.edits] 2023-09-15 23:03:06,056 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/d822a57dcbc31b3d0545cf66f9deb083/cf, FileablePath, hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/d822a57dcbc31b3d0545cf66f9deb083/recovered.edits] 2023-09-15 23:03:06,057 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:33655-0x100b1d2daa90001, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-15 23:03:06,057 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:34705-0x100b1d2daa90002, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-15 23:03:06,057 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:41413-0x100b1d2daa90003, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-15 23:03:06,057 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-15 23:03:06,057 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:34705-0x100b1d2daa90002, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-15 23:03:06,057 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:33655-0x100b1d2daa90001, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-15 23:03:06,057 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-15 23:03:06,057 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:41413-0x100b1d2daa90003, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-15 23:03:06,058 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-09-15 23:03:06,061 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/5b6923290cc0dbe584c094916ff81886/cf/f8ed9c2df3e8426b94fe311c97fbdd0d to hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/5b6923290cc0dbe584c094916ff81886/cf/f8ed9c2df3e8426b94fe311c97fbdd0d 2023-09-15 23:03:06,061 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/d822a57dcbc31b3d0545cf66f9deb083/cf/6db7472d6e714eb89934712585a61232 to hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/d822a57dcbc31b3d0545cf66f9deb083/cf/6db7472d6e714eb89934712585a61232 2023-09-15 23:03:06,064 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/5b6923290cc0dbe584c094916ff81886/recovered.edits/9.seqid to hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/5b6923290cc0dbe584c094916ff81886/recovered.edits/9.seqid 2023-09-15 23:03:06,064 DEBUG [HFileArchiver-15] backup.HFileArchiver(596): Deleted hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/5b6923290cc0dbe584c094916ff81886 2023-09-15 23:03:06,064 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/d822a57dcbc31b3d0545cf66f9deb083/recovered.edits/9.seqid to hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/d822a57dcbc31b3d0545cf66f9deb083/recovered.edits/9.seqid 2023-09-15 23:03:06,065 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/d822a57dcbc31b3d0545cf66f9deb083 2023-09-15 23:03:06,065 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-09-15 23:03:06,065 DEBUG [PEWorker-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-09-15 23:03:06,066 DEBUG [PEWorker-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf] 2023-09-15 23:03:06,069 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b202309154d9286e806834e6fbf3bbda871bd8e60 to hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b202309154d9286e806834e6fbf3bbda871bd8e60 2023-09-15 23:03:06,070 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e202309157f26d65e00f8438cbc59c2d104a44b94 to hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e202309157f26d65e00f8438cbc59c2d104a44b94 2023-09-15 23:03:06,071 DEBUG [PEWorker-2] backup.HFileArchiver(596): Deleted hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-09-15 23:03:06,072 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=119, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-15 23:03:06,074 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithSkipTmp from hbase:meta 2023-09-15 23:03:06,076 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithSkipTmp' descriptor. 2023-09-15 23:03:06,077 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=119, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-15 23:03:06,077 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithSkipTmp' from region states. 2023-09-15 23:03:06,077 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1694818970938.5b6923290cc0dbe584c094916ff81886.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1694818986077"}]},"ts":"9223372036854775807"} 2023-09-15 23:03:06,077 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1694818970938.d822a57dcbc31b3d0545cf66f9deb083.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1694818986077"}]},"ts":"9223372036854775807"} 2023-09-15 23:03:06,078 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-15 23:03:06,078 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 5b6923290cc0dbe584c094916ff81886, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1694818970938.5b6923290cc0dbe584c094916ff81886.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => d822a57dcbc31b3d0545cf66f9deb083, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1694818970938.d822a57dcbc31b3d0545cf66f9deb083.', STARTKEY => '1', ENDKEY => ''}] 2023-09-15 23:03:06,078 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithSkipTmp' as deleted. 2023-09-15 23:03:06,078 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1694818986078"}]},"ts":"9223372036854775807"} 2023-09-15 23:03:06,080 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithSkipTmp state from META 2023-09-15 23:03:06,081 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=119, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-15 23:03:06,082 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=119, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 34 msec 2023-09-15 23:03:06,159 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-09-15 23:03:06,160 INFO [Listener at jenkins-hbase4.apache.org/46629] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 119 completed 2023-09-15 23:03:06,165 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithSkipTmp" 2023-09-15 23:03:06,167 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 23:03:06,168 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithSkipTmp" 2023-09-15 23:03:06,170 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44427] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 23:03:06,195 INFO [Listener at jenkins-hbase4.apache.org/46629] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=767 (was 767), OpenFileDescriptor=913 (was 928), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=175 (was 196), ProcessCount=166 (was 166), AvailableMemoryMB=4818 (was 4924) 2023-09-15 23:03:06,195 WARN [Listener at jenkins-hbase4.apache.org/46629] hbase.ResourceChecker(130): Thread=767 is superior to 500 2023-09-15 23:03:06,195 INFO [Listener at jenkins-hbase4.apache.org/46629] hbase.HBaseTestingUtility(2762): Stopping mini mapreduce cluster... 2023-09-15 23:03:06,208 INFO [Listener at jenkins-hbase4.apache.org/46629] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-09-15 23:03:06,320 WARN [ContainersLauncher #0] nodemanager.DefaultContainerExecutor(305): Exit code from container container_1694818878578_0007_01_000001 is : 143 2023-09-15 23:03:11,484 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-15 23:03:20,332 INFO [Listener at jenkins-hbase4.apache.org/46629] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-09-15 23:03:34,453 ERROR [Thread[Thread-408,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-09-15 23:03:34,454 INFO [Listener at jenkins-hbase4.apache.org/46629] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-09-15 23:03:34,565 WARN [ApplicationMaster Launcher] amlauncher.ApplicationMasterLauncher$LauncherThread(122): org.apache.hadoop.yarn.server.resourcemanager.amlauncher.ApplicationMasterLauncher$LauncherThread interrupted. Returning. 2023-09-15 23:03:34,570 ERROR [SchedulerEventDispatcher:Event Processor] event.EventDispatcher$EventProcessor(61): Returning, interrupted : java.lang.InterruptedException 2023-09-15 23:03:34,571 ERROR [Thread[Thread-418,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-09-15 23:03:34,579 INFO [Listener at jenkins-hbase4.apache.org/46629] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-09-15 23:03:34,683 ERROR [Thread[Thread-383,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-09-15 23:03:34,683 INFO [Listener at jenkins-hbase4.apache.org/46629] hbase.HBaseTestingUtility(2765): Mini mapreduce cluster stopped 2023-09-15 23:03:34,683 INFO [Listener at jenkins-hbase4.apache.org/46629] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-09-15 23:03:34,683 INFO [Listener at jenkins-hbase4.apache.org/46629] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-09-15 23:03:34,684 DEBUG [Listener at jenkins-hbase4.apache.org/46629] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5ef1d215 to 127.0.0.1:51149 2023-09-15 23:03:34,684 DEBUG [Listener at jenkins-hbase4.apache.org/46629] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-15 23:03:34,684 DEBUG [Listener at jenkins-hbase4.apache.org/46629] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-09-15 23:03:34,684 DEBUG [Listener at jenkins-hbase4.apache.org/46629] util.JVMClusterUtil(257): Found active master hash=697902412, stopped=false 2023-09-15 23:03:34,684 DEBUG [Listener at jenkins-hbase4.apache.org/46629] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-15 23:03:34,684 DEBUG [Listener at jenkins-hbase4.apache.org/46629] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-09-15 23:03:34,685 INFO [Listener at jenkins-hbase4.apache.org/46629] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,44427,1694818870945 2023-09-15 23:03:34,686 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:41413-0x100b1d2daa90003, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-09-15 23:03:34,686 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:33655-0x100b1d2daa90001, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-09-15 23:03:34,686 INFO [Listener at jenkins-hbase4.apache.org/46629] procedure2.ProcedureExecutor(628): Stopping 2023-09-15 23:03:34,686 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:34705-0x100b1d2daa90002, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-09-15 23:03:34,686 DEBUG [Listener at jenkins-hbase4.apache.org/46629] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4133dbe6 to 127.0.0.1:51149 2023-09-15 23:03:34,686 DEBUG [Listener at jenkins-hbase4.apache.org/46629] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-15 23:03:34,686 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-09-15 23:03:34,687 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-15 23:03:34,687 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41413-0x100b1d2daa90003, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-15 23:03:34,687 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34705-0x100b1d2daa90002, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-15 23:03:34,686 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33655-0x100b1d2daa90001, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-15 23:03:34,687 INFO [Listener at jenkins-hbase4.apache.org/46629] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,33655,1694818872204' ***** 2023-09-15 23:03:34,687 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-15 23:03:34,687 DEBUG [Listener at jenkins-hbase4.apache.org/46629] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-15 23:03:34,687 INFO [Listener at jenkins-hbase4.apache.org/46629] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-09-15 23:03:34,687 INFO [Listener at jenkins-hbase4.apache.org/46629] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,34705,1694818872254' ***** 2023-09-15 23:03:34,687 DEBUG [Listener at jenkins-hbase4.apache.org/46629] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-15 23:03:34,687 INFO [Listener at jenkins-hbase4.apache.org/46629] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-09-15 23:03:34,687 INFO [RS:0;jenkins-hbase4:33655] regionserver.HeapMemoryManager(220): Stopping 2023-09-15 23:03:34,688 INFO [Listener at jenkins-hbase4.apache.org/46629] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,41413,1694818872288' ***** 2023-09-15 23:03:34,688 INFO [RS:1;jenkins-hbase4:34705] regionserver.HeapMemoryManager(220): Stopping 2023-09-15 23:03:34,688 DEBUG [Listener at jenkins-hbase4.apache.org/46629] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-15 23:03:34,688 INFO [RS:1;jenkins-hbase4:34705] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-09-15 23:03:34,688 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-09-15 23:03:34,688 INFO [RS:0;jenkins-hbase4:33655] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-09-15 23:03:34,688 INFO [RS:1;jenkins-hbase4:34705] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-09-15 23:03:34,688 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-09-15 23:03:34,688 INFO [Listener at jenkins-hbase4.apache.org/46629] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-09-15 23:03:34,688 INFO [RS:0;jenkins-hbase4:33655] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-09-15 23:03:34,688 INFO [RS:1;jenkins-hbase4:34705] regionserver.HRegionServer(3305): Received CLOSE for c1bbd79b4a7b2345bd057dfc3a1a2a94 2023-09-15 23:03:34,688 INFO [RS:2;jenkins-hbase4:41413] regionserver.HeapMemoryManager(220): Stopping 2023-09-15 23:03:34,688 INFO [RS:0;jenkins-hbase4:33655] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,33655,1694818872204 2023-09-15 23:03:34,688 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-09-15 23:03:34,688 DEBUG [RS:0;jenkins-hbase4:33655] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3340701e to 127.0.0.1:51149 2023-09-15 23:03:34,688 INFO [RS:2;jenkins-hbase4:41413] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-09-15 23:03:34,688 DEBUG [RS:0;jenkins-hbase4:33655] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-15 23:03:34,688 INFO [RS:2;jenkins-hbase4:41413] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-09-15 23:03:34,689 INFO [RS:1;jenkins-hbase4:34705] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:03:34,690 INFO [RS:0;jenkins-hbase4:33655] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,33655,1694818872204; all regions closed. 2023-09-15 23:03:34,690 INFO [RS:2;jenkins-hbase4:41413] regionserver.HRegionServer(3305): Received CLOSE for d38939590183e4a5cb1ff6cb57c77dc8 2023-09-15 23:03:34,690 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing c1bbd79b4a7b2345bd057dfc3a1a2a94, disabling compactions & flushes 2023-09-15 23:03:34,690 DEBUG [RS:1;jenkins-hbase4:34705] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x29a2d220 to 127.0.0.1:51149 2023-09-15 23:03:34,691 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1694818874374.c1bbd79b4a7b2345bd057dfc3a1a2a94. 2023-09-15 23:03:34,690 INFO [RS:2;jenkins-hbase4:41413] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:03:34,691 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1694818874374.c1bbd79b4a7b2345bd057dfc3a1a2a94. 2023-09-15 23:03:34,691 DEBUG [RS:2;jenkins-hbase4:41413] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x226a0771 to 127.0.0.1:51149 2023-09-15 23:03:34,691 DEBUG [RS:1;jenkins-hbase4:34705] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-15 23:03:34,691 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing d38939590183e4a5cb1ff6cb57c77dc8, disabling compactions & flushes 2023-09-15 23:03:34,691 DEBUG [RS:2;jenkins-hbase4:41413] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-15 23:03:34,691 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1694818874374.c1bbd79b4a7b2345bd057dfc3a1a2a94. after waiting 0 ms 2023-09-15 23:03:34,694 INFO [RS:2;jenkins-hbase4:41413] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-09-15 23:03:34,694 INFO [RS:2;jenkins-hbase4:41413] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-09-15 23:03:34,694 INFO [RS:2;jenkins-hbase4:41413] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-09-15 23:03:34,693 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:acl,,1694818875113.d38939590183e4a5cb1ff6cb57c77dc8. 2023-09-15 23:03:34,694 INFO [RS:2;jenkins-hbase4:41413] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-09-15 23:03:34,693 INFO [RS:1;jenkins-hbase4:34705] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-09-15 23:03:34,694 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1694818875113.d38939590183e4a5cb1ff6cb57c77dc8. 2023-09-15 23:03:34,694 DEBUG [RS:1;jenkins-hbase4:34705] regionserver.HRegionServer(1478): Online Regions={c1bbd79b4a7b2345bd057dfc3a1a2a94=hbase:namespace,,1694818874374.c1bbd79b4a7b2345bd057dfc3a1a2a94.} 2023-09-15 23:03:34,694 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1694818874374.c1bbd79b4a7b2345bd057dfc3a1a2a94. 2023-09-15 23:03:34,694 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1694818875113.d38939590183e4a5cb1ff6cb57c77dc8. after waiting 0 ms 2023-09-15 23:03:34,694 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing c1bbd79b4a7b2345bd057dfc3a1a2a94 1/1 column families, dataSize=78 B heapSize=488 B 2023-09-15 23:03:34,694 INFO [RS:2;jenkins-hbase4:41413] regionserver.HRegionServer(1474): Waiting on 2 regions to close 2023-09-15 23:03:34,694 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1694818875113.d38939590183e4a5cb1ff6cb57c77dc8. 2023-09-15 23:03:34,695 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-09-15 23:03:34,695 DEBUG [RS:2;jenkins-hbase4:41413] regionserver.HRegionServer(1478): Online Regions={d38939590183e4a5cb1ff6cb57c77dc8=hbase:acl,,1694818875113.d38939590183e4a5cb1ff6cb57c77dc8., 1588230740=hbase:meta,,1.1588230740} 2023-09-15 23:03:34,695 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing d38939590183e4a5cb1ff6cb57c77dc8 1/1 column families, dataSize=914 B heapSize=2.17 KB 2023-09-15 23:03:34,695 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-09-15 23:03:34,695 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-09-15 23:03:34,695 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-09-15 23:03:34,695 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-09-15 23:03:34,695 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=45.93 KB heapSize=71.92 KB 2023-09-15 23:03:34,695 DEBUG [RS:2;jenkins-hbase4:41413] regionserver.HRegionServer(1504): Waiting on 1588230740, d38939590183e4a5cb1ff6cb57c77dc8 2023-09-15 23:03:34,695 DEBUG [RS:1;jenkins-hbase4:34705] regionserver.HRegionServer(1504): Waiting on c1bbd79b4a7b2345bd057dfc3a1a2a94 2023-09-15 23:03:34,713 DEBUG [RS:0;jenkins-hbase4:33655] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/oldWALs 2023-09-15 23:03:34,713 INFO [RS:0;jenkins-hbase4:33655] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C33655%2C1694818872204:(num 1694818873958) 2023-09-15 23:03:34,714 DEBUG [RS:0;jenkins-hbase4:33655] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-15 23:03:34,714 INFO [RS:0;jenkins-hbase4:33655] regionserver.LeaseManager(133): Closed leases 2023-09-15 23:03:34,714 INFO [RS:0;jenkins-hbase4:33655] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-09-15 23:03:34,714 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-09-15 23:03:34,714 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-09-15 23:03:34,714 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-09-15 23:03:34,714 INFO [RS:0;jenkins-hbase4:33655] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-09-15 23:03:34,715 INFO [RS:0;jenkins-hbase4:33655] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-09-15 23:03:34,715 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-09-15 23:03:34,715 INFO [RS:0;jenkins-hbase4:33655] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-09-15 23:03:34,722 INFO [RS:0;jenkins-hbase4:33655] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:33655 2023-09-15 23:03:34,733 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/hbase/namespace/c1bbd79b4a7b2345bd057dfc3a1a2a94/.tmp/info/94c7d3452540422c8bb0c20e46a0bf3a 2023-09-15 23:03:34,735 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:41413-0x100b1d2daa90003, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,33655,1694818872204 2023-09-15 23:03:34,735 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-15 23:03:34,735 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:34705-0x100b1d2daa90002, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,33655,1694818872204 2023-09-15 23:03:34,735 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:33655-0x100b1d2daa90001, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,33655,1694818872204 2023-09-15 23:03:34,735 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:33655-0x100b1d2daa90001, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-15 23:03:34,735 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:41413-0x100b1d2daa90003, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-15 23:03:34,735 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:34705-0x100b1d2daa90002, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-15 23:03:34,735 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,33655,1694818872204] 2023-09-15 23:03:34,736 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,33655,1694818872204; numProcessing=1 2023-09-15 23:03:34,738 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,33655,1694818872204 already deleted, retry=false 2023-09-15 23:03:34,738 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,33655,1694818872204 expired; onlineServers=2 2023-09-15 23:03:34,740 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/hbase/namespace/c1bbd79b4a7b2345bd057dfc3a1a2a94/.tmp/info/94c7d3452540422c8bb0c20e46a0bf3a as hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/hbase/namespace/c1bbd79b4a7b2345bd057dfc3a1a2a94/info/94c7d3452540422c8bb0c20e46a0bf3a 2023-09-15 23:03:34,744 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/hbase/namespace/c1bbd79b4a7b2345bd057dfc3a1a2a94/info/94c7d3452540422c8bb0c20e46a0bf3a, entries=2, sequenceid=6, filesize=4.8 K 2023-09-15 23:03:34,745 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for c1bbd79b4a7b2345bd057dfc3a1a2a94 in 51ms, sequenceid=6, compaction requested=false 2023-09-15 23:03:34,749 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/hbase/namespace/c1bbd79b4a7b2345bd057dfc3a1a2a94/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-15 23:03:34,750 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-15 23:03:34,750 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1694818874374.c1bbd79b4a7b2345bd057dfc3a1a2a94. 2023-09-15 23:03:34,750 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for c1bbd79b4a7b2345bd057dfc3a1a2a94: 2023-09-15 23:03:34,750 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1694818874374.c1bbd79b4a7b2345bd057dfc3a1a2a94. 2023-09-15 23:03:34,775 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-09-15 23:03:34,775 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-09-15 23:03:34,837 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:33655-0x100b1d2daa90001, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-15 23:03:34,837 INFO [RS:0;jenkins-hbase4:33655] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,33655,1694818872204; zookeeper connection closed. 2023-09-15 23:03:34,837 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:33655-0x100b1d2daa90001, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-15 23:03:34,837 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@97ae8e9] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@97ae8e9 2023-09-15 23:03:34,856 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-09-15 23:03:34,856 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-09-15 23:03:34,896 DEBUG [RS:2;jenkins-hbase4:41413] regionserver.HRegionServer(1504): Waiting on 1588230740, d38939590183e4a5cb1ff6cb57c77dc8 2023-09-15 23:03:34,896 INFO [RS:1;jenkins-hbase4:34705] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,34705,1694818872254; all regions closed. 2023-09-15 23:03:34,901 DEBUG [RS:1;jenkins-hbase4:34705] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/oldWALs 2023-09-15 23:03:34,901 INFO [RS:1;jenkins-hbase4:34705] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C34705%2C1694818872254:(num 1694818873958) 2023-09-15 23:03:34,901 DEBUG [RS:1;jenkins-hbase4:34705] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-15 23:03:34,901 INFO [RS:1;jenkins-hbase4:34705] regionserver.LeaseManager(133): Closed leases 2023-09-15 23:03:34,901 INFO [RS:1;jenkins-hbase4:34705] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-09-15 23:03:34,902 INFO [RS:1;jenkins-hbase4:34705] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-09-15 23:03:34,902 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-09-15 23:03:34,902 INFO [RS:1;jenkins-hbase4:34705] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-09-15 23:03:34,902 INFO [RS:1;jenkins-hbase4:34705] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-09-15 23:03:34,903 INFO [RS:1;jenkins-hbase4:34705] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:34705 2023-09-15 23:03:34,904 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:34705-0x100b1d2daa90002, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:03:34,904 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:41413-0x100b1d2daa90003, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,34705,1694818872254 2023-09-15 23:03:34,904 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-15 23:03:34,906 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,34705,1694818872254] 2023-09-15 23:03:34,906 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,34705,1694818872254; numProcessing=2 2023-09-15 23:03:34,907 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,34705,1694818872254 already deleted, retry=false 2023-09-15 23:03:34,907 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,34705,1694818872254 expired; onlineServers=1 2023-09-15 23:03:35,006 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:34705-0x100b1d2daa90002, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-15 23:03:35,006 INFO [RS:1;jenkins-hbase4:34705] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,34705,1694818872254; zookeeper connection closed. 2023-09-15 23:03:35,006 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:34705-0x100b1d2daa90002, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-15 23:03:35,006 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@3b29e24] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@3b29e24 2023-09-15 23:03:35,096 DEBUG [RS:2;jenkins-hbase4:41413] regionserver.HRegionServer(1504): Waiting on 1588230740, d38939590183e4a5cb1ff6cb57c77dc8 2023-09-15 23:03:35,132 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=914 B at sequenceid=18 (bloomFilter=false), to=hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/hbase/acl/d38939590183e4a5cb1ff6cb57c77dc8/.tmp/l/c3ed59f4af104489b00a3a10e6c971f6 2023-09-15 23:03:35,133 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=40.45 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/hbase/meta/1588230740/.tmp/info/648f89b500b543e89b7ea7692d2e0a71 2023-09-15 23:03:35,136 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c3ed59f4af104489b00a3a10e6c971f6 2023-09-15 23:03:35,137 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 648f89b500b543e89b7ea7692d2e0a71 2023-09-15 23:03:35,137 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/hbase/acl/d38939590183e4a5cb1ff6cb57c77dc8/.tmp/l/c3ed59f4af104489b00a3a10e6c971f6 as hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/hbase/acl/d38939590183e4a5cb1ff6cb57c77dc8/l/c3ed59f4af104489b00a3a10e6c971f6 2023-09-15 23:03:35,141 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c3ed59f4af104489b00a3a10e6c971f6 2023-09-15 23:03:35,141 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/hbase/acl/d38939590183e4a5cb1ff6cb57c77dc8/l/c3ed59f4af104489b00a3a10e6c971f6, entries=7, sequenceid=18, filesize=5.2 K 2023-09-15 23:03:35,142 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~914 B/914, heapSize ~2.16 KB/2208, currentSize=0 B/0 for d38939590183e4a5cb1ff6cb57c77dc8 in 448ms, sequenceid=18, compaction requested=false 2023-09-15 23:03:35,151 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/hbase/acl/d38939590183e4a5cb1ff6cb57c77dc8/recovered.edits/21.seqid, newMaxSeqId=21, maxSeqId=1 2023-09-15 23:03:35,152 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.50 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/hbase/meta/1588230740/.tmp/rep_barrier/02f2184e14754d1ca128f7374d2548eb 2023-09-15 23:03:35,152 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-15 23:03:35,152 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:acl,,1694818875113.d38939590183e4a5cb1ff6cb57c77dc8. 2023-09-15 23:03:35,152 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for d38939590183e4a5cb1ff6cb57c77dc8: 2023-09-15 23:03:35,153 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:acl,,1694818875113.d38939590183e4a5cb1ff6cb57c77dc8. 2023-09-15 23:03:35,156 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 02f2184e14754d1ca128f7374d2548eb 2023-09-15 23:03:35,167 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.98 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/hbase/meta/1588230740/.tmp/table/ef4e40e8971947f98cd14d2c71ce3b9b 2023-09-15 23:03:35,171 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ef4e40e8971947f98cd14d2c71ce3b9b 2023-09-15 23:03:35,171 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/hbase/meta/1588230740/.tmp/info/648f89b500b543e89b7ea7692d2e0a71 as hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/hbase/meta/1588230740/info/648f89b500b543e89b7ea7692d2e0a71 2023-09-15 23:03:35,175 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 648f89b500b543e89b7ea7692d2e0a71 2023-09-15 23:03:35,175 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/hbase/meta/1588230740/info/648f89b500b543e89b7ea7692d2e0a71, entries=48, sequenceid=131, filesize=10.3 K 2023-09-15 23:03:35,176 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/hbase/meta/1588230740/.tmp/rep_barrier/02f2184e14754d1ca128f7374d2548eb as hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/hbase/meta/1588230740/rep_barrier/02f2184e14754d1ca128f7374d2548eb 2023-09-15 23:03:35,181 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 02f2184e14754d1ca128f7374d2548eb 2023-09-15 23:03:35,181 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/hbase/meta/1588230740/rep_barrier/02f2184e14754d1ca128f7374d2548eb, entries=13, sequenceid=131, filesize=6.4 K 2023-09-15 23:03:35,182 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/hbase/meta/1588230740/.tmp/table/ef4e40e8971947f98cd14d2c71ce3b9b as hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/hbase/meta/1588230740/table/ef4e40e8971947f98cd14d2c71ce3b9b 2023-09-15 23:03:35,186 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ef4e40e8971947f98cd14d2c71ce3b9b 2023-09-15 23:03:35,186 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/hbase/meta/1588230740/table/ef4e40e8971947f98cd14d2c71ce3b9b, entries=24, sequenceid=131, filesize=6.9 K 2023-09-15 23:03:35,187 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~45.93 KB/47028, heapSize ~71.88 KB/73600, currentSize=0 B/0 for 1588230740 in 492ms, sequenceid=131, compaction requested=false 2023-09-15 23:03:35,197 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/data/hbase/meta/1588230740/recovered.edits/134.seqid, newMaxSeqId=134, maxSeqId=1 2023-09-15 23:03:35,198 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-15 23:03:35,198 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-09-15 23:03:35,198 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-09-15 23:03:35,198 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-09-15 23:03:35,198 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-09-15 23:03:35,296 INFO [RS:2;jenkins-hbase4:41413] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,41413,1694818872288; all regions closed. 2023-09-15 23:03:35,301 DEBUG [RS:2;jenkins-hbase4:41413] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/oldWALs 2023-09-15 23:03:35,301 INFO [RS:2;jenkins-hbase4:41413] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C41413%2C1694818872288.meta:.meta(num 1694818874067) 2023-09-15 23:03:35,306 DEBUG [RS:2;jenkins-hbase4:41413] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/oldWALs 2023-09-15 23:03:35,306 INFO [RS:2;jenkins-hbase4:41413] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C41413%2C1694818872288:(num 1694818873958) 2023-09-15 23:03:35,306 DEBUG [RS:2;jenkins-hbase4:41413] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-15 23:03:35,306 INFO [RS:2;jenkins-hbase4:41413] regionserver.LeaseManager(133): Closed leases 2023-09-15 23:03:35,307 INFO [RS:2;jenkins-hbase4:41413] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-09-15 23:03:35,307 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-09-15 23:03:35,307 INFO [RS:2;jenkins-hbase4:41413] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:41413 2023-09-15 23:03:35,314 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:41413-0x100b1d2daa90003, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,41413,1694818872288 2023-09-15 23:03:35,314 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-15 23:03:35,315 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,41413,1694818872288] 2023-09-15 23:03:35,315 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,41413,1694818872288; numProcessing=3 2023-09-15 23:03:35,316 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,41413,1694818872288 already deleted, retry=false 2023-09-15 23:03:35,316 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,41413,1694818872288 expired; onlineServers=0 2023-09-15 23:03:35,316 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,44427,1694818870945' ***** 2023-09-15 23:03:35,316 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-09-15 23:03:35,316 DEBUG [M:0;jenkins-hbase4:44427] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@68a42f77, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-09-15 23:03:35,317 INFO [M:0;jenkins-hbase4:44427] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,44427,1694818870945 2023-09-15 23:03:35,317 INFO [M:0;jenkins-hbase4:44427] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,44427,1694818870945; all regions closed. 2023-09-15 23:03:35,317 DEBUG [M:0;jenkins-hbase4:44427] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-15 23:03:35,317 DEBUG [M:0;jenkins-hbase4:44427] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-09-15 23:03:35,317 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-09-15 23:03:35,317 DEBUG [M:0;jenkins-hbase4:44427] cleaner.HFileCleaner(317): Stopping file delete threads 2023-09-15 23:03:35,317 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1694818873542] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1694818873542,5,FailOnTimeoutGroup] 2023-09-15 23:03:35,317 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1694818873541] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1694818873541,5,FailOnTimeoutGroup] 2023-09-15 23:03:35,317 INFO [M:0;jenkins-hbase4:44427] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-09-15 23:03:35,317 INFO [M:0;jenkins-hbase4:44427] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-09-15 23:03:35,317 INFO [M:0;jenkins-hbase4:44427] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-09-15 23:03:35,317 DEBUG [M:0;jenkins-hbase4:44427] master.HMaster(1512): Stopping service threads 2023-09-15 23:03:35,317 INFO [M:0;jenkins-hbase4:44427] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-09-15 23:03:35,318 ERROR [M:0;jenkins-hbase4:44427] procedure2.ProcedureExecutor(652): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-14,5,PEWorkerGroup] Thread[HFileArchiver-15,5,PEWorkerGroup] 2023-09-15 23:03:35,318 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-09-15 23:03:35,318 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-15 23:03:35,318 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-09-15 23:03:35,318 INFO [M:0;jenkins-hbase4:44427] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-09-15 23:03:35,318 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-09-15 23:03:35,319 DEBUG [M:0;jenkins-hbase4:44427] zookeeper.ZKUtil(398): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-09-15 23:03:35,319 WARN [M:0;jenkins-hbase4:44427] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-09-15 23:03:35,319 INFO [M:0;jenkins-hbase4:44427] assignment.AssignmentManager(315): Stopping assignment manager 2023-09-15 23:03:35,319 INFO [M:0;jenkins-hbase4:44427] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-09-15 23:03:35,320 DEBUG [M:0;jenkins-hbase4:44427] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-09-15 23:03:35,320 INFO [M:0;jenkins-hbase4:44427] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-15 23:03:35,320 DEBUG [M:0;jenkins-hbase4:44427] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-15 23:03:35,320 DEBUG [M:0;jenkins-hbase4:44427] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-09-15 23:03:35,320 DEBUG [M:0;jenkins-hbase4:44427] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-15 23:03:35,320 INFO [M:0;jenkins-hbase4:44427] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=375.89 KB heapSize=452.12 KB 2023-09-15 23:03:35,333 INFO [M:0;jenkins-hbase4:44427] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=375.89 KB at sequenceid=899 (bloomFilter=true), to=hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/172455a7eb4f495999be5fab7f582b59 2023-09-15 23:03:35,338 INFO [M:0;jenkins-hbase4:44427] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 172455a7eb4f495999be5fab7f582b59 2023-09-15 23:03:35,339 DEBUG [M:0;jenkins-hbase4:44427] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/172455a7eb4f495999be5fab7f582b59 as hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/172455a7eb4f495999be5fab7f582b59 2023-09-15 23:03:35,342 INFO [M:0;jenkins-hbase4:44427] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 172455a7eb4f495999be5fab7f582b59 2023-09-15 23:03:35,343 INFO [M:0;jenkins-hbase4:44427] regionserver.HStore(1080): Added hdfs://localhost:44545/user/jenkins/test-data/ce035db2-99f6-03ab-d529-876c03b64a64/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/172455a7eb4f495999be5fab7f582b59, entries=119, sequenceid=899, filesize=28.7 K 2023-09-15 23:03:35,343 INFO [M:0;jenkins-hbase4:44427] regionserver.HRegion(2948): Finished flush of dataSize ~375.89 KB/384913, heapSize ~452.10 KB/462952, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 23ms, sequenceid=899, compaction requested=false 2023-09-15 23:03:35,345 INFO [M:0;jenkins-hbase4:44427] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-15 23:03:35,345 DEBUG [M:0;jenkins-hbase4:44427] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-09-15 23:03:35,348 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-09-15 23:03:35,348 INFO [M:0;jenkins-hbase4:44427] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-09-15 23:03:35,349 INFO [M:0;jenkins-hbase4:44427] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:44427 2023-09-15 23:03:35,351 DEBUG [M:0;jenkins-hbase4:44427] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,44427,1694818870945 already deleted, retry=false 2023-09-15 23:03:35,415 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:41413-0x100b1d2daa90003, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-15 23:03:35,416 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): regionserver:41413-0x100b1d2daa90003, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-15 23:03:35,416 INFO [RS:2;jenkins-hbase4:41413] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,41413,1694818872288; zookeeper connection closed. 2023-09-15 23:03:35,416 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@765231ad] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@765231ad 2023-09-15 23:03:35,416 INFO [Listener at jenkins-hbase4.apache.org/46629] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 3 regionserver(s) complete 2023-09-15 23:03:35,516 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-15 23:03:35,516 DEBUG [Listener at localhost/41597-EventThread] zookeeper.ZKWatcher(600): master:44427-0x100b1d2daa90000, quorum=127.0.0.1:51149, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-15 23:03:35,516 INFO [M:0;jenkins-hbase4:44427] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,44427,1694818870945; zookeeper connection closed. 2023-09-15 23:03:35,518 WARN [Listener at jenkins-hbase4.apache.org/46629] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-09-15 23:03:35,522 INFO [Listener at jenkins-hbase4.apache.org/46629] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-09-15 23:03:35,625 WARN [BP-1165591135-172.31.14.131-1694818867351 heartbeating to localhost/127.0.0.1:44545] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-09-15 23:03:35,625 WARN [BP-1165591135-172.31.14.131-1694818867351 heartbeating to localhost/127.0.0.1:44545] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1165591135-172.31.14.131-1694818867351 (Datanode Uuid 53f92d5c-5dc8-458f-b486-7f45b0a59549) service to localhost/127.0.0.1:44545 2023-09-15 23:03:35,627 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c5e9ebbf-ce0f-c6b3-3dce-6299f7b47f51/cluster_730e0029-aea3-8c57-14c7-897a98b383cd/dfs/data/data5/current/BP-1165591135-172.31.14.131-1694818867351] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-15 23:03:35,628 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c5e9ebbf-ce0f-c6b3-3dce-6299f7b47f51/cluster_730e0029-aea3-8c57-14c7-897a98b383cd/dfs/data/data6/current/BP-1165591135-172.31.14.131-1694818867351] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-15 23:03:35,629 WARN [Listener at jenkins-hbase4.apache.org/46629] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-09-15 23:03:35,630 INFO [Listener at jenkins-hbase4.apache.org/46629] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-09-15 23:03:35,733 WARN [BP-1165591135-172.31.14.131-1694818867351 heartbeating to localhost/127.0.0.1:44545] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-09-15 23:03:35,733 WARN [BP-1165591135-172.31.14.131-1694818867351 heartbeating to localhost/127.0.0.1:44545] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1165591135-172.31.14.131-1694818867351 (Datanode Uuid 3096ce5d-6737-4bb9-97d0-468fc9af91c7) service to localhost/127.0.0.1:44545 2023-09-15 23:03:35,734 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c5e9ebbf-ce0f-c6b3-3dce-6299f7b47f51/cluster_730e0029-aea3-8c57-14c7-897a98b383cd/dfs/data/data3/current/BP-1165591135-172.31.14.131-1694818867351] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-15 23:03:35,753 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c5e9ebbf-ce0f-c6b3-3dce-6299f7b47f51/cluster_730e0029-aea3-8c57-14c7-897a98b383cd/dfs/data/data4/current/BP-1165591135-172.31.14.131-1694818867351] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-15 23:03:35,754 WARN [Listener at jenkins-hbase4.apache.org/46629] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-09-15 23:03:35,757 INFO [Listener at jenkins-hbase4.apache.org/46629] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-09-15 23:03:35,859 WARN [BP-1165591135-172.31.14.131-1694818867351 heartbeating to localhost/127.0.0.1:44545] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-09-15 23:03:35,859 WARN [BP-1165591135-172.31.14.131-1694818867351 heartbeating to localhost/127.0.0.1:44545] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1165591135-172.31.14.131-1694818867351 (Datanode Uuid bc7c6f42-1888-4c37-b025-d0ceb970c9c9) service to localhost/127.0.0.1:44545 2023-09-15 23:03:35,860 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c5e9ebbf-ce0f-c6b3-3dce-6299f7b47f51/cluster_730e0029-aea3-8c57-14c7-897a98b383cd/dfs/data/data1/current/BP-1165591135-172.31.14.131-1694818867351] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-15 23:03:35,860 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c5e9ebbf-ce0f-c6b3-3dce-6299f7b47f51/cluster_730e0029-aea3-8c57-14c7-897a98b383cd/dfs/data/data2/current/BP-1165591135-172.31.14.131-1694818867351] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-15 23:03:35,884 INFO [Listener at jenkins-hbase4.apache.org/46629] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-09-15 23:03:36,010 INFO [Listener at jenkins-hbase4.apache.org/46629] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-09-15 23:03:36,104 INFO [Listener at jenkins-hbase4.apache.org/46629] hbase.HBaseTestingUtility(1293): Minicluster is down